deWaC – German corpus from the .de domain
The German web corpus (deWaC) is a German corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).
Data was crawled by the SpiderLing web spider in 2009 and comprises more than 1.34 billion words.
sdeWaC: Parsed German web corpus
The sdeWaC corpus is a 755-million-word subset of German web corpus prepared by Getrud Faaß and Kerstin Eckart and later automatically annotated by Janina Kopp and Niels Ott in 2012. The sdeWaC does not contain duplications. It was parsed by TreeTagger and FSPar dependency parser which carried out sentence analysis.
The corpus is tagged with TreeTagger using the Stuttgart-Tubingen tagset.
Tools to work with the German web corpus
A complete set of Sketch Engine tools is available to work with these German corpora to generate:
- without duplications
- parsed by TreeTagger and FSPar dependency parser
- initial version 1,3 billion words
- tagged by TreeTagger
BARONI, Marco, et al. The WaCky wide web: a collection of very large linguistically processed web-crawled corpora. Language resources and evaluation, 2009, 43.3: 209-226.
Corpus factory method
Adam Kilgarriff, Siva Reddy, Jan Pomikálek, and Avinesh PVS. A corpus factory for many languages. In LREC workshop on Web Services and Processing Pipelines, Malta, May 2010.
FAAß, Gertrud; ECKART, Kerstin. Sdewac–a corpus of parsable sentences from the web. In: Language processing and knowledge in the Web. Springer, Berlin, Heidelberg, 2013. p. 61-68.
German word sketch (sdeWaC)
Ivanova, K., Heid, U., Im Walde, S. S., Kilgarriff, A., & Pomikálek, J. (2008, May). Evaluating a German Sketch Grammar: A Case Study on Noun Phrase Case. In LREC.
Search the German corpus
Sketch Engine offers a range of tools to work with this German corpus.
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.