deTenTen: Corpus of the German Web
The German Web Corpus (deTenTen) is a corpus made up of texts collected from the internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages.
The newest deTenTen German corpus consists of 5.3 billion words of texts collected from the web in December 2018 and January 2019. The corpus contains lemmatization including gender lemmas and part-of-speech tagging.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Part-of-speech tagset
This German corpus was tagged by RFTagger using this POS tagset.
Overview of German TenTen corpora
These web corpora were crawled and processed repeatedly over the years:
- German Web corpus 2018 (enTenTen18) – 5.3 billion words
- German Web corpus 2013 (enTenTen13) – 16.5 billion words
- German Web corpus 2010 (enTenTen10) – 2.3 billion words
German Web 2018 corpus in detail
Distribution of top-level domains
Basic frequency statistics of the German Web 2018 corpus
| Tokens | 6,382,147,542 |
| Words | 5,346,041,196 |
| Sentences | 342,730,929 |
| Web pages | 13,767,030 |
Tool work with the German corpus from the web
A complete set of Sketch Engine tools is available to work with this German corpus to generate:
- word sketch – German collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- keywords – terminology extraction of one-word and multi-word units
- word lists – lists of German nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
Changelog
German Web corpus (deTenTen13)
- data crawled in December 2018 and January 2019 – 6.3 billion tokens
German Web corpus (deTenTen13)
- data crawled in 2013 – 16.5 billion tokens
German Web corpus (deTenTen10)
- version 2.0 (28 April 2011)
- fixed problems with part-of-speech tagging which caused a major data loss in the previous version
- 2.8 billion tokens
- version 1.0 (30 November 2010)
- initial version – 1.2 billion tokens
Bibliography
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen Corpus Family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Search the German corpus
Sketch Engine offers a range of tools to work with this German corpus from the web.
Use Sketch Engine in minutes
Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.
