deTenTen: Corpus of the German Web
The German Web Corpus (deTenTen) is a corpus made up of texts collected from the internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 30 languages.
This deTenTen German corpus consists of 16.5 billion words of texts collected from the web in 2013. The corpus contains lemmatization including gender lemmas and part-of-speech tagging.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Part-of-speech tagset
This German corpus was tagged by RFTagger using this POS tagset.
Overview of German TenTen corpora
These web corpora were crawled and processed repeatedly over the years:
- German Web corpus 2013 (enTenTen13) – 16.5 billion words
- German Web corpus 2010 (enTenTen10) – 2.3 billion words
deTenTen corpus in detail
The chart shows the distribution of the parts of speech in the German Web corpus 2013.
Further information about texts in the corpus
Basic information
Frequency | |
Tokens | 19,808,173,163 |
Words | 16,526,335,416 |
Sentences | 1,095,990,180 |
Web pages | 49,993,180 |
Distribution of top-level domains
Tool work with the German Web corpus
A complete set of Sketch Engine tools is available to work with this German corpus to generate:
- word sketch – German collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- keywords – terminology extraction of one-word and multi-word units
- word lists – lists of German nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
Changelog
German Web corpus (deTenTen13)
- obtained in 2013 – 16.5 billion tokens
German Web corpus (deTenTen10)
- version 2.0 (28 April 2011)
- fixed problems with part-of-speech tagging which caused a major data loss in the previous version
- 2.8 billion tokens
- version 1.0 (30 November 2010)
- initial version – 1.2 billion tokens
Bibliography
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen Corpus Family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Search the German corpus
Sketch Engine offers a range of tools to work with this German corpus from the web.
Use Sketch Engine in minutes
Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.