etTenTen: Corpus of the Estonian Web

The Estonian Web Corpus (etTenTen) is an Estonian language corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages.

The Estonian Web 2019 corpus was crawled by the SpiderLing web spider from September 2019 to January 2020. The final size of the corpus consists of 500+ million words. The Estonian Web 2019 corpus contains semi-automatically detected text types such as news, blogs, discussion, education, …

Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.

Part-of-speech tagset

The etTenTen corpus was annotated by the Estonian NLTK tool tagger using the following Estonian Filosoft tagset.

Overview of Estonian TenTen corpora

These web corpora were crawled and processed repeatedly during the years:

  • Estonian Web corpus 2019 (etTenTen19) – 508 million words (September 2019 – January 2020; semi-automatically detected Text types)
  • Estonian Web corpus 2017 (etTenTen15) – 658 million words (July–November 2017)
  • Estonian Web corpus 2013 (etTenTen13) – 260 million words

etTenTen corpus in detail

The chart shows the distribution of the parts of speech in the Estonian Web corpus 2019.

Basic information

Frequency
Tokens 622,999,541
Words 508,447,009
Sentences 41,819,737
Web pages 2,535,829

Tools to work with the Estonian Web corpora

A complete set of Sketch Engine tools is available to work with these Estonian corpora to generate:

  • word sketch – Estonian collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word and multi-word units
  • word lists – lists of Estonian nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context

etTenTen 2017 (February 2021)

  • tagged with the Filosoft tagset (Estonian NLTK + Filosoft pipeline v.2)

etTenTen 2019 (January 2021)

  • crawled by SpiderLing from September 2019 to January 2020
  • 622 million tokens
  • tagged with the Filosoft tagset (Estonian NLTK + Filosoft pipeline v.2)
  • semi-automatically detected Text types

etTenTen 2017 (February 2018)

  • crawled by SpiderLing from July to November 2017
  • 807 million tokens

etTenTen 2013 (May 2017)

  • new word sketches

etTenTen 2013 (May 2014)

  • tagging & word sketches
  • tagged with the Filosoft tagset (Estonian NLTK + Filosoft pipeline v.1)

etTenTen 2013 (March 2013)

  • obtained from the web in January 2013
  • 260 million words
  • no tagging

TenTen corpora

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

Search the Estonian corpus

Sketch Engine offers a range of tools to work with the etTenTen corpus.

or

Other text corpora

Sketch Engine offers 500+ language corpora.

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.