Estonian Trends: a daily-updated monitor corpus of news articles

The Estonian Trends corpus is an Estonian monitor corpus made up of news articles or other sources that are regularly updated from their RSS feeds (newsfeeds). The Estonian trends corpus is updated daily with new texts and grows by about 200,000 words each day. These regular updates enable you to use the diachronic analysis tool  including the timeline show_chart function and study word usage changes.

Part-of-speech tagset

The Estonian Trends corpus was annotated by the Estonian NLTK tool tagger using the following Estonian Filosoft tagset.

How is the Estonian Trends corpus updated?

New texts are downloaded every four hours. Every Tuesday and Friday, all texts downloaded until the previous day are added to the corpus. Duplicate and near-duplicate texts within the same month are removed, but they are kept in different months, e.g. if the same text appears in June twice, only one instance is kept. If the same text appears once in June and once in July, both are kept.

Search the Estonian Trends corpus

Sketch Engine offers a range of tools to work with this Estonian Trends corpus from news articles.

Where to find Trends

The texts in the corpus are timestamped which enables users to use Trends, the diachronic analysis tool for detecting neologisms and studying word usage changes

Estonian Trends corpus – Dashboard

Tools to work with the Estonian Trends corpus

A complete set of tools is available to work with this Estonian Trends corpus from news to generate:

  • word sketch – Estonian collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word and multi-word units
  • word lists – lists of Estonian nouns, verbs, adjectives, etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • trends – diachronic analysis automatically identifies neologisms and changes in use
  • text type analysis – statistics of metadata in the corpus

TenTen corpora

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

Other text corpora

Sketch Engine offers 800+ language corpora.

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.