csTenTen: Corpus of the Czech Web

The Czech Web Corpus (csTenTen) is a Czech corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of web corpora built using the same method with a target size of 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages.

The most recent version of the csTenTen corpus consists of 6.2 billion words. The texts were downloaded in December 2019 and January 2020, the Wikipedia part was downloaded in December 2019. The sample texts of the biggest web domains which account for 54% of all corpus texts were checked semi-manually and content with poor quality text and spam was removed.

Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.

Before 2018, the corpus was called czTenTen.

Part-of-speech tagset and lemmatization

The csTenTen corpus was POS annotated by the Majka tool using the following POS tagset. The corpus texts also contain lemmatization when each word form from the corpus is assigned to its base form (lemma).

Genre annotation and topic classification

A part of the Czech Web 2019 corpus contains genre annotation and topic classification. These can be displayed as corpus structures in Concordance or in the Text type Analysis tool. Genres refer to writing styles and are divided into four groups (blog, discussion, fiction, legal, news, reference/encyclopedia) whereas topic classification is inspired by categories used by https://curlie.org/ (formerly dmoz.org) and includes the following topics: beauty & fashion, cars & bikes, culture & entertainment, economy finance & business, games, health, history, hobbies, home family & children, nature & environment, pets & animal, politics & government, religion, science, sex, sports, technology & IT, and travel & tourism.

  • genres cover 14.2% of the corpus, i.e. 1.08 billion tokens
  • topic classification covers 14.2% of the corpus, i.e. 18.6 billion tokens

Hover over the chart to display a number of tokens of the particular topic.

Basic information

Frequency
Tokens 7,614,652,084
Words 6,280,217,621
Sentences 412,795,974
Web pages 20,390,192

Preloaded subcorpora

A list of preloaded subcorpora (based on the top-level domains or genre annotation and topic classification) that are available in the Czech Web 2019 corpus.

Subcorpus Tokens % of the whole corpus
Czech Wikipedia 138,743,995 1.82
Czech domain .cz 6,861,860,711 90.114
Genre Blog 167,610,864 2.201
Genre Discussion 186,325,731 2.447
Genre Fiction 15,269,992 0.201
Genre Legal 3,561,409 0.047
Genre News 533,007,927 7.00
Genre Reference/Encyclopedia 177,635,171 2.333
Topic Beauty & Fashion 11,868,826 0.156
Topic Cars & Bikes 86,587,451 1.137
Topic Culture & Entertainment 220,624,708 2.897
Topic Economy, Finance & Business 151,209,192 0.831
Topic Education 21,801,905 0.286
Topic Games 85,424,822 1.122
Topic Health 73,052,119 0.959
Topic History 31,812,264 0.418
Topic Hobbies 111,837,888 1.469
Topic Home, Family & Children 1.469 0.90
Topic Pets & Animals 42,383,994 0.557
Topic Politics & Government 56,596,868 0.743
Topic Religion 14,476,433 0.19
Topic Science 36,475,330 0.479
Topic Sex 6,342,518 0.083
Topic Sports 134,007,070 1.76
Topic Technology & IT 256,462,158 3.368
Topic Travel & Tourism 6,513,771 0.086

Overview of Czech TenTen corpora

Czech web corpora csTenTen were crawled and processed repeatedly during the last years:

  • Czech Web corpus 2019 (csTenTen19) – 6.2 billion words, genre annotation and topic classification, semi-manual check of corpus texts
  • Czech Web corpus 2017 (csTenTen17) – 10.5 billion words (subcorpora: 2017, 2016, 2015 years and Wikipedia texts)
  • Czech Web corpus 2012 (csTenTen12) – 4 billion words

Tools to work with the Czech corpora from the web

A complete set of Sketch Engine tools is available to work with this Czech corpus to generate:

  • word sketch – Czech collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word and multi-word units
  • word lists – lists of Czech nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

csTenTen19 (May 2023)

  • 7.6 billion tokens
  • genre and topic classification

new version of the csTenTen corpus from 2017 (November 2018)

  • crawled by SpiderLing in May, October and November 2017, October and November 2016, October and November 2015 + Czech Wikipedia from November 2017
  • Encoded in UTF-8, cleaned, deduplicated, tagged using majka+desamb pipeline v2

version 9 (2018-10-19)

  • renamed from czTenTen to csTenTen

version 9 (2017-05-20)

  • added lempos (a combination of lemma and one-letter abbreviation of the part of speech, e.g. dům-n)

version 8 (2014-09-17)

  • M ? j removed

Thanks to Marek Grác for spotting much errors and contributing to a cleaner corpus.

version 7 (2014-08-04)

  • Paragraphs without accents removed.

version 6 (June 2014)

  • Machine translated documents from domains infostar.cz and navajo.cz removed.

version 5 (May 2014)

  • Malformed vertical lines corrected (MacLeodovy MacL eodůvk2eAgFnPc1d1 –> MacLeodovy MacLeodův k2eAgFnPc1d1).

version 4 “clean 2” (March 2014)

  • Documents containing a certain wrong character caused by wrong encoding detection were removed.

version 3 “clean” (2013)

  • Paragraphs containing more than 20 % of words not recognized by morphological analyzer Majka were removed.

version 2 (December 2012)

version 1 (September 2012)

  • tagged by Majka + Desamb

version 1 untagged (April 2012)

  • initial version – 4.8 G words

TenTen corpora

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

csTenTen corpus

Suchomel, Vít (2018). csTenTen17, a Recent Czech Web Corpus. In Twelveth Workshop on Recent Advances in Slavonic Natural Language Processing. Brno: Tribun EU, 2018. pp. 111–123.

Suchomel, Vít (2012). Recent Czech Web Corpora. In 6th Workshop on Recent Advances in Slavonic Natural Language Processing. Brno, pp. 77–83.

Search the Czech corpus csTenTen

Sketch Engine offers a range of tools to work with this Czech corpus.

register for free trial

or

subscribe
about Sketch Engine

Other text corpora

Sketch Engine offers 700+ language corpora.

available corpora

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract. Use our Quick Start Guide to learn it in minutes.

Quick Start Guide