faTenTen: Corpus of the Persian Web

The Persian Web (faTenTen) is a Persian corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family. Sketch Engine currently provides access to TenTen corpora in more than 50 languages. The corpora are built using technology specialized in collecting only linguistically valuable web content.

For detailed information about TenTen corpora, see Common TenTen corpora attributes.

The most recent version of the faTenTen corpus consists of 7 billion words. The texts were downloaded in 2018.

Part-of-speech tagset and lemmatization

The corpus is not part of speech tagged nor lemmatized.

Overview of Persian TenTen corpora

These web corpora were crawled and processed repeatedly during the years:

  • Persian Web corpus 2018 (faTenTen18) – 7 billion words

Persian Web 2018 corpus sizes

Number of words 7+ billion
Number of tokens 8+ billion
Number of sentences 130+ thousand
Number of web pages 20+ million

Search the Persian Web

Sketch Engine offers a range of tools to work with this Persian corpus.

open in Sketch Engine
about Sketch Engine

Tools to work with the Persian Web 2018 corpus from the web

A complete set of Sketch Engine tools is available to work with this Persian corpus to generate:

  • word sketch – Persian collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word units
  • word lists – lists of Persian words organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

Persian Web 2018 (faTenTen18)

version fatenten18 (October 2018)

  • 7 billion words
  • no tagging or lemmatization

TenTen corpora

SUCHOMEL, Vít. Better Web Corpora For Corpus Linguistics And NLP. 2020. Available also from: https://is.muni.cz/th/u4rmz/. Doctoral thesis. Masaryk University, Faculty of Informatics, Brno. Supervised by Pavel RYCHLÝ.

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

Other Persian corpora

Sketch Engine offers dozens of Persian language corpora.

available Persian corpora

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.

Quick Start Guide