teTenTen: Corpus of the Telugu Web

The Telugu Web Corpus (teTenTen) is a Telugu corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family that is a set of web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages.

Data was crawled by the SpiderLing tool from the Web and Wikipedia in 2021. Then texts were cleaned, deduplicated, and tagged with the final size of 101 million words.

For detailed information about TenTen corpora, see  Common TenTen corpora attributes.

Part-of-speech tagset

The Telugu corpus was tagged by the Cross Language POS Tagger for Indian languages with the following tagset.

Overview of Telugu TenTen corpora

These web corpora were crawled and processed repeatedly during the years:

  • Telugu Web corpus 2021 (teTenTen21) – 101 million words, tagging and lemmatization
  • Telugu Web corpus 2017 (teTenTen17) – 126 million words, tagging and lemmatization

Tools to work with the Telugu corpus

A complete set of tools is available to work with this Telugu corpus to generate:

  • word sketch – Telugu collocations categorized by grammatical relations
  • keywords – terminology extraction of one-word units
  • thesaurus – synonyms and similar words for every word
  • word lists – lists of Telugu nouns, verbs, adjectives, etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

Telugu Web Corpus (teTenTen)

2017

  • the initial version of the corpus crawled by SpiderLing in 2017

2021

  • cleaned – final size 122 million tokens
  • lemmatized and PoS tagged by Telugu Tagger

TenTen corpora

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

PoS tagging

Reddy, S., & Sharoff, S. (2011). Cross Language POS Taggers (and other Tools) for Indian Languages: An Experiment with Kannada using Telugu Resources. In Proceedings of the Fifth International Workshop On Cross Lingual Information Access. Chiang Mai, Thailand. (pp. 11–19).

Search the Telugu corpus

Sketch Engine offers a range of tools to work with this Telugu corpus from the web.

open in Sketch Engine
about Sketch Engine

Other text corpora

Sketch Engine offers 800+ language corpora.

available corpora

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.

Quick Start Guide