trTenTen: Corpus of the Turkish Web
The Turkish Web Corpus (trTenTen) is a Turkish corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 30 languages.
Data was crawled by the SpiderLing web spider in December 2011 and January 2012 and comprised of more than 3.3 billion words in 12 million documents.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Part-of-speech tagging and stemming
This Turkish corpus was processed by TRMorph tool which provides part-of-speech tags and stems (parts of words without affixes). More information about the tool can be found in Bibliography.
Part-of-speech tagset
The trTenTen corpus is POS tagged with the Turkish TRMorph tagset.
Tools to work with the Turkish corpus
A complete set of Sketch Engine tools is available to work with this Turkish corpus from the web to generate:
- keywords – terminology extraction of one-word units
- word lists – lists of Turkish nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
Changelog
universal word sketches (February 2018)
- created universal word sketches
tagged version (April 2017)
- part-of-speech tagging
initial version (March 2012)
- initial version 3.3 billion words
- no tagging, no sketches
Bibliography
Vít Baisa and Vít Suchomel (2012). Large Corpora for Turkic Languages and Unsupervised Morphological Analysis. In Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), Turkey, May 2012, pp. 28–32.
TRMorph tool (part-of-speech tagging, stemming)
(2014) A Set of Open Source Tools for Turkish Natural Language Processing In: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14) Ed. by N. Calzolari et al. 1079–1086 [pdf] [bib]
(2010) A Freely Available Morphological Analyzer for Turkish In: Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC 2010) 820–827
TenTen corpora
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).
Word Sketches
Ambati, B. R., Reddy, S., & Kilgarriff, A. (2012). Word Sketches for Turkish. In LREC (pp. 2945-2950).
Use Sketch Engine in minutes
Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.