huTenTen: Corpus of the Hungarian Web
The Hungarian Web Corpus (huTenTen) is a Hungarian corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 30 languages.
Data was crawled by the SpiderLing web spider in June 2012 and comprised of almost 2.5 billion words.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Part-of-speech tagset
The huTenTen corpus was POS annotated with two different part-of-speech tagsets:
- MSD code tagset (used also in the National Hungarian corpus HNC)
- emMorph tagset
Tools to work with the Hungarian corpus
A complete set of Sketch Engine tools is available to work with this Hungarian corpus to generate:
- word sketch – Hungarian collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- word lists – lists of Hungarian nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
Changelog
huTenTen (hunpos version 2)
- lemmatized
- tag with new PoS tagset
version 1.0
- initial version, obtained from the web in 2012
Bibliography
TenTen corpora
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).
Search the Hungarian corpus
Sketch Engine offers a range of tools to work with this Hungarian corpus.
or
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.
