koTenTen: Corpus of the Korean Web
The Korean Web Corpus (koTenTen) is a Korean corpus made up of texts collected from the Internet. It belongs to the TenTen corpus family containing corpora in more than than 30 languages. The corpora are built using technology specialized in collecting only linguistically valuable web content.
Data was crawled by the SpiderLing web spider in August & September 2012 and from December 2017 to April 2018.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
The koTenTen copora were annotated by the POS tagger HanNanum using following simplified tagset.
Overview of Korean TenTen corpora
These web corpora were crawled and processed repeatedly during the last ten years:
- Korean Web corpus 2018 (koTenTen18) – 1,7 billion words
- Korean Web corpus 2012 (koTenTen12) – 461 million words