CatalanWaC: Catalan web corpus
The Catalan web corpus (CatalanWaC) is a language corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).
Data was crawled by the SpiderLing web spider in 2014. The corpus size after cleaning and deduplication is 180 million words.
Part-of-speech tagset
The CatalanWaC corpus was tagged with the FreeLing morphological tagger using POS tags based on the proposals by EAGLES, see the Catalan part-of-speech tagset.
Tools to work with the Catalan Web corpus
A complete set of Sketch Engine tools is available to work with this Catalan Web corpus to generate:
- word sketch – Catalan collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- word lists – lists of Catalan nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
Changelog
version 1 (2017)
- filtering French and Spanish
- created Catalan word sketches
initial version (2014)
- size 17 million words
Bibliography
Corpus factory method
Kilgarriff, A., Reddy, S., Pomikálek, J., & Avinesh, P. V. S. (2010, May). A corpus factory for many languages. In LREC.
Search the Catalan Web corpus
Sketch Engine offers a range of tools to work with the CatalanWaC corpus.
or
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.