corpus from the web

Build a corpus from the web

The web is a great source of readily available textual data but also a bottomless warehouse of spam, machine-generated content and duplicated content unsuitable for linguistic analysis. This may generate some uncertainty about the quality of the language included in the corpora from the web. At Sketch Engine, we are very well aware of the […]

Concordance from enTenTen13 English corpus

POS tags

This blog post defines what POS tags are, explains manual and automatic tagging and points readers to Sketch Engine where they can have their texts tagged automatically in many languages. What is a POS tag? A POS tag (or part-of-speech tag) is a special label assigned to each token (word) in a text corpus to indicate […]

Screenshot from OneClick Terms – term extraction tool

The best term extraction

Term extraction or terminology extraction is an automatic method of analysing text in order to identify phrases which fulfil the criteria for terms. Terminology extraction has its use in translation and terminology management but also in text analytics where it is used for topic modelling, data mining and information retrieval from unstructured text.

Screenshot of thesaurus from esTenTen Spanish corpus

Automatic thesaurus

By definition, a thesaurus (plural thesauri, pronounced [-rai]) is a type of dictionary which lists synonyms or words from the same semantic category, e.g. animals, furniture etc.