urWaC: Urdu corpus from the web

The Urdu web corpus (urWaC) is an Urdu corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).

Data was crawled by the SpiderLing web spider in 2015 and comprised of more than 53 million. The UrduWaC corpus has not tagged yet.

Tools to work with the Urdu corpus

A complete set of tools is available to work with this UrduWaC corpus to generate:

  • word lists – lists of Urdu nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • keywords– terminology extraction of one-word
  • text type analysis – statistics of metadata in the corpus

Corpus factory method

Adam Kilgarriff, Siva Reddy, Jan Pomikálek, and Avinesh PVS. A corpus factory for many languages. In LREC workshop on Web Services and Processing Pipelines, Malta, May 2010.

Search the Urdu corpus

Sketch Engine offers a range of tools to work with this Urdu corpus.

Other text corpora

Sketch Engine offers 800+ language corpora.

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.