The Wikipedia Partnership Corpora are a set of text corpora created from (target:) every language version of Wikipedia. Each corpus contains the texts of all the articles of the particular Wikipedia, including formatting and metadata; templates are not expanded.

The corpora are developed and hosted by Sketch Engine in partnership with the Wikimedia movement and made available free of charge to active Wikipedians for analyzing, maintaining and improving of Wikipedia. Established contributors to Wikimedia projects can request access by following instructions on a special page on Meta-Wiki. Access to these corpora is also included in a Sketch Engine subscription.

For regular corpus linguistic research, cleaned and deduplicated plain texts of Wikipedia articles (with templates expanded) might be more useful. These are available either as a subcorpus of the corresponding TenTen corpus, or as a stand-alone Respective-Language Wikipedia corpus.

Wikipedia Partnership corpora are currently available for the following languages:

The corpora were created using Wiki2Corpus 3.0, Sketch Engine’s bespoke Wikipedia processing tool, from Wikipedia snapshots published by Wikimedia Enterprise, with support from the Wikimedia Foundation. They are regularly updated, with the target update period of 1 year.

Part-of-speech tagset and lemmatization

Many of the Wikipedia Partnership Corpora are part-of-speech tagged, indicating the part of speech and grammatical category of each word using the tagset available for the respective language at the respective time. The corpus texts are also lemmatized, where applicable, meaning that each word form in the corpus is assigned to its base form (lemma).

Rich markup (formatting)

All markup present in the source Wikipedia articles (e.g. bold text, section titles, links, images) is preserved in the Wikipedia Partnership Corpora. The information is encoded as corpus structures and structural attributes, modelled after the MediaWiki DOM Spec. This data, possibly linked with part-of-speech tagging and lemmatization, may be used to construct powerful corpus queries that support the research of Wikipedia content. Community-maintained lists of ready-made queries are available on language-specific subpages at Meta-Wiki.

Wikipedia Partnership Corpora

This is a set of corpora created from many language versions of Wikipedia.

See the Meta-Wiki page
about Sketch Engine

Tools to work with the Wikipedia Partnership Corpora

A complete set of Sketch Engine tools is available to work with some of these corpora (support varies by language) to generate:

  • word sketch – collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word and multi-word units
  • word lists – lists of nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

Wikipedia Partnership Corpora

initial release of 5 corpora (mid-October 2026)

  • Czech
  • English
  • Esperanto
  • Serbian
  • Slovak

Wikipedia Partnership Corpora

BLAHUŠ, M., & NEČAS, O. (2026). Korpus z Wikipedie. In Celorepublikové wikisetkání. Praha: Wikimedia Česká republika, 17. října 2026. To be published.

Wiki2Corpus tool

NEČAS, Ondřej. Bachelor’s thesis. Brno: Masaryk University, 2027. To be published.

Other text corpora

Sketch Engine offers hundreds of language corpora.

available corpora

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.

Quick Start Guide