frTenTen: Corpus of the French Web

The French Web Corpus (frTenTen) is a French corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages. The French Web corpus contains many varieties of the French language – European, Canadian and African French.

Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.

The most recent version of the frTenTen corpus consists of 20.9 billion words. The texts were downloaded between 2019 and 2021. The sample texts of the biggest web domains which account for 50% of all corpus texts were checked semi-manually and content with poor quality text and spam was removed.

Part-of-speech tagset

The French Web corpora are annotated by the FreeLing tool using the following POS tags. The French Web 2012 corpus (frTenTen12) was annotated by the TreeTagger tool using the following POS tags.

Overview of French TenTen corpora

This is a list of French Web corpora available in Sketch Engine:

  • French Web corpus 2020 (frTenTen20) – 20.9 billion words, genre annotation and topic classification (FreeLing tagset)
  • French Web corpus 2017 (frTenTen17) – 5.7 billion words (FreeLing tagset)
  • French Web corpus 2012 (frTenTen12) – 9.8 billion words (TreeTagger tagset)

Genre annotation and topic classification

A part of the French Web 2020 corpus contains genre annotation and topic classification. These can be displayed as corpus structures in Concordance or in the Text type Analysis tool. Genres refer to writing styles and are divided into three groups (blog, discussion) whereas topic classification is inspired by categories used by https://curlie.org/ (formerly dmoz.org) and includes the following topics: arts, business, games, health, home, recreation, reference, science, sport, society, and technology.

  • genres cover 1.3% of the corpus, i.e. 312 million tokens
  • topic classification covers 12.2% of the corpus, i.e. 2.19 billion tokens

Hover on the chart to display a number of tokens of the particular topic.

Basic frequency statistics of the French Web 2020 corpus

Tokens 24,575,992,729
Words 20,903,371,891
Sentences 980,123,917
Web pages 51,692,925

Tools to work with the French corpus from the web

A complete set of Sketch Engine tools is available to work with this French corpus to generate:

  • word sketch – French collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word and multi-word units
  • word lists – lists of French nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

frTenTen20 (August 2022)

  • downloaded by SpiderLing in Oct, Nov & Dec 2019, Jan 2020, Dec 2020 and Jan 2021
  • initial version – 26,774,601,851 billion tokens
  • annotated by FreeLing pipeline v3
  • new term grammar 2.0

frTenTen17 (December 2018)

  • crawled in December 2017
  • annotated by FreeLing pipeline v2

frTenTen12 version 2 (February 18 2015)

  • retokenised and processed with up-to-date versions of tools (TreeTagger pipeline v2)
  • Spanish documents filtered out

frTenTen12 version 1 (April 2012)

  • initial version – 10.7 billion word (February 2012)
  • annotated by TreeTagger pipeline

TenTen corpora

SUCHOMEL, Vít. Better Web Corpora For Corpus Linguistics And NLP. 2020. Available also from: https://is.muni.cz/th/u4rmz/. Doctoral thesis. Masaryk University, Faculty of Informatics, Brno. Supervised by Pavel RYCHLÝ.

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

Genre annotation

SUCHOMEL, Vít. Genre Annotation of Web Corpora: Scheme and Issues. In Kohei Arai, Supriya Kapoor, Rahul Bhatia. Proceedings of the Future Technologies Conference (FTC) 2020, Volume 1. Vancouver, Canada: Springer Nature Switzerland AG, 2021. s. 738-754. ISBN 978-3-030-63127-7. doi:10.1007/978-3-030-63128-4_55.

Search the French corpus

Sketch Engine offers a range of tools to work with this French corpus.

or

Other French corpora

Sketch Engine offers dozens of French language corpora.

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.