English TreeTagger PoS tagset with Sketch Engine modifications
A tagset is a list of part-of-speech tags (POS tags for short), i.e. labels used to indicate the part of speech and sometimes also other grammatical categories (case, tense etc.) of each token in a text corpus.
Modified English TreeTagger part-of-speech tagset is available in English corpora annotated by the tool TreeTagger that was developed by Helmut Schmid in the TC project at the Institute for Computational Linguistics of the University of Stuttgart and containing modifications developed by Sketch Engine (currently pipeline version 2).
This is modified tagset of default TreeTagger tagset.
An Example of a tag in the CQL concordance search box: [tag="NNS"]
finds all nouns in plural, e.g. people, years (note: please make sure that you use straight double quotation marks)
Tagset
POS Tag | Description | Example |
CC | coordinating conjunction | and |
CD | cardinal number | 1, third |
CDZ | possesive pronoun | one’s |
DT | determiner | the |
EX | existential there | there is |
FW | foreign word | d’hoevre |
IN | preposition, subordinating conjunction | in, of, like |
IN/that | that as subordinator | that |
JJ | adjective | green |
JJR | adjective, comparative | greener |
JJS | adjective, superlative | greenest |
LS | list marker | 1) |
MD | modal | could, will |
NN | noun, singular or mass | table |
NNS | noun plural | tables |
NNSZ | possesive noun plural | people’s, women’s |
NNZ | possesive noun, singular or mass | year’s, world’s |
NP | proper noun, singular | John |
NPS | proper noun, plural | Vikings |
NPSZ | possesive proper noun, plural | Boys’, Workers’ |
NPZ | possesive noun, singular | Britain’s, God’s |
PDT | predeterminer | both the boys |
PP | personal pronoun | I, he, it |
PPZ | possessive pronoun | my, his |
RB | adverb | however, usually, naturally, here, good |
RBR | adverb, comparative | better |
RBS | adverb, superlative | best |
RP | particle | give up |
SENT | Sentence-break punctuation | . ! ? |
SYM | Symbol | / [ = * |
TO | infinitive ‘to’ | togo |
UH | interjection | uhhuhhuhh |
VB | verb be, base form | be |
VBD | verb be, past tense | was, were |
VBG | verb be, gerund/present participle | being |
VBN | verb be, past participle | been |
VBP | verb be, sing. present, non-3d | am, are |
VBZ | verb be, 3rd person sing. present | is |
VH | verb have, base form | have |
VHD | verb have, past tense | had |
VHG | verb have, gerund/present participle | having |
VHN | verb have, past participle | had |
VHP | verb have, sing. present, non-3d | have |
VHZ | verb have, 3rd person sing. present | has |
VV | verb, base form | take |
VVD | verb, past tense | took |
VVG | verb, gerund/present participle | taking |
VVN | verb, past participle | taken |
VVP | verb, sing. present, non-3d | take |
VVZ | verb, 3rd person sing. present | takes |
WDT | wh-determiner | which |
WP | wh-pronoun | who, what |
WPZ | possessive wh-pronoun | whose |
Z | possessive ending | ‘s |
Main differences to default Penn tagset
In TreeTagger tagset
- Distinguishes be (VB) and have (VH) from other (non-modal) verbs (VV)
- For proper nouns, NNP and NNPS have become NP and NPS
- SENT for end-of-sentence punctuation (other punctuation tags may also differ)
In TreeTagger + Sketch Engine
- token “to” can be tagged as IN when it is a preposition or TO only when it is an infinitive marker
Changelog
- updated TreeTagger model
- various changes in tokenization
- “would” lemmatized as “would”
- possessive clitic (Saxon genitive) re-tokenized (joined to preceding word) in almost all cases
- changed tags: POS -> Z, PP$ -> PPZ, WP$ -> WPZ
- new tags: NNZ, NNSZ, NPZ, NPSZ, CDZ
- Default word sketch grammar has human-readable relation names
Bibliography
M. Marcus, B. Santorini and M.A. Marcinkiewicz (1993). Building a large annotated corpus of English: The Penn Treebank. In Computational Linguistics, volume 19, number 2, pp. 313–330.
or