Word
Note: This entry is for the type of token. For the positional attribute, see word form.
A word is a type of token. All tokens in a corpus are divided into two groups: words and nonwords. Words are tokens which begin with a letter of the alphabet. Tokens such as book, working, Mary, T-shirt, post-1945, mp3 or CO2 are words because they start with a letter.
In non-alphabetic scripts, a word is a token that starts with a kanji, kana, hanzi or hanja.
The regular expression Sketch Engine users to identify words is [[:alpha:]].*
Compare to nonword.
See also token.