Token annotation

For most languages, Sketch Engine tags and lemmatizes tokens in user corpora automatically. If the tools are not available for a language, the user can supply tags or lemmas manually. Automatically generated tags and lemmas can also be corrected manually.

Procedure in a nutshell

(If your corpus is in Sketch Engine, first download it in vertical format.)

  • Open the corpus in a plain text editor or annotation software.
  • Add metadata to tokens and save the file.
  • Upload it to Sketch Engine where metadata will be processed into token attributes automatically.

Example

Tokens annotated with these attributes:

  • token ID
  • word
  • lowercase lemma
  • part of speech
  • dependency ID
0 Golden golden adjective 1
1 gate gate noun 2
2 bridge bridge noun -

Structure annotation and token annotation

If the corpus contains metadata for structures, each structure will be listed on a separate line together with the related metadata like this:

<named_entity type="geography" subtype="bridge">
0 Golden adjective 1
1 gate noun 2
2 bridge noun -
</named_entity>