The Tools

Corpus

run parts of the entire corpus task in one go

split an one-file corpus in bits

strip unwanted elements from a corpus

further refine (sentence-split, remove whitesp)

collect meta-data from a corpus (dividing reqs it)

divide into age-groups for example (reqs metadata)

turn into the wordrow format (examine tools req it)

take a random sample from a corpus

Tagging

run parts of the entire tagging task in one go

move a refined corpus to the TnT-format

unite a TnT-ready corpus to prepare it for training

train TnT on a tagged corpus

tag a corpus using TnT

move a tagged corpus to the statistics-format

Statistics

run parts of the entire stat task in one go

permutates the n-grams

applies normalizations and measures to the data

rewrites the results to tab-delimited format

selects significant and sorted top results

Examine

examines a corpus

debugs a stripped corpus

stats a collection of wordrow or tagrow files

finds samples of POS-tag ngrams

tests the prestations of an automatic tagger (TnT)