- Purpose
Unites a corpus (from any dir tree) into one file. This is neccesary for training TnT.
The configfile is configunitecorpus.pl
- Synopsis
./tnt2tagstat.pl
- [-c <corpus>] [-f <fromsubdir>] | [-fd <fromdir>] [-tc <tocorpus>] [-t <tosubdir>] | [-td <targetdir>] [-tf <tofile>] [-w <whitelines>] [-ps <partsubdir>][-p <part>] | [-pd <partdir>] [-pf <divprtfile> [...]] [-dr] [-? = -h = -help = --help] [-v [<verboselvl>]]
- -c
- the corpus to unite
- -f
- the subdir below corpus in which the corpus that should be united can be found
- -fd
- full path to the stuff to unite
- -tc
- target-corpus. If none is set the source corpus is used
- -t
- the the subdir in which the united corpus should be stored
- -td
- full path (including the filename) of the file to store the united corpus in
- -tf
- the filename of the file in which the united corpus should be stored
- -w
- the number of whitelines with which to separate the different sourcefiles within the united file
- -ps
- subdir in which the divisions are
- -p
- the name of a division to use as a part. The file-names in all the divprt -files in the division-dir are added and used as the list of files to use unless you specify one or more explicitly using the -pf option
- -pd
- full path to the division-dir to use as a part. This option causes the -p option to be ignored
- -pf
- one or more divprt files to use as the part instead of all files in the division
- -dr
- dry-run. Nothing is written or deleted, only reading and reporting is done
- -v
- the level of verbosity, default verboselevel = 2, available levels: 0,1,2,3
- -?
- (and equivalents) prints help: the purpose and the synopsys
NOTE:
- If no from-dir and to-file is given the default(s) in the config file are/is used
You can download (or look at the sources of) UniteCorpus [here]. To run it you will also need [the config file] and the [fiauimenre library]. You can also get the entire tool-package (containing the newest version of all fiauimenre tools and the library) [in one download]
|