Purpose

Unites a corpus (from any dir tree) into one file. This is neccesary for training TnT.

The configfile is configunitecorpus.pl

Synopsis

./tnt2tagstat.pl
[-c <corpus>] [-f <fromsubdir>] | [-fd <fromdir>] [-tc <tocorpus>] [-t <tosubdir>] | [-td <targetdir>] [-tf <tofile>] [-w <whitelines>] [-ps <partsubdir>][-p <part>] | [-pd <partdir>] [-pf <divprtfile> [...]] [-dr] [-? = -h = -help = --help] [-v [<verboselvl>]]

-c
the corpus to unite
-f
the subdir below corpus in which the corpus that should be united can be found
-fd
full path to the stuff to unite
-tc
target-corpus. If none is set the source corpus is used
-t
the the subdir in which the united corpus should be stored
-td
full path (including the filename) of the file to store the united corpus in
-tf
the filename of the file in which the united corpus should be stored
-w
the number of whitelines with which to separate the different sourcefiles within the united file
-ps
subdir in which the divisions are
-p
the name of a division to use as a part. The file-names in all the divprt -files in the division-dir are added and used as the list of files to use unless you specify one or more explicitly using the -pf option
-pd
full path to the division-dir to use as a part. This option causes the -p option to be ignored
-pf
one or more divprt files to use as the part instead of all files in the division
-dr
dry-run. Nothing is written or deleted, only reading and reporting is done
-v
the level of verbosity, default verboselevel = 2, available levels: 0,1,2,3
-?
(and equivalents) prints help: the purpose and the synopsys

NOTE:
If no from-dir and to-file is given the default(s) in the config file are/is used

You can download (or look at the sources of) UniteCorpus [here]. To run it you will also need [the config file] and the [fiauimenre library]. You can also get the entire tool-package (containing the newest version of all fiauimenre tools and the library) [in one download]
Part of the LogiLogi Network: The LogiLogi Foundation - LogiLogi.org - OgOg.org
This is an old version for archival purposes, see www.LogiLogi.org for the current version.
< Edit this document | View history | Printer friendly (inc. links) >
Visited 1025 times
Document last modified Fri, 29 Jul 2005 07:21:24
All content is available under the GNU Free Documentation License. The LogiLogi-system is under the GPL
SourceForge.net Logo Zylon Internet Services-Groningen Logo
Visitor statistics