Corpus Stripper

Purpose

Strips unwanted elements from a corpus and saves the modified files in a different directory. What exactly is stripped is determined by the selected striplib

Use -ll to list the stripper-libs

The configfile is configcorpusstripper.pl

The following stripper-libs are available:

Synopsis

./corpusstripper.pl

[-c <corpus>] [-f <fromsubdir>] | [-fd <fromdir>] [-tc <tocorpus>] [-t <tosubdir>] | [-td <targetdir>] [-l <striplibshortname>] | [-lf <striplibfullname>][-ll] [-la <extrastriplibargs>] [-a <actionlist>] [-ps <partsubdir>] [-p <part>] | [-pd <partdir>] [-pf <divprtfile> [...]] [-dr] [-? = -h = -help = --help] [-v [<verboselvl>]]

-c: the corpus to work on

-f: the subdir in which the files to work on can be found

-fd: full path to the stuff to work on (conflicts with -c and -f)

-tc: target-corpus. If none is set the source corpus is used

-t: the subdir in which the stripped corpus should be stored

-td: full path to the place where the stripped corpus should be stored (conflicts with -t)

-l: the short name of the strip-library to use (conflicts with -lf)

-lf: the strip-library to use (conflicts with -l)

-ll: list the installed strip-libraries (exits the program immidiately)

-la: extra args to hand over to the strip-lib

-a: a detailed specification of the actions to perform, in this case what to strip and what not in the form of a string in which each token stands for a string/thing to strip). Have a look at the description of the strip-lib you use for info on what actionlist-settings it supports

-ps: subdir in which the divisions are

-p: the name of a division to use as a part. The file-names in all the divprt -files in the division-dir are added and used as the list of files to use unless you specify one or more explicitly using the -pf option

-pd: full path to the division-dir to use as a part. This option causes the -p option to be ignored

-pf: one or more divprt files to use as the part instead of all files in the division

-dr: dry-run. Nothing is written or deleted, only reading and reporting is done

-v: the level of verbosity, default verboselevel = 2, available levels: 0,1,2,3

-?: (and equivalents) prints help: the purpose and the synopsys

NOTE:

If no lists or levels are given the defaults in the config file are used

WARNING:

If options are not given they can be still used if they're specified in the config file

You can download (or look at the sources of) CorpusStripper [here]. To run it you will also need [the config file] and the [fiauimenrelibrary]. You can also get the entire tool-package (containing the newest version of all fiauimenre tools and the library) [in one download]