CoSORT:
Horizontal and Vertical Selection for Flat File
Filtering
CoSORT's
Sort Control Language (SortCL)
program offers several horizontal (record/row-level)
and vertical (field/column-level) filtering statements
for managing the size, number, and flow of records
before and after its central processing (sort,
merge, join, report) actions. SortCL's elimination,
reduction or hand-off of records provides for
high performance, SQL-oriented data cleansing
during both input and output phases. Input-side
data "scrubbing" can increase the efficiency
of the downstream transformations.
SortCL
supports extensive conditional logic (if-then-else)
to 'vertically' filter (include/omit) and reformat
records in a sort, join or report. You can also
'horizontally' filter records through de-dupes
and byte/record/header-specific process/ignore
commands. For example, you could specify to SortCL
which field values are valid in order to output
only records without those values. Following are
the commands you can use:
Input
and Output Filters
These
'horizontal selection' commands are based on implicit
or explicit 'WHERE' clauses which can be unary
(change break) or binary conditions. Conditions
in SortCL are also used in FIELD, DATA, JOIN and
aggregation statements, and are used classically
in data segmentation.
Input-level
Filters
