What are Mapping Files?

Operation files contain instructions for the application. These files allow for complex filtering and extraction of data.

@DYNAMIC MAPPING: Applies the stock ticker of the company that owns this product on this date. Needs extra permissioning.

@EXTRACT (in dev)

@FILTER: A list of values for a variable that a row must include for it to be included when duplicating a file.

@CONDITION FILTER: A list of values that must @NOT make it through filter.

@NUMERICAL CONDITION FILTER: Apply filters using @LT (<), @LE (<=), @EQ (=), @NE (<>),@GE (>=) and @GT (>) math operators.

@GROUP

@HEADER: Specifies what headers to use in a specific operation (where required). For example importing JSON files requires an @HEADER file.

@MAPPING: Specifies how to Map from one value to another.

@MASK: Encrypts the contents of a column with a salt value.

@PRESENCE: Creates a filter file containing a list of the unique values of column.

@RUN (in dev)

@SAMPLE: Creates a new file with a random sample of rows. User specifies the proportion as a decimal, e.g. (1% = 0.01)

@SCRIPT (in dev)

@TRANSFORM (in dev)

@COLUMN REDUCE: Specifies the columns in a file and deletes the columns NOT in this list when a new version of the STATIC data file is generated.

@COLUMN ORDER: Specifies the Columns and their order in a data file. Used with Merge Pipelines

@FORMAT DATE: Changes the data from one format to another (e.g yyyy-MM-dd -> yyyyMMdd)

@FUNCTION: Perform simple sum/subtraction/multiplication/divide of columns.

@RELABEL: Change column labels from X to Y

@REPLACE: Replace characters (uses unicode values)