What are all the mapping types?

Here is a list of all the mapping file types, what they do and the format of the files.

Column Merge:

Concatenates the values of columns to form a new column. Values from source columns appear in the merged column separated by a "_". Merging AGE and GENDER columns would yield values like 43_Female, 18_Male, etc.

Format:

@COLUMN MERGE

new col

source col A,source col B,source col C

Column Order:

The order of columns in a merged dataset - column listed first will be the first column, 2nd column down the list will be the second column in the merged file.

Format:

@COLUMN ORDER

col a

col b

col e

col c

col d

Column Reduce:

A list of columns to KEEP in the data set once this is applied

Format:

@COLUMN REDUCE

col a

col b

etc

Filter:

Filters in rows that contain one of the values in this list in the specified column. There must be a column in the data file with the same name for this to be able to be applied.

Format:

Var / Column Name

value a

value b

etc

Format:

Changes the format of a column from one type to another

Format:

@FORMAT

column name

current format,new format

Notes: yyyy-MM-dd,yyyyMMdd wil convert the date from 2020-07-16 to 20200716

Function:

Performs simple math operations on columns and copy results into new column (must be unique)

Format:

@FUNCTION

new_column

column a

operator (* + - /)

column b

Notes: This simple equation is new_column = column a [operator] column b

Mapping File:

Maps from one value in the source column to another value in a new column (Destination column). The destination column name must not have the same name as a column/variable already in the data set.

Format:

source column,destination column

from_value_1,to_value_1

from_value_2,to_value_3

from_value_3,to_value_3

etc

Notes: These files allow for fall back keywords: @ELSE, value or @ELSE @COPY. If a value isn't discovered in the Map From List then this instructs to application to COPY the value to the new variable. These keywords appear on the second row of the file.

Mask:

Encrypts a field with a preceding salt value.

Format:


@MASK

Presence:

Creates a mapping file (FILTER type) containing the unique values in a specified variable. Applied from Mapping File page. Make Filter also performs the same but is applied from the Static Data actions page.

Format:

@PRESENCE

Variable to operate function on

Relabel:

Relabels variables / column headings in a file

Format:

@RELABEL

old_name, new_name

old_name_2,new_name_2

etc

Replace:

Replaces a character in a file with a another character.

Format:

@REPLACE

unicode value of character,new character

\0034,a

List of Unicode Characters

Sample:

Sample randomly from a file

Format:

@SAMPLE

proportion to be sampled (0.001 - 0.999)