Page Action: Add Merge Pipeline
A merge pipeline merges files together with a similar structure. You can specify the columns and the order of the columns in this process.
A merge pipeline merges files together with a similar structure. You can specify the columns and the order of the columns in this process.
The first step is the specify the output content type - the delimiter - and the file extension. You can then enter the pattern of the file names to merge in the text box.
The first step is the specify the output content type - the delimiter - and the file extension. You can then enter the pattern of the file names to merge in the text box.
Multiple patterns must be separated by a ; (semi-colon). Although this process will run with just one file pattern selected.
Multiple patterns must be separated by a ; (semi-colon). Although this process will run with just one file pattern selected.
In this view, you will also select when this will run. The options are the same as those in the Data Processor pipeline.
In this view, you will also select when this will run. The options are the same as those in the Data Processor pipeline.
Important:
- The merge pipeline only works with Static data files generated by a process pipeline and should be generated after merge process pipeline was created.
- Merge pipelines will not work with a static data file that was already processed by merge process pipeline
- Each static data should contain all headers from Column Order mapping file used when defining pipeline
The next step is to specify the column order using a a special mapping/operational file called a Column Order file.
The next step is to specify the column order using a a special mapping/operational file called a Column Order file.
As with the data processor pipeline you can add multiple delivery locations. You can also specify the file name and select an option to append the Knowledge Date to the file name.
As with the data processor pipeline you can add multiple delivery locations. You can also specify the file name and select an option to append the Knowledge Date to the file name.
All files that are delivered will have YYYYmmDD_HHMMSS appended to the file name reflecting when they were delivered.
All files that are delivered will have YYYYmmDD_HHMMSS appended to the file name reflecting when they were delivered.
Specifying delivery is similar to the Data Processor Pipeline view. The one difference is that a delay can be built in. You can specify upto a 31 day delay and a specific time for the delivery after that delay.
Specifying delivery is similar to the Data Processor Pipeline view. The one difference is that a delay can be built in. You can specify upto a 31 day delay and a specific time for the delivery after that delay.
Once a file has been scheduled for delivery it appears in the delivery manifest list on this page.
Once a file has been scheduled for delivery it appears in the delivery manifest list on this page.
You can also enter email addresses that will receive a notification email once the delivery is completed.
You can also enter email addresses that will receive a notification email once the delivery is completed.
Once the Merge Process is saved and has run, the delivery schedule will be displayed on the Delivery Manifest page.
Once the Merge Process is saved and has run, the delivery schedule will be displayed on the Delivery Manifest page.