ICTS-DMD introduced the Pentaho Data Integrator and the use of MYSQL to the participants of NLP PHILAIMIS Region 6 Data Encoders last April 26-29, 2022. The training's goal was to deploy a data integration system and conduct mentoring sessions to upskill the PHILAIMIS Data Regional Encoders in their data management skill in data preparation.

The following topics were discussed in detail:

Pentaho Data Integration

• Introduction to data cleaning, validation and ETL process.

• Data Extraction

  • Source from spreadsheet, excel, table input

  • Conversion

• Data Transformation

  • Data cleaning

  • Filter rows

  • Select values

  • RegX

  • Stream lookup

  • String operations

  • Replace string

• Data Loading

  • table output

  • Load to text file

Database Management

• Database creation

• Table creation

• Fields metadata