Topic 03: Custom ETL
Topic 03: Custom ETL
Topic Description:
A wide range of options are available to GIS professionals seeking to automate common workflows. This includes Modelbuilder, Python, and FME...among others. Workflows where automation using FME is appropriate include when project data is acquired or stored in several various formats and locations. Not only can FME automation help save time, but it can also ensure data quality through attribute and feature filters and comparisons. What's nice is that FME can even download your project data directly from the source website, extract the ZIP file into your project folder, and visualize the features directly in the application. All of this integration and automation leads to faster completion of the data collection and assimilation tasks in a GIS project.
Learning Goals with Lecture Videos:
Identify the workflows where FME is appropriate.
List real-world applications of FME integration with GIS.
Explain the settings for integrating Python with FME.
Develop an FME Workbench with HTTPCallers.
Data:
Learning Objective:
Create an inventory of data through automation.
Exercise: Make an FME Workbench
What can you do with what you have learned?
Create a Workbench that downloads Imagery for 2018 and 2020 for this study area.
Remember the steps for creating a Workbench:
Develop the Workflow
Test the Workbench
Update the Documentation
What has changed over these two time periods?
Add the Imagery to the map.
Use the slider in the map to see the changes.
Submit an FME Workbench file (.fmw) to the discussion below for feedback.
Discussion:
The goal of Discussions in this class is to collaborate and communicate with your classmates and instructor. This is your chance to ask questions, share your work for a peer review, show your progress in the Lab Demos and Exercises, and simply network with one another. Not sure how to get started? Share your opinions of this topic, demo, and exercise. What did you find interesting, helpful, surprising, etc? Share a URL to an interesting article, video, webinar, etc. that relates to this topic. Share your workbench from the exercise.
Click Transit Equity Assessment Project to proceed with the next step.
Questions? Contact: Stephanie.Long@austincc.edu