Problem:
Financial reports relied on manual downloads from SAP ECC in Excel format, resulting in slow and non-scalable processes.
There was no consolidated data architecture or incremental update process.
The integration infrastructure needed to be built from scratch since there was no dedicated data team.
Solution:
Extracted data from SAP ECC into a Lakehouse in Microsoft Fabric and then loaded it into the Data Warehouse.
Configured pipelines using Copy Data and Dataflows, resolving incremental update limitations by implementing a selective two-year rolling load process.
Standardized catalogs and cleaned data from SAP, Excel, and SharePoint.
Modeled data in the Warehouse using T-SQL, created measures, and migrated the model to Power BI Desktop to replicate original reports.
Implemented automatic retries in pipelines to ensure successful extraction in case of SAP connection failures.
Impact:
Established the foundation for a data architecture in Fabric, reducing data load times from 45 to 40 minutes.
Eliminated the dependency on Excel files for report updates.
Built a scalable pipeline to support future consolidation processes and migrate dashboards to Power BI with greater reliability.
Marked the first step toward adopting Microsoft Fabric in the company, demonstrating tangible benefits in centralizing and standardizing information.