Bing News Search — An End-to-End Azure Data Engineering Project in Microsoft Fabric.

Project Summary
This project uses Bing News API within Azure to create an end-to-end Data Engineering project using Microsoft Fabric to determine the Olympic news sentiments for each news. 

For this project, I carried out the following:

1. Create a Bing Search Resource in Azure.

2. Data Ingestion.

3. Data Transformation with Incremental Loading.

4. Sentiment Analysis with Incremental Loading.

5. Data Visualization and Reporting in Power BI.

6. Set up Alerts with Data Activator with notification on Teams.

This is a project I am excited about as we get to wear the hat of a Data Analyst + Data Engineer + Data Scientist.

If you prefer to read, see the detailed tutorial on my Blog or read about it on Linkedin
Download the notebook on my GitHub used to Extract, Transform, and load (ETL) the olympi-news to the olympic_news_updated data


Project Date: August 21, 2024.

Skills Used:
- Azure Bing News API as Data Source.
- Data Factory in Microsoft Fabric.
- Lake House as Data Storage.
- Data Pipeline for data ingestion.
- Notebook for Data Transformation, Incremental loading and Sentiment Analysis.
- Power BI to analyze, and format tables, and data visualization.
- Alerts and Data Activators  with notification on  Microsoft Teams.

Desired Results:

-  A dashboard report analysis of  Over 100 news was published and only 17% of it has positive sentiments.  

Interested in the analysis?
Read the full project documentation on my Blog  or on Linkedin
The Dataset: Is the Paris 2024 Olympic news .

 CONTACT ME