The project explores modern data engineering in Databricks, using a star schema and the Medallion Architecture for incremental ingestion via Spark Streaming and Auto Loader. It features dynamic job orchestration, declarative Lakeflow pipelines, and automated SCD/fact builders, culminating in a KPI Databricks Dashboard for a simulated stakeholder.
Documentation
Capstone project at Ironhack Data Analytics Bootcamp — from answering the question of 'what is a regional airport' to an in depth analysis of the industry in Brazil — putting machine learning into action with international aviation metrics to classify airports in clusters.
Storytelling
A #viz4ClimateAction to make us — yeah! me and you — aware, wake up and take personal action about worldwide explosive meat consumption growth and its huge share in the total Greenhouse Gas Emissions.
Storytelling
Shark Attacks — data cleaning and manipulation with Pandas — was my first project at Ironhack's Data Analytics Bootcamp. The given dataset was extremly messy and dirty, so the main pythonic challange here was to have it clean and usable. But before starting to transform beast into beauty I was also challanged to develop a story based on a business question to answer.
Storytelling
Work with data to understand the characteristics of a diamond which are most likely to influence its price. Rick — our client — has 5,000 diamonds and asked us to estimate their price based on a historic dataset with over 54,000 diamond prices. Our assignment is to estimate the price of Rick’s 5,000 diamonds achieving the smallest amount of error, so he can sell them properly. We will specifically measure the root mean squared error (RMSE) of our predictions.
How do annual members and casual riders use Cyclistic bikes differently? — my analysis for the Google Data Analytics Professional Certificate capstone project.
Storytelling
