AFAira Francoindataengineeringlearning.hashnode.dev·Jun 8 · 16 min readMarathos Atlas - Building a data platform in Databricks to learn Medallion ArchitectureFor my Big Data and Cloud Platform Development Course, I used the Databricks platform to build Marathos Atlas. The whole learning goal was to build a lakehouse workflow that transforms raw global mara00
AFAira Francoindataengineeringlearning.hashnode.dev·May 15 · 2 min readNetflix Analytics Dashboard with StreamlitFor this project, Data Engineers and UX Designers worked on building a Netflix analytics dashboard using Streamlit. The goal was to turn raw ranking data into something structured, interactive, user-f00
AFAira Francoindataengineeringlearning.hashnode.dev·Apr 27 · 8 min readWhy Semantic Models Need Strong Data Engineering PrinciplesPrinciples of Good Data Engineering One major challenge is the ambiguity in metrics and the ambiguity in human questions. For data to deliver meaningful answers, the underlying data must be supported00
AFAira Francoindataengineeringlearning.hashnode.dev·Mar 30 · 3 min readEngineering a Robust ETL Pipeline for Messy Product DataI built an ETL pipeline that takes messy product data from a CSV file, cleans and validates it, and loads both trusted and rejected records into PostgreSQL. https://github.com/Akina-Aoki/data_ops_work00
AFAira Francoindataengineeringlearning.hashnode.dev·Mar 27 · 7 min readBuilding a batch processed "Real Time" Retail Inventory Data Platform using ETL + FastAPI + Kafka + Postgresql / SupabaseProduct Finder is a retail data platform prototype built for SportsWear AB. The goal is simple: take inventory and sales events from operations, process them in a reliable pipeline, and turn them into10
