Engineering a Robust ETL Pipeline for Messy Product Data

1d ago · 3 min read · I built an ETL pipeline that takes messy product data from a CSV file, cleans and validates it, and loads both trusted and rejected records into PostgreSQL. https://github.com/Akina-Aoki/data_ops_work

Building a batch processed "Real Time" Retail Inventory Data Platform using ETL + FastAPI + Kafka + Postgresql / Supabase

3d ago · 7 min read · Product Finder is a retail data platform prototype built for SportsWear AB. The goal is simple: take inventory and sales events from operations, process them in a reliable pipeline, and turn them into

What I Learned About Apache Kafka by Running It in Docker

Feb 25 · 3 min read · Why I Started Learning Kafka Github Repository: Kafka Streamcraft As a data engineer student, I recently started building ETL pipelines and working with Docker-based environments. As our projects beca

Aira: Data Engineer Student

SQL Project: Data Analysis with DuckDB

Jan 26 · 6 min read · Project Summary This project explores the Sakila DVD rental database using SQL, DuckDB, Python, and Evidence. The goal is to understand the data and find patterns in movies, customers, and revenue. The data is loaded from a SQLite database into DuckD...