APAndrea Parisinandreaparisdata.hashnode.dev·Jun 11 · 6 min readThe Moment I Realised a Database Is Not a Data WarehouseContext The platform combines real-time cryptocurrency market data from the CoinGecko API with sentiment analysis derived from cryptocurrency-related YouTube discussions. Apache Kafka, Spark Structure00
APAndrea Parisinandreaparisdata.hashnode.dev·Jun 10 · 6 min readBuilding a Real-Time Crypto Analytics PlatformFrom Streaming Pipeline to Analytics Platform When I started learning data engineering, I wanted a project that would force me to use the technologies I was studying in a realistic setting. Tutorials 00
APAndrea Parisinandreaparisdata.hashnode.dev·Apr 19 · 6 min readWeek 1: Building the Dataset (Harder Than Expected)We’re still figuring out what this project is going to become. I’m working with Zoe (data scientist), and my role is to build the dataset — daily stock data for a selection of energy companies so we c00
APAndrea Parisinandreaparisdata.hashnode.dev·Apr 15 · 5 min readI Thought I Understood Databases — Then I Built One ProperlyI thought I understood databases. I had written SQL queries, built tables, and used them in projects. But everything I knew was limited to querying data - not managing it. So I decided to build a comp00
APAndrea Parisinandreaparisdata.hashnode.dev·Apr 8 · 5 min readBuilding an ETL Pipeline in Bash (and What I Learned)As part of my data engineering learning, I built a small project to understand how data pipelines work end-to-end using only Bash and standard Unix tools. The idea was simple: collect weather data for00