DDineshindinesh-dezoomcamp.hashnode.dev·Mar 31, 2025 · 5 min readBuilding a Real-Time Stock Market Analytics Platform on GCP (Part 2)Introduction In Part 1 of this series, we introduced our Stock Market Analytics Platform built on Google Cloud Platform (GCP). We covered the architecture, infrastructure deployment with Terraform, batch processing with Dataproc/Spark, and real-time ...00
DDineshindinesh-dezoomcamp.hashnode.dev·Mar 31, 2025 · 5 min readBuilding a Real-Time Stock Market Analytics Platform on GCP (Part 1)Introduction In today's fast-paced financial markets, the ability to process and analyze stock market data in real-time provides a significant competitive advantage. This article describes our journey building a comprehensive Stock Market Analytics P...00
DDineshindinesh-dezoomcamp.hashnode.dev·Mar 17, 2025 · 1 min readReal-Time Data Processing with PyFlink and RedpandaIntroduction Real-time data processing offers immediate insights compared to traditional batch processing, enabling analysis of data as it arrives. Core Architecture Components Redpanda: A Kafka-compatible event streaming platform that's simpler to ...00
DDineshindinesh-dezoomcamp.hashnode.dev·Mar 6, 2025 · 2 min readDiving into Big Data with Apache SparkMy Journey Through Module 5 of Data Engineering Zoomcamp This week marked an exciting milestone in my data engineering journey as I completed Module 5 of the Data Engineering Zoomcamp, which focused on batch processing with Apache Spark. 🛠️ Setting ...00
DDineshindinesh-dezoomcamp.hashnode.dev·Feb 26, 2025 · 7 min readData Engineering with dbt: Mastering Analytics Engineering Through NYC Taxi DataWhat I Learned in Module 4 of the Data Engineering Zoomcamp Today I completed Module 4 of the Data Engineering Zoomcamp, focusing on Analytics Engineering with dbt (data build tool). This module took me on a comprehensive journey through transforming...00
