I specialize in building robust batch and streaming data pipelines, with deep expertise in both data infrastructure and real-time applications. Skilled in Python for rapid development and orchestration, and Rust for building high-performance, memory-safe systems.
Tech stack includes Kafka, Flink, Airflow, RisingWave, Apache Arrow, and async Rust.
My focus is on delivering low-latency, scalable, and maintainable data platforms that power business-critical insights.
Nothing here yet.
19h ago · 9 min read · Key Takeaways Core Concept: The Bidirectional Build-Probe model is the foundation of stream-to-stream joins. Key Challenge: Infinite data streams require intelligent state management and cleanup to h
Join discussion
Feb 25 · 7 min read · Do you remember the concept of stateful operations we discussed on Day 12? And the Database Lookup Join we implemented earlier? Today, we take it a step further and dive into the true mindset of strea
Join discussion
Jan 16 · 4 min read · Imagine you’re running a coffee shop, and there’s a camera at the entrance, continuously capturing every customer who walks in. These snapshots are your event stream — one after another, playing endlessly. But here’s the challenge, if you want to kno...
Join discussion
Jan 16 · 3 min read · Remember last time we asked: “Why not just move all the logic to streaming? Wouldn’t that be faster?” The Dual-Track Problem of Lambda Architecture In a Lambda architecture, our data pipelines follow a dual-track approach: Lambda Architecture: Raw D...
Join discussion
Jan 8 · 10 min read · Recap: Pain Points from Last Time Remember the coffee shop story from last time? The owner evolved from just wanting order counts to wanting detailed order breakdowns (orders_detail). We solved it in the Serving Layer of the Lambda architecture with ...
Join discussion