7h ago · 5 min read · When developers start building serverless applications on Google Cloud, they often run into the same dilemma. Should this workload run on Cloud Run or Cloud Functions? Both services allow you to run c
Join discussion
1d ago · 5 min read · Choosing the right stack for a retail data pipeline is often treated as a matter of developer preference. Python is the undisputed leader in data science, making it the default choice for data collect
Join discussion
Feb 5 · 4 min read · I'm diving into the world of big data using Rust. This might sound unusual—isn't Python the industry standard? Yes, Python dominates the field, but I chose Rust because I want to master it for systems programming, which is my end goal. It all started...
Join discussion
Feb 3 · 12 min read · Complete Setup Guide for Local, Docker, and Cloud Deployments. Introduction: Why Installation Matters Think of Kestra as the conductor of your data orchestra. Just as a great conductor needs the right stage setup, Kestra needs proper installation to ...
Join discussionFeb 3 · 8 min read · From Legacy Workflow Tools to Declarative Data Pipelines Introduction: The Orchestration Evolution Imagine you're building a complex data pipeline. You have data scattered across cloud storage, databases, and APIs. You need to transform it, validate ...
Join discussionJan 26 · 6 min read · Project Summary This work demonstrates end-to-end data modelling, from a school’s business requirements to a running database environment. I designed and implemented a 3rd Normal Form Relational Database for a vocational school according to their bus...
Join discussion
Jan 20 · 4 min read · In today’s data-driven world, Big Data and Artificial Intelligence (AI) projects are transforming how organizations operate, make decisions, and deliver value. At the heart of these initiatives lies a critical yet often behind-the-scenes role: the Da...
Join discussionJan 16 · 2 min read · In today’s world, data isn’t just numbers on a spreadsheet—it’s the heartbeat of every business decision. Over the past few years, I’ve honed my skills in Python, SQL, and data visualization tools like Tableau and Power BI to turn raw data into actio...
Join discussionDec 13, 2025 · 11 min read · Introduction: From Pandas User to Data Engineer Typing import pandas as pd followed by a read_csv() is likely one of the first things we learn in any data course. It is simple, fast, and works like a charm... until it doesn't. Anyone can load a small...
Join discussionDec 3, 2025 · 2 min read · Slowly Changing Dimensions (SCD) Type-2 is the go-to pattern when you need full historical tracking of your dimensional tables. But running a naïve column-by-column comparison becomes messy fast. A much cleaner way? 👉 Create an MD5 hash of all busin...
Join discussion