SDStephane Derosiauxinconduktor.hashnode.dev·2h ago · 6 min readThe Delete Button Hiding in Your Schema RegistryQuick question: right now, which of your applications can delete a schema from your registry? If you run Kafka at any real scale, you run a schema registry too. It's the shared contract every producer00
GMGunish Mattaingunishmatta.hashnode.dev·1d ago · 8 min readRethinking retention for your topics on Amazon MSKretention.ms=604800000. Seven days. You set it when the topic is created and then never look at it again. That one number quietly fixes three separate things: what you pay for storage, how far back yo00
MGManjusha Gunturinmanjushaguntur.hashnode.dev·3d ago · 17 min readFrom Requirement to Release: Building an AI Software Engineering Platform for Event-Driven SystemsWhy Code Generation Is Not Enough The first generation of AI software engineering tools demonstrated that Large Language Models can generate production-quality code. The next generation will be measur00
KSKanishka Shashiinhtml-dev09.hashnode.dev·Jul 10 · 11 min readKafka Explained Like You're 5: Events, Partitions, and Consumer GroupsIntroduction How does a large application process millions of events every day? Imagine a food delivery app during dinner time. Thousands of customers are placing orders, restaurants are accepting the11C
SHSanskriti Harmukhinvultr.hashnode.dev·Jul 7 · 6 min readDeploying Redpanda Kafka-Compatible Streaming Platform on Ubuntu 24.04Redpanda is a Kafka-API-compatible streaming platform written in C++ with no JVM and no ZooKeeper. This guide installs Redpanda on Ubuntu 24.04, secures it with a Let's Encrypt certificate and SASL/SC00
RKRithwik Kumar Nagulapatiinrithwikn.hashnode.dev·Jul 5 · 7 min readHow I Cut Infrastructure Costs by Building an Auto-Shutdown Mechanism for a Long-Running Java Batch Pipeline on an Ephemeral ClusterIt started with a cost conversation So my manager pulled me aside one day. Pretty direct conversation, infrastructure costs for our batch pipeline were too high, and he needed me to do something about00
SDStanislav Deviatovinstn1slv.hashnode.dev·Jul 6 · 17 min readIntegration Digest for June 202Articles 🔍 4 Rules to Build an Efficient MCP Server Concrete design rules for MCP servers that treat the server as a user interface for an LLM rather than a thin API proxy. It recommends designing to00
RKRithwik Kumar Nagulapatiinrithwikn.hashnode.dev·Jul 5 · 7 min readBeating the 7-Day Cluster TTL: How I Built a Graceful Shutdown Watchdog for a Kafka Streaming PipelineIt started with a cost conversation My manager flagged the VMware costs on our streaming pipeline. Two machines running 24/7 — two Kafka consumers and a Bootstrap application, always on, whether traff00
AJAshmit JaiSarita Guptainengineeringwithashmit.hashnode.dev·Jul 3 · 9 min readGreen does not mean working: what a health check confirmsA liveness probe and a real request take different paths through a service, and the gap between them hides a whole class of bug. The first real POST to log0's gateway hung with no error and no log lin00
SKSachin Kamathinzeliot-official.hashnode.dev·Jul 2 · 24 min readKafka Streams: A Production Guide to Joins, Aggregations, and Stateful ProcessingTL;DR Building real-time data pipelines is often more complex than it appears at first. A simple stream processing application may start with a few Kafka topics, joins, and aggregations. As data volum00
