HKHair77.hashnode.dev·Jul 8, 2024Kafka 토픽 발행으로 Mysql 부하 줄이기🤯 문제 발생 회사 광고팀에서 사용하던 mysql이 터졌다 정확히는 connection pool이 너무 많이 늘어나면서 요청을 다 처리하지 못하고 뻗어버렸다 유력 범인 후보로는 내가 관리하는 추천 API 서버가 지목이 되었다 문제를 해결해보자 😌 🤔 원인이 무엇이었을까? 우선적으로 광고 유효 업체 api 구조를 살펴보자 추천 api를 통해 광고 업체들의 유효성 판별 요청을 광고 서버에 보낸다 해당 광고 서버는 정보가 담긴 mysql ...Discuss·1 likeMySQL
vikash kumardevopswizard.hashnode.dev·Jul 2, 2024Apache Kafka for DevOps: From Confusion to Confidence - A Beginner's TutorialHey there, fellow tech enthusiasts and aspiring DevOps engineers! Pull up a chair, grab your favorite beverage, and let me tell you about my wild ride with Apache Kafka. If you're wondering how to set up Kafka for DevOps or looking for an Apache Kafk...Discusskafka for devops
Vikas Guptavikasfeedingdotnet.hashnode.dev·Jun 29, 2024Introduction to Apache KafkaApache Kafka is an open-source stream-processing platform designed to handle real-time data feeds with high throughput, fault tolerance, and scalability. It's a go-to solution for building real-time data pipelines and streaming applications. Key Conc...Discusskafka
Jayakiran Guntukujkblogs.hashnode.dev·Jun 22, 2024Apache Kafka 101: Key Features, Architecture, and Use CasesWhat is Apache Kafka? Apache Kafka is a powerful, distributed streaming platform designed to handle real-time data feeds with high throughput, fault tolerance, and scalability. Initially developed at LinkedIn and open-sourced in 2011, Kafka has becom...DiscussKafkakafka
Indal kumarindal.hashnode.dev·May 19, 2024Building a Kafka Producer and Consumer in GoApache Kafka is a powerful distributed streaming platform used for building real-time data pipelines and streaming applications. In this blog post, we'll walk through setting up a Kafka producer and consumer using Golang. Prerequisites Before we begi...Discuss·28 readsDockr
Sai SrirampurforPeerDB Blogblog.peerdb.io·May 6, 2024PeerDB Streams - Simple, Native Postgres Change Data CaptureWe spent the past 7 months building a solid experience to replicate data from Postgres to Data Warehouses such as Snowflake, BigQuery, ClickHouse and Postgres. Now, we want to expand and bring a similar experience for Queues. With that spirit, we are...Richard Christopher and 1 other are discussing this2 people are discussing thisDiscuss·3 likes·3.6K readsPostgreSQL
Cloud Tunedcloudtuned.hashnode.dev·Mar 6, 2024Implementing a Real-time Data Streaming Solution with Apache Kafka & SpringBootExploring and Implementing a Real-time Data Streaming Solution with Apache Kafka Real-time data streaming has become increasingly crucial in today's data-driven world, enabling businesses to react to events instantaneously, make timely decisions, and...Discuss·1 like·179 readsSpringboot
Parth P Shahparthpshah.hashnode.dev·Feb 11, 2024Apache Kafka Raft (KRaft): Apache Kafka and how it's finally without Zookeeper.The Basics, Apache Kafka Let's start with some context.Apache kafka is is an open-source event streaming platform that can transport huge volumes of data at very low latency. Kafka lets you: Publish and subscribe to streams of events Store streams ...Discuss·1 like·72 readsapache kafka kraft
Ladna Mekeladmerc.com·Jan 3, 2024Stream Symphony: More Than Enough KafkaIntroduction: Navigating the Data Maze Feel free to skip this section if you want to dive right into the technical bits. Imagine you want to order your favourite burger from your neighbourhood spot “Akaso Burger” - you visit the website/mobile app, s...Discuss·111 readskafka-partition
Ayush Singhaviace.hashnode.dev·Jan 1, 2024Introduction to Apache Kafka: Beginners' GuidePrerequisites: Familiar working in Node.js intermediate level Knowledge about designing distributed systems (Its okay if you don't, keep learning it along with learning Kafka) Docker and containerization concepts(beginner level: you can take 5-8 m...Discuss·4 likesapache zookeeper
