Mani Balamanib.hashnode.dev·Sep 28, 2023RabbitMQ vs. Apache Kafka: A ComparisonGreat choice! RabbitMQ and Apache Kafka are popular message brokers used for message queuing and event processing in distributed systems. Here's a comparison of RabbitMQ and Kafka along with a small example for each. RabbitMQ vs. Apache Kafka RabbitM...Discussrabbitmq
RisingWave Labsrisingwavelabs.hashnode.dev·Sep 22, 2023Why Kafka Is the New Data Lake?The shift in data management towards data lakes is indeed transformative. Data lakes are fundamental in managing vast amounts of raw, unstructured, and semi-structured data. Their ability to store historical data as a single source of truth is crucia...Discusskafka
Annis Souamesanniscodes.com·Sep 20, 2023How to Stream From a REST API Using Kafka ConnectIn a recent project, I was working on, I had to create a data pipeline that reads flight data from a REST API (Opensky Network API) and sends the data continuously to an S3 bucket. To accomplish this, I decided to use Kafka, a powerful and scalable s...Discusskafka
Md. Minhazul Haqueblog.mdminhazulhaque.io·Sep 20, 2023Helm CheatsheetHere is a list of commands to install well-known charts via Helm. Most of them come from the Bitnami official repo. So you need to add the Bitnami repo first. helm repo add bitnami https://charts.bitnami.com/bitnami helm repo update Redis Single Nod...Discuss·184 readsHelm
Daniel Lopesdanieljalopes.hashnode.dev·Sep 19, 2023Spring Cloud Data FlowAbstract This is the 1st part of a series dedicated to Spring Cloud Data Flow (SCDF). Here it will be explained how to create a simple SCDF Stream application just to show how to interact with SCDF. The Stream will perform a simple operation, receive...Discusskafka
Aneesh Sethaneeshseth.hashnode.dev·Sep 19, 2023Distributed Queue Systems (Kafka's Architecture)You should think of when operations need to be performed Synchronously or in an Async manner. For example, sending mail for invoice can be async, but getting notifications for lets say a text message on instagram needs to probably be instant. Let’s s...Discusskafka
Elvis Davidtechlake.dev·Sep 18, 2023Real-time data ingestion to Databricks Delta Lake using Redpanda (Kafka Connect)Introduction We are in the era where Real-time data ingestion has become one of the critical requirement for many organizations which are seeking to tap the value from their data in Real-time and near Real-time. Real-time data ingestion has grown to ...DiscussData EngineeringData Science
Joobi S Bjoobisb.com·Sep 18, 2023Apache Kafka: A PrimerNowadays it's very common to build systems focused on events where events drive the flow of data and interactions, aka Event-driven architecture. Simply put, Apache Kafka is an event-streaming platform. It does the following, Single platform to publ...Discusskafka
kumail rizvirizvicodes.hashnode.dev·Sep 8, 2023Intro To KafkaI will cover the theoretical part of Kafka in this article "More than 80% of all Fortune 100 companies trust, and use Kafka." This is the quote you will find on the Apache Kafka official site. According to this Kafka seems to play a crucial role i...Discuss·33 likes·105 readskafka
Hemantblog.hemant.social·Sep 8, 2023A Beginner's Introduction to Apache KafkaApache Kafka is a system that helps transfer data in real-time. It is commonly used in modern applications where events play a crucial role. For example, when a customer places an order on a website, the order service needs to inform other services a...Discuss·4 likeskafka