Streaming Data Pipeline Using Confluent Cloud and Dataproc on GCP

Jun 5, 2023 · 3 min read · Introduction In This Article, we'll look into How we can build a streaming data pipeline using Confluent Kafka and Spark Structured Streaming on Dataproc(GCP). Objective: Create a Confluent Kafka Topic and Stream events from Kafka to Google cloud sto...