@yadukrishnan

Building a Generic Data Integration Pipeline in Scala: The Data Plumber - Part 3

Mar 18, 2025 · 5 min read · Introduction This blog is a part of the Data Plumber Series. In Parts 1 and Part 2, we explored simple and batch-oriented data pipelines. Now, let's dive into continuous streaming data processing using FS2. Streaming Data Plumber The streaming impl...

Building a Generic Data Integration Pipeline in Scala: The Data Plumber - Part 2

Mar 17, 2025 · 6 min read · Introduction This blog is a part of the Data Plumber Series. In Part 1, we explored the basic implementation of our data pipeline framework, demonstrating the core concepts of type-safe data transformation between sources and sinks. While the simpl...

Building a Generic Data Integration Pipeline in Scala: The Data Plumber - Part 1

Mar 17, 2025 · 6 min read · Introduction This blog is a part of the Data Plumber Series. In today's enterprise applications, data integration is not just a feature—it's a fundamental requirement. Applications need to communicate with various systems using different protocols ...

1

A Generic Approach to Parsing CSV into Case Classes in Scala 3

Feb 27, 2025 · 6 min read · CSV is one of the most common formats for exchanging and importing data between different systems. While working on a Scala 3 project, I needed a way to read CSV files and convert them into case classes generically—without manually setting values for...

AAndreas commented

Custom SBT Task to List Direct Dependencies of a Project

Jul 2, 2024 · 4 min read · Introduction Recently, at work, there was a requirement to list out the direct dependencies of the our SBT project, something like Bill Of Materials. SBT itself provides the dependencies as list or tree or searchable HTML page using the built-in comm...