Harsh Daiya

@harshdaiya

Deving the Dev

Omaha, NEJoined September 2020

About

Sr. Data Engineer working mostly on Data and Observability problems. Writing mostly about Data and cloud, sometimes productivity and other musings.

Available for

Mentoring, Tech chats, Ideas, Investments

Harsh Daiya's blogs

HD's blog - Data, DataOps, Observability, MLopsblog.harshdaiya.com26 posts

Chainproof.io Blogblog.chainproof.io1 post

Articles Threads Comments

Recently published

blog.chainproof.io

Hello World!

Lets get Started

Apr 10, 20251 min read

blog.harshdaiya.com

Apache Hudi: A Deep Dive with Python Code Examples

In today's data-driven world, real-time data processing and analytics have become crucial for businesses to stay competitive. Apache Hudi (Hadoop Upserts and Incremental) is an open-source data management framework that provides efficient data ingest...

Jun 8, 20245 min read

blog.harshdaiya.com

Exploring Large Language Models (LLMs) with Python: A Comprehensive Guide

Introduction Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP). These models, such as GPT-4, are designed to understand and generate human-like text. In this post, we will delve into how to work with LLMs...

Feb 15, 20246 min read

blog.harshdaiya.com

Implementing Real-Time Credit Card Fraud Detection with Apache Flink on AWS

Credit card fraud is a significant concern for financial institutions, as it can lead to considerable monetary losses and damage customer trust. Real-time fraud detection systems are essential for identifying and preventing fraudulent transactions as...

Jan 5, 20244 min read

blog.harshdaiya.com

Managing keys & environment variables in a python pipeline/app

In a production ETL (extract, transform, load) pipeline, it is often helpful to manage environment variables to store sensitive information, such as database credentials or API keys. This allows you to keep this sensitive information separate from yo...

Oct 31, 20233 min read

Harsh Daiya

About

Available for

Harsh Daiya's blogs

Recently published

Hello World!

Apache Hudi: A Deep Dive with Python Code Examples

Exploring Large Language Models (LLMs) with Python: A Comprehensive Guide

Implementing Real-Time Credit Card Fraud Detection with Apache Flink on AWS

Managing keys & environment variables in a python pipeline/app

Search Hashnode

Harsh Daiya

About

Available for

Harsh Daiya's blogs

Recently published

Hello World!

Apache Hudi: A Deep Dive with Python Code Examples

Exploring Large Language Models (LLMs) with Python: A Comprehensive Guide

Implementing Real-Time Credit Card Fraud Detection with Apache Flink on AWS

Managing keys & environment variables in a python pipeline/app