Home
Feed

Extend

Hashnode Pro
Hashnode for Agents

Resources

The foreword
Hashnode gql skill

Buildful - AI coding agent that delivers frontier-level results at a fraction of the cost Bug0 - The AI-native e2e QA regression testing Hackathons Changelog Brand @hashnode on X Hashnode on LinkedIn Support - hello+support@hashnode.com Code of Conduct Terms Privacy Sitemap

Sign in

Search Hashnode

Search posts, tags, users, and pages

Harsh Daiya (@harshdaiya) | Hashnode

@harshdaiya

Harsh Daiya

@harshdaiya·Omaha, NE·Joined September 2020

Deving the Dev

About

Sr. Data Engineer working mostly on Data and Observability problems. Writing mostly about Data and cloud, sometimes productivity and other musings.

Available for

Mentoring, Tech chats, Ideas, Investments

Harsh Daiya's blogs

HD's blog - Data, DataOps, Observability, MLopsblog.harshdaiya.com25 posts

Articles Comments

About

Sr. Data Engineer working mostly on Data and Observability problems. Writing mostly about Data and cloud, sometimes productivity and other musings.

Available for

Mentoring, Tech chats, Ideas, Investments

Harsh Daiya's blogs

HD's blog - Data, DataOps, Observability, MLopsblog.harshdaiya.com25 posts

Apache Hudi: A Deep Dive with Python Code Examples

In today's data-driven world, real-time data processing and analytics have become crucial for businesses to stay competitive. Apache Hudi (Hadoop Upserts and Incremental) is an open-source data management framework that provides efficient data ingest...

Jun 8, 2024 · 5 min readblog.harshdaiya.com

Exploring Large Language Models (LLMs) with Python: A Comprehensive Guide

Introduction Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP). These models, such as GPT-4, are designed to understand and generate human-like text. In this post, we will delve into how to work with LLMs...

Feb 15, 2024 · 6 min readblog.harshdaiya.com

Implementing Real-Time Credit Card Fraud Detection with Apache Flink on AWS

Credit card fraud is a significant concern for financial institutions, as it can lead to considerable monetary losses and damage customer trust. Real-time fraud detection systems are essential for identifying and preventing fraudulent transactions as...

Jan 5, 2024 · 4 min readblog.harshdaiya.com

Managing keys & environment variables in a python pipeline/app

In a production ETL (extract, transform, load) pipeline, it is often helpful to manage environment variables to store sensitive information, such as database credentials or API keys. This allows you to keep this sensitive information separate from yo...

Oct 31, 2023 · 3 min readblog.harshdaiya.com

Migrating from AWS Redshift to Google BigQuery: A Step-by-Step Guide

A Comprehensive Guide to Migrating from Redshift to BigQuery Migrating your data from Amazon Redshift to Google BigQuery can be a significant undertaking, but with careful planning and execution, it can lead to enhanced performance and scalability fo...

Aug 10, 2023 · 4 min readblog.harshdaiya.com