---
title: "#data-pipelines articles | Hashnode"
description: "Explore 52 articles tagged #data-pipelines on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/data-pipelines"
---

Tag

# #data-pipelines

52 posts · 0 followers

[Yemi Ojedapo](https://hashnode.com/@Hyemiie) · [5d ago](https://hashnode.com/posts/schema-drift-vs-semantic-drift-in-data-pipelines/6af6f326f94aa3564f351d31)

### [Schema Drift vs. Semantic Drift in Data Pipelines](https://freecodecamp.org/news/schema-drift-vs-semantic-drift-in-data-pipelines?utm_source=hashnode&utm_medium=feed)

When a column is removed from a source database or dataset, the next pipeline run usually fails, making the problem easy to detect. But when a field keeps the same name and data type but its meaning c

23 min read · [freecodecamp.org](https://freecodecamp.org/news/schema-drift-vs-semantic-drift-in-data-pipelines?utm_source=hashnode&utm_medium=feed)

[Future Tech Career Hub](https://hashnode.com/@futuretechcareerhub) · [Oct 7](https://hashnode.com/posts/data-engineering-roadmap-from-sql-and-python-to-modern-data-pipelines/6ac6516dbfe1165273af2501)

### [Data Engineering Roadmap: From SQL and Python to Modern Data Pipelines](https://futuretechcareerhub.hashnode.dev/data-engineering-roadmap-from-sql-and-python-to-modern-data-pipelines?utm_source=hashnode&utm_medium=feed)

A practical guide to building data pipelines, working with cloud platforms, and developing production-ready data systems

10 min read · [futuretechcareerhub.hashnode.dev](https://futuretechcareerhub.hashnode.dev/data-engineering-roadmap-from-sql-and-python-to-modern-data-pipelines?utm_source=hashnode&utm_medium=feed)

[Andrew Tan](https://hashnode.com/@tandrew) · [Sep 24](https://hashnode.com/posts/iceberg-is-easy-to-demo-the-maintenance-bill-arrives-later/6ab4db25f9b7015735527db2)

### [Iceberg Is Easy to Demo. The Maintenance Bill Arrives Later.](https://layline.hashnode.dev/iceberg-is-easy-to-demo-the-maintenance-bill-arrives-later?utm_source=hashnode&utm_medium=feed)

Open table formats solve portability. They do not solve operations. The real work starts after the launch post: compaction, retention, and more.

9 min read · [layline.hashnode.dev](https://layline.hashnode.dev/iceberg-is-easy-to-demo-the-maintenance-bill-arrives-later?utm_source=hashnode&utm_medium=feed)

[Andrew Tan](https://hashnode.com/@tandrew) · [Sep 1](https://hashnode.com/posts/why-85-of-enterprises-aren-t-ready-for-ai/6a96d8f3246bbe96cb41d578)

### [Why 85% of Enterprises Aren't Ready for AI](https://layline.hashnode.dev/why-85-of-enterprises-aren-t-ready-for-ai?utm_source=hashnode&utm_medium=feed)

Fivetran's 2026 benchmark found 85% of enterprises running agentic AI on infrastructure that isn't ready. The model isn't the problem.

6 min read · [layline.hashnode.dev](https://layline.hashnode.dev/why-85-of-enterprises-aren-t-ready-for-ai?utm_source=hashnode&utm_medium=feed)

[Wesley Kambale](https://hashnode.com/@kambale) · [Jul 29](https://hashnode.com/posts/data-pipelines-with-grain/6a6951a3c391c6185d3f46df)

### [Feeding the Beast: Data Pipelines with Grain](https://kambale.dev/data-pipelines-with-grain?utm_source=hashnode&utm_medium=feed)

Over the last seven weeks we have built models, written training loops, composed optimizers, bulletproofed our code with Chex, and learned to debug inside JIT-compiled functions. Every one of those ar

13 min read · [kambale.dev](https://kambale.dev/data-pipelines-with-grain?utm_source=hashnode&utm_medium=feed)

[2](https://hashnode.com/posts/data-pipelines-with-grain/6a6951a3c391c6185d3f46df)

[Anirudh Singh Bhadauria](https://hashnode.com/@AnirudhBhadauria) · [Jul 21](https://hashnode.com/posts/sdp/6a5f2ff3bc494ef6473a592f)

### [Stop Building ETL Pipelines. Start Declaring Them ✨](https://anirudhbhadauria.hashnode.dev/sdp?utm_source=hashnode&utm_medium=feed)

Discover how Spark Declarative Pipelines SDP replaces complex ETL orchestration with Auto Loader, Auto CDC & Append Flows for simple data engineering

6 min read · [anirudhbhadauria.hashnode.dev](https://anirudhbhadauria.hashnode.dev/sdp?utm_source=hashnode&utm_medium=feed)

[AlterLab](https://hashnode.com/@alterlab) · [May 11](https://hashnode.com/posts/agentic-rag-vs-traditional-rag-architecting-real-time-ai-data-pipelines/6a020e5fa78103c9c2e3b417)

### [Agentic RAG vs Traditional RAG: Architecting Real-Time AI Data Pipelines](https://alterlab.hashnode.dev/agentic-rag-vs-traditional-rag-architecting-real-time-ai-data-pipelines?utm_source=hashnode&utm_medium=feed)

Retrieval-Augmented Generation (RAG) solved the initial problem of LLM hallucinations by grounding models in factual data. But traditional RAG architectures share a fundamental flaw: they rely on static data. If you are building an AI agent for finan...

9 min read · [alterlab.hashnode.dev](https://alterlab.hashnode.dev/agentic-rag-vs-traditional-rag-architecting-real-time-ai-data-pipelines?utm_source=hashnode&utm_medium=feed)

[AlterLab](https://hashnode.com/@alterlab) · [May 10](https://hashnode.com/posts/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency/6a00bb12455c25b5f737c056)

### [RAG Pipelines: Why Markdown Extraction Beats HTML for Token Efficiency](https://alterlab.hashnode.dev/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency?utm_source=hashnode&utm_medium=feed)

Feeding raw HTML into a Retrieval-Augmented Generation (RAG) pipeline is computationally expensive and highly inefficient. Large Language Models (LLMs) operate on tokens, and HTML DOM structures are notoriously token-heavy. When you pipe raw HTML int...

6 min read · [alterlab.hashnode.dev](https://alterlab.hashnode.dev/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency/6a00bb12455c25b5f737c056)

[AlterLab](https://hashnode.com/@alterlab) · [May 8](https://hashnode.com/posts/how-to-give-your-ai-agent-access-to-reddit-data/69fdd2fa688d422805cde4da)

### [How to Give Your AI Agent Access to Reddit Data](https://alterlab.hashnode.dev/how-to-give-your-ai-agent-access-to-reddit-data?utm_source=hashnode&utm_medium=feed)

Disclaimer: This guide covers accessing publicly available data. Always review a site's robots.txt and Terms of Service before automated access. AI agents require robust, real-time data to execute complex tasks. Connecting an agent to public discussi...

5 min read · [alterlab.hashnode.dev](https://alterlab.hashnode.dev/how-to-give-your-ai-agent-access-to-reddit-data?utm_source=hashnode&utm_medium=feed)

[AlterLab](https://hashnode.com/@alterlab) · [May 7](https://hashnode.com/posts/how-to-give-your-ai-agent-access-to-amazon-data/69fc7be5533febeae5d5ed57)

### [How to Give Your AI Agent Access to Amazon Data](https://alterlab.hashnode.dev/how-to-give-your-ai-agent-access-to-amazon-data?utm_source=hashnode&utm_medium=feed)

Disclaimer: This guide covers accessing publicly available data. Always review a site's robots.txt and Terms of Service before automated access. Building AI agents that interact with real-world e-commerce requires live data. Stale training data doesn...

4 min read · [alterlab.hashnode.dev](https://alterlab.hashnode.dev/how-to-give-your-ai-agent-access-to-amazon-data?utm_source=hashnode&utm_medium=feed)
