Tag feed

#deltalake

39 posts2 followers

Explore Hashnode

Alternatives

Trending tags this week

KKKrunal Kanojiyakrunalkanojiya.hashnode.dev2d ago · 3 min read

Delta Lake Explained: What It Actually Does and Why Your Data Lake Needs It

Every data lake has the same problem underneath. You store Parquet files in cloud object storage. Cheap. Scalable. Open. That part works fine. Then a pipeline fails halfway through a write. You end up

0

KKKushneet Kaurcloudnativebykushneet.hashnode.dev3d ago · 5 min read

What is a Lakehouse?

This article is part of the Databricks from Scratch series.Start from the beginning: Stop Optimising Your Prompts. Fix Your Data Pipelines. Picture this. It's IPL ticket booking day. 10 AM. 1 crore

0

KKKushneet Kaurcloudnativebykushneet.hashnode.devMay 23 · 6 min read

Stop Optimizing Your Prompts. Fix Your Data Pipelines.

or a long time, I thought building AI was fundamentally a modeling problem. Better architecture. More parameters. Smarter prompts. That was the game — or so I believed. It took working through real, p

2

V

Ssrkhan2809core-de-platform.hashnode.devMay 11 · 4 min read

Delta Lake Deep Dive: The ACID Trip That Actually Works (Mostly)

Act 1: The "Then vs. Now" – Why Delta? Back in the day, a Data Lake was just a folder of files. If two people wrote to it at once, the data became a scrambled egg. FeatureThe Parquet "Swamp" (Then)The

0

Cchristan_technochristan-tech-blog.hashnode.devMar 29 · 13 min read

Databricks Account Hierarchy Explained: A Complete Guide to Unity Catalog, Workspaces, and Data Governance

TL;DR: Databricks organizes everything in a layered hierarchy — Account → Metastore → Workspace → Catalog → Schema → Table. Understanding how Workspaces, Bindings, and Permissions interact at each lay

0

KBKilian Baccaro Salinasdatagym.esJan 9 · 8 min read

Sparkwise: Optimización Inteligente para Apache Spark en Microsoft Fabric

Si trabajas con Apache Spark en Microsoft Fabric, probablemente te hayas enfrentado a la complejidad de optimizar configuraciones, reducir costos y mejorar el rendimiento de tus workloads. Sparkwise es una librería de Python diseñada específicamente ...

0

KBKilian Baccaro Salinasdatagym.esDec 15, 2025 · 6 min read

¿Qué es la deduplicación de datos y por qué es tan importante?

En el universo de los datos, la presencia de duplicados es casi una garantía. Desde registros de clientes que se repiten hasta transacciones que aparecen más de una vez, los datos duplicados son un problema silencioso que puede socavar la fiabilidad ...

0

MAMbuotidem Awakmbuotidemawak.hashnode.devDec 11, 2025 · 8 min read

Data Architecture: Managed and External Tables in Fabric Lakehouse

When you work with data in Fabric Lakehouse, you need to understand two fundamental table types: managed tables and external tables. This distinction affects how your data is stored, accessed, and what happens when you delete tables. This article exp...

0

BBladePipebladepipe.hashnode.devOct 29, 2025 · 8 min read

Choosing Your Data Lake Format in 2025:Iceberg vs Delta Lake vs Paimon

In the era of big data, data lakes became a popular choice for large-scale analytics, thanks to their flexibility, low cost, and separation of storage and compute. But they’ve also struggled with consistency, schema drift, and complex query optimizat...

0

AMAlex Mercedtechblog.alexmerced.comSep 25, 2025 · 19 min read

The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

title: The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake date: "2025-09-24" description: "Understanding Iceberg, Delta Lake, Hudi, Paimon, and DuckLake" author: "Alex Merced" category: "Data Engineering" banne...

0

#deltalake

Search Hashnode

#deltalake

Explore Hashnode

Trending tags this week

Delta Lake Explained: What It Actually Does and Why Your Data Lake Needs It

What is a Lakehouse?

Stop Optimizing Your Prompts. Fix Your Data Pipelines.

Delta Lake Deep Dive: The ACID Trip That Actually Works (Mostly)

Databricks Account Hierarchy Explained: A Complete Guide to Unity Catalog, Workspaces, and Data Governance

Sparkwise: Optimización Inteligente para Apache Spark en Microsoft Fabric

¿Qué es la deduplicación de datos y por qué es tan importante?

Data Architecture: Managed and External Tables in Fabric Lakehouse

Choosing Your Data Lake Format in 2025:Iceberg vs Delta Lake vs Paimon

The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake