Tag feed

#data-lake

101 posts10 followers

Explore Hashnode

Alternatives

Trending tags this week

MIMyData Insightsmydatainsights-blogs.hashnode.devAug 7 · 7 min read

Lakehouse vs Data Lake: Governance and Security Differences Every Enterprise Should Know

Storage and scale get the attention, but governance and security are the real difference between a Data Lake and a Lakehouse. How they compare on metadata, lineage, access control and compliance. The

0

SGSergio González Téllezevankhandev.hashnode.devJul 20 · 3 min read

Why do AI systems with increasingly sophisticated models continue to produce mediocre or inconsistent results?

SEED-011 PROBLEM Why do AI systems with increasingly sophisticated models continue to produce mediocre or inconsistent results? INSIGHT A well-modeled, validated, and governed data lake often contri

0

SSapotaCorpsapotacorpvn.hashnode.devJul 12 · 13 min read

Data engineering for a regulated fintech: a 10-month AWS lake build

Client: Regional fintech operator (anonymized per agreement) Timeline: 10-month engagement (6-month build + 4-month fine-tuning & warranty) Team: 6 engineers including 2 from Sapota's data team, worki

0

BNBraeson Nyaherabraeson.hashnode.devJul 5 · 5 min read

Slowly Changing Dimensions(SCDs) with examples; Complete Guide

What are dimensions? Dimensions are descriptive data elements used to classify or categorize data. For example in a sales database, dimensions might include product, customer, store. Dimensions includ

0

TCTencent Cloud -Cloud Log Servicetencentcloud-cls.hashnode.devJun 15 · 5 min read

Deliver CLS Logs to Tencent Cloud DLC for Spark-Based Analysis

Log platforms often start with search and alerting, then grow into data processing and analytics workflows. Tencent Cloud Log Service (CLS) already supports delivery to Ckafka and COS. The source work

0

SNSachin Nandanwarazureguru.netApr 6 · 6 min read

Retrieve the hierarchical directory structure from Azure ADLS Gen2 storage

In one of my earlier article, I demonstrated how to leverage DatalakeServiceClient to create and modify files in a Lakehouse within Microsoft Fabric. Similarly, we can use DatalakeServiceClient for op

0

AAAbstract Algorithmsabstractalgorithms.hashnode.devMar 28 · 23 min read

Medallion Architecture: Bronze, Silver, and Gold Layers in Practice

TLDR: Medallion Architecture solves the "data swamp" problem by organizing a data lake into three progressively refined zones — Bronze (raw, immutable), Silver (cleaned, conformed), Gold (aggregated,

0

AAAbstract Algorithmsabstractalgorithms.hashnode.devMar 28 · 24 min read

Modern Table Formats: Delta Lake vs Apache Iceberg vs Apache Hudi

TLDR: Delta Lake, Apache Iceberg, and Apache Hudi are open table formats that wrap Parquet files with a transaction log (or snapshot tree) to deliver ACID guarantees, time travel, schema evolution, an

0

CIComplere Infosystemcomplere.hashnode.devFeb 4 · 1 min read

Want to overcome data Silos? Try top 11 Strategies with Data Lake Consulting

Effective data management is critical for modern businesses. Data lake consulting firms help organizations centralize data, improve quality, and enable analytics for better insights. A strong data lake strategy allows teams to break down silos, suppo...

0

VVinayvinay206.hashnode.devJan 11 · 4 min read

A Plain-English Guide to Modern Data Architecture (No Jargon, I Promise)

If you’ve ever heard terms like data lake, data warehouse, ETL, streaming, or lakehouse and thought: “I kind of get it… but not really” —you’re not alone. This post breaks down modern data architecture in simple terms, explains why each component e...

0

#data-lake

Search Hashnode

#data-lake

Explore Hashnode

Trending tags this week

Lakehouse vs Data Lake: Governance and Security Differences Every Enterprise Should Know

Why do AI systems with increasingly sophisticated models continue to produce mediocre or inconsistent results?

Data engineering for a regulated fintech: a 10-month AWS lake build

Slowly Changing Dimensions(SCDs) with examples; Complete Guide

Deliver CLS Logs to Tencent Cloud DLC for Spark-Based Analysis

Retrieve the hierarchical directory structure from Azure ADLS Gen2 storage

Medallion Architecture: Bronze, Silver, and Gold Layers in Practice

Modern Table Formats: Delta Lake vs Apache Iceberg vs Apache Hudi

Want to overcome data Silos? Try top 11 Strategies with Data Lake Consulting

A Plain-English Guide to Modern Data Architecture (No Jargon, I Promise)