Tag feed

#data-lake

104 posts10 followers

Explore Hashnode

Alternatives

Trending tags this week

MKMugesh Krishna {M K }organization-data-analysis-agent.hashnode.dev1d ago · 8 min read

Databricks LTAP: Bringing PostgreSQL OLTP and Lakehouse Analytics Together

Introduction Modern applications continuously generate transactional data. PostgreSQL is commonly used as the operational database because applications need fast and reliable INSERT, UPDATE, DELETE, a

0

VSvikas sharmavkdigiservices.hashnode.dev6d ago · 4 min read

Best Data Lake Solutions for Growing Business Data

Every growing business eventually reaches a point where its data becomes too diverse to manage through isolated storage systems. Customer information, application logs, documents, media files, backups

0

Aaslangamzenur079gamzenuraslan.hashnode.devSep 11 · 4 min read

I Finally Understood Why We Need OLTP, OLAP, Data Lakes and Lakehouses

Lately I have been spending more time on data engineering and one question kept coming back to me Where should the data actually live At first this sounded like a simple storage decision. Then I reali

0

MIMyData Insightsmydatainsights-blogs.hashnode.devAug 7 · 7 min read

Lakehouse vs Data Lake: Governance and Security Differences Every Enterprise Should Know

Storage and scale get the attention, but governance and security are the real difference between a Data Lake and a Lakehouse. How they compare on metadata, lineage, access control and compliance. The

0

SGSergio González Téllezevankhandev.hashnode.devJul 20 · 3 min read

Why do AI systems with increasingly sophisticated models continue to produce mediocre or inconsistent results?

SEED-011 PROBLEM Why do AI systems with increasingly sophisticated models continue to produce mediocre or inconsistent results? INSIGHT A well-modeled, validated, and governed data lake often contri

0

SSapotaCorpsapotacorpvn.hashnode.devJul 12 · 13 min read

Data engineering for a regulated fintech: a 10-month AWS lake build

Client: Regional fintech operator (anonymized per agreement) Timeline: 10-month engagement (6-month build + 4-month fine-tuning & warranty) Team: 6 engineers including 2 from Sapota's data team, worki

0

BNBraeson Nyaherabraeson.hashnode.devJul 5 · 5 min read

Slowly Changing Dimensions(SCDs) with examples; Complete Guide

What are dimensions? Dimensions are descriptive data elements used to classify or categorize data. For example in a sales database, dimensions might include product, customer, store. Dimensions includ

0

TCTencent Cloud -Cloud Log Servicetencentcloud-cls.hashnode.devJun 15 · 5 min read

Deliver CLS Logs to Tencent Cloud DLC for Spark-Based Analysis

Log platforms often start with search and alerting, then grow into data processing and analytics workflows. Tencent Cloud Log Service (CLS) already supports delivery to Ckafka and COS. The source work

0

SNSachin Nandanwarazureguru.netApr 6 · 6 min read

Retrieve the hierarchical directory structure from Azure ADLS Gen2 storage

In one of my earlier article, I demonstrated how to leverage DatalakeServiceClient to create and modify files in a Lakehouse within Microsoft Fabric. Similarly, we can use DatalakeServiceClient for op

0

AAAbstract Algorithmsabstractalgorithms.hashnode.devMar 28 · 23 min read

Medallion Architecture: Bronze, Silver, and Gold Layers in Practice

TLDR: Medallion Architecture solves the "data swamp" problem by organizing a data lake into three progressively refined zones — Bronze (raw, immutable), Silver (cleaned, conformed), Gold (aggregated,

0

#data-lake

Search Hashnode

#data-lake

Explore Hashnode

Trending tags this week

Databricks LTAP: Bringing PostgreSQL OLTP and Lakehouse Analytics Together

Best Data Lake Solutions for Growing Business Data

I Finally Understood Why We Need OLTP, OLAP, Data Lakes and Lakehouses

Lakehouse vs Data Lake: Governance and Security Differences Every Enterprise Should Know

Why do AI systems with increasingly sophisticated models continue to produce mediocre or inconsistent results?

Data engineering for a regulated fintech: a 10-month AWS lake build

Slowly Changing Dimensions(SCDs) with examples; Complete Guide

Deliver CLS Logs to Tencent Cloud DLC for Spark-Based Analysis

Retrieve the hierarchical directory structure from Azure ADLS Gen2 storage

Medallion Architecture: Bronze, Silver, and Gold Layers in Practice