samhita sarkarsamhita-sarkar.hashnode.dev·Nov 11, 2024Deciding When to Normalize or Denormalize Data for Best ResultsNormalisation and denormalisation are essentially design patterns in databases that determine how data is stored and used. Storage pattern : The key difference between normalisation and denormalisation is their storage patterns, which are essentially...Discuss·1 like·44 readsDatabases
Mehul Kansalmehulkansal.hashnode.dev·Sep 30, 2024Week 18: Azure Synapse Key Concepts 🔑Hey data folks! 👋 This week’s blog explores how to provision and use key features like Serverless SQL Pools, Dedicated SQL Pools, and Apache Spark Pools within an Azure Synapse workspace. We’ll dive into creating external tables, loading data from A...DiscussAzure
Mehul Kansalmehulkansal.hashnode.dev·Sep 2, 2024Week 15: Lakehouse Architecture and Delta Engine 🏠Hey data engineers! 👋 In this blog, we explore the Azure Lakehouse architecture, focusing on how Databricks Lakehouse integrates the benefits of data lakes and data warehouses. We'll dive into its core components, such as the storage layer, Delta La...DiscussData-lake
neurontistneurontist.hashnode.dev·Sep 1, 2024Data Lakes vs Data Warehouses: How to Choose the Right OneWhen it comes to managing and analyzing vast amounts of data, businesses are often faced with a critical decision: should they invest in a data lake or a data warehouse? Choosing between a data lake and a data warehouse can feel like navigating a maz...DiscussData Science
Danish bukshdanish2299.hashnode.dev·Aug 28, 2024Understanding AWS Redshift: A Comprehensive GuideIntroduction In the fast-paced world of big data and analytics, organizations need robust tools to store, manage, and analyze massive amounts of data efficiently. One such powerful tool is Amazon Redshift, a fully managed, petabyte-scale data warehou...DiscussAWS
Mehul Kansalmehulkansal.hashnode.dev·Aug 26, 2024Week 14: Delta Lake on Azure Databricks 🚀Hey there! 👋 In this week's blog, we’ll delve into the specific challenges associated with traditional Data Lakes and demonstrate how Delta Lake, an open-source storage layer, effectively addresses these issues, with hands-on examples using Azure Da...DiscussAzure
Emma Jonesdigitallyemma.hashnode.dev·Aug 22, 2024The Modern Data Warehouse: Bridging the Gap Between Data and Actionable InsightsA new era of data management has arrived, in which organizations are empowered to make informed decisions based on vast information. Data is an organization's lifeblood. However, with the speed at which data is growing and the demands of analytics ch...Discussdata-warehousing
Hana Satohanasato.hashnode.dev·Aug 16, 2024Data-as-an-Asset: Unlocking the True Value of InformationIn today's digital economy, data is no longer just a byproduct of business operations—it has become a critical asset that drives innovation, efficiency, and competitive advantage. As organizations increasingly recognize the strategic value of data, t...DiscussData-as-an-Asset
Cavin KaremaforData Engineering conceptsdata-engineering.hashnode.dev·Aug 4, 2024Data Warehousing SeriesWhat are dimension tables? Dimension tables group related attributes that provide context to a business process. They contain associated context with a business process or measurement event. Dimensions are descriptive in nature, they typically descri...Discussdata
Shreyan Dasshreyandas.hashnode.dev·Jul 19, 2024Need for speed, but where do I store all of this data?Dear Diary, The most dreaded day in the life of any data engineer came to me a while ago — our TL sat us down to tell us that we had been billed an enormous amount for our cloud storage in the last quarter, and we needed to find a way to cut down sto...Kev and 1 other are discussing this2 people are discussing thisDiscuss·40 likes·27 readsConfessions of a Data Engineerdata-engineering
