Shreyan Dasshreyandas.hashnode.dev·Jul 19, 2024Need for speed, but where do I store all of this data?Dear Diary, The most dreaded day in the life of any data engineer came to me a while ago — our TL sat us down to tell us that we had been billed an enormous amount for our cloud storage in the last quarter, and we needed to find a way to cut down sto...Kev and 1 other are discussing this2 people are discussing thisDiscuss·40 likesConfessions of a Data Engineerdata-engineering
Abhishek Jaiswaldataplumber.hashnode.dev·Jun 29, 2024Data Democratization..In today's data-driven world, data democratization is a game-changer for businesses. By making data accessible to all employees, regardless of their technical expertise, companies can harness the power of information to drive efficiency, innovation, ...Discuss·1 likedata-engineering
Abhishek Jaiswaldataplumber.hashnode.dev·Jun 28, 2024Snowflake Architecture: A Modern Approach to Data WarehousingSnowflake's architecture represents a significant evolution in data warehousing, designed to handle the challenges of modern data analytics with unmatched efficiency and scalability. This innovative platform is built on a unique architecture that sep...Discusssnowflake
Kaushik IskaforPeerDB Blogblog.peerdb.io·May 7, 2024PeerDB Cloud is Now in Public Beta!🚀 Today, we're excited to announce that PeerDB Cloud is officially entering public beta. If you're a data engineer or an organization looking for a fast, simple, and cost-effective way to replicate data from Postgres to data warehouses such as Snowf...Discuss·1 like·153 readsdata-movement
Sourabh Guptaonlydataengineering.hashnode.dev·Apr 22, 2024How to Load Data from SQL Server to SnowflakeIn today's data-driven world, organizations often need to migrate their data from one system to another for various reasons, such as consolidating data sources, upgrading to a more modern and efficient platform, or enabling advanced analytics. One co...DiscussSql server to Snowflake
Nikhil ThomasforSnow Forged Machine Minds (SFM2)sfm2.ai·Mar 12, 2024Data Engineering Foundations: A Practical Introduction to Snowflake, Fivetran, and dbtWelcome to our exciting journey through the world of data integration and transformation! Today, we're diving into a practical project that involves a trio of modern data tools: Snowflake, Fivetran, and dbt. Whether you're a data enthusiast, a profes...Discuss·208 readsfivetran
Daniel Olusesitechvillian.hashnode.dev·Feb 24, 2024Unlock the Power of the Cloud: How PostgreSQL Supercharges Your Data Storage and WarehousingIntroduction: In today's digital landscape, data holds the key to unlocking insights and driving informed decision-making. PostgreSQL stands out as a powerful tool in this endeavor, offering a robust platform for managing both structured and unstruct...Discuss·15 likes·96 readsPostgreSQL
Stefan StarkeforCloudflight Engineering Blogengineering.cloudflight.io·Feb 14, 2024Lakehouse: Securing data accessIn this article, we'll delve into best practices for securing data access when using Microsoft Fabric Lakehouses. The goal is ensuring that your valuable data remains protected and enable people from within your organization to see subsets of the dat...Discuss·642 readsfabric
Kunal GuptaforPeerDB Blogblog.peerdb.io·Jan 17, 2024SSH Tunneling for Secure Postgres ReplicationAt PeerDB, we are building a fast and a cost-effective way to replicate data from Postgres to Data Warehouses, Queues and Storage. This blog post talks about how PeerDB accesses Postgres Databases securely via SSH Tunneling and moves data to any of i...Discuss·1 like·2.1K readsPostgreSQL
Nkoyo Ekponkoyoekpo.hashnode.dev·Oct 14, 2023Demystifying Database, Data Warehouse, and Data Lake: Unraveling the DifferencesAccording to a recent survey by Datanami, databases are the most widely used data storage technology, followed by data lakes and data warehouses. The survey found that 86% of respondents use databases, 68% use data lakes, and 61% use data warehouses ...DiscussDatabases
