Ejiro Onoseejiroonose.hashnode.dev·Oct 17, 2023Making The Right Choice: ETL vs. ELT in Data Engineering.Over the last few weeks, I’ve had to do some data engineering and was privileged to have the help of a top data engineer(who I shall keep anonymous) Thanks D :). We needed to build our data infrastructure from the ground up again and we wanted to mak...Discuss·1 likeETL
Stephen David-Williamsstephendavidwilliams.com·Sep 12, 2023Data pipelines with Python and SQL - Part 2Preface ✨ In part 1, we explored the concept of data pipelines, how Python and SQL can be used to create them, and simple code examples to demonstrate them too. This time in part 2, we will be venturing into a hands-on project that utilizes real-worl...Discuss·1 like·111 readsSQL
Stephen David-Williamsstephendavidwilliams.com·Sep 1, 2023Data pipelines with Python and SQL - Part 1Preface🌟 Data engineering’s key objective is turning raw data into valuable and usable information. A key component of this process is called a data pipeline. In this article, we dive deep into what a data pipeline is and highlight Python and SQL’s ...Discuss·1 like·584 readsETL
Richmond Damaghateryx.hashnode.dev·Aug 3, 2023Fundamental Snippet: ETL vs ELTI always encounter the term "ETL" when reading a job post for a data engineer role. Eventually, I googled it and finally found its meaning - Extract, Transform, Load. It's an automated process of extracting data from different sources, transforming i...Discuss·8 likesELT
Debra's blogiloveopensource.hashnode.dev·Jul 31, 2023ELT is dead, and EtLT will be the end of modern data processing architectureImage Source: Pixabay When talking about data processing, people often abbreviate it as “ETL.” However, if we look closely, data processing has undergone several iterations from ETL, ELT, XX ETL (such as Reverse ETL, Zero-ETL) to the currently popula...Discuss·1 likebig data
Karl Bolingerkbolinger.hashnode.dev·Apr 24, 2023Understanding ETL and ELT Workflows in Data Engineering: An Easy Guide with ExamplesData engineering is a complex field where many different technologies, frameworks, and techniques come into play. Two of the most common data processing workflows data engineers use are ETL and ELT. ETL stands for Extract, Transform, and Load, while ...Discuss·47 readsData Engineering Basicsdata-engineering
Vipul Tripathiitsvipul.hashnode.dev·Apr 2, 2023Snowflake: Pre-Requisite to Get StartedThe definition of Snowflake is that it is a cloud-based data warehousing platform that provides a fully managed, scalable, and secure solution for storing, managing, and analyzing large amounts of data. Whenever and wherever you'll hear of Snowflake,...Discuss·22 likes·81 readsZero to Snowflakesnowflake
Stephen David-Williamsstephendavidwilliams.com·Jan 12, 2023What is a data warehouse?Preface A data warehouse is a single centralized unit that collects and stores large volumes of data from several data sources. Its primary purpose is to serve as a single place where business users can gain insights into the past and current operati...Discuss·226 reads#datawarehouse
Fritz LarcoforSling Data Blogblog.slingdata.io·Nov 23, 2022Exporting data from BigTable and Loading it into your Data WarehouseBigTable You may not have heard about Google’s BigTable but it is a thriving NoSQL database offering from the juggernaut, allowing exceptional read/write performance when properly tuned. According to Google Cloud’s own blog post, BigTable manages ove...Discuss·1 like·144 readsbigtable
Fritz LarcoforSling Data Blogblog.slingdata.io·Nov 11, 2022Exporting Data from BigQuery to Snowflake, the Easy WayCloud Data Warehouses In the past few years, we've seen a rapid growth in the usage of cloud data warehouses (as well as the "warehouse-first" paradigm). Two popular cloud DWH platforms are BigQuery and Snowflake. Check out the chart below to see the...Discuss·1 like·544 readsbigquery
