Alfin Rohadialfrode.com·May 2, 2024Everything you need to get started with data engineering (part 1)Not too long ago, data-driven companies started to use the phrase "data engineer" as the data has increase in velocity, volume, value, variety and veracity (also known as 5 V's in big data) that, in the nutshell, require a broader focus on sophistica...17 likes·149 readsdata-engineering
Aryan Mallaaryan19.hashnode.dev·Mar 7, 2024Intro to Data EngineeringIn today’s era where data holds value, the role of data engineering has become increasingly crucial. In this blog post, we'll dive deeper into the world of data engineering, exploring its importance, key concepts, and the tools and technologies that ...data-engineering
Aravind Rajeshinscope.hashnode.dev·Dec 26, 2023Unveiling the Essence of Data EngineeringData engineering is a field within data management that focuses on the practical application of engineering principles to the design, development, and maintenance of systems for collecting, processing, and storing data. It involves the entire data li...10 likesdata-engineering
Harshita Chaudharyharshita.hashnode.dev·Oct 7, 2023Modes of handling corrupt dataToday, we have a substantial amount of data, and it's not necessary that all the records are free from corruption. PySpark provides us with three modes for handling corrupted data. Let's delve into it! Permissive mode - In this approach, PySpark wi...data
Warui Wanjiruwaruithemystery.hashnode.dev·Jun 23, 2023Mastering the basics: Unlocking the Data PotentialIntroduction: Welcome back, esteemed readers, to another captivating installment of our blog series on the transformative world of data engineering! In our previous articles, we explored the fascinating realm of data-driven technologies and the pivot...10 likesdata-engineering
Warui Wanjiruwaruithemystery.hashnode.dev·Jun 21, 2023Mastering the basics: Powering Organizational SuccessIntroduction: In the realm of data-driven organizations, data engineers play a crucial role in building and maintaining the data infrastructure that drives decision-making and business success. In this continuation of our blog series, we will explore...Technical Tuesdaydata-engineering
Warui Wanjiruwaruithemystery.hashnode.dev·Jun 20, 2023Mastering the basics: Navigating the Path to SuccessIntroduction: Welcome back to our captivating series on data engineering! In our previous blog posts, we explored the fundamentals of this dynamic field and discussed the crucial role of data engineers in our data-driven society. Today, we continue o...10 likes·27 readsTechnical Tuesdaydata-engineering
