Vipinvipinmp.hashnode.dev·May 8, 2024Quick and Easy Apache Airflow Setup TutorialApache Airflow is an open-source platform designed to manage workflows, specifically data pipelines. It was created by Airbnb to handle their increasingly complex workflows and allows users to: Define workflows using Python code. This makes them eas...Discuss·33 readsapache-airflow
Yogendra Porwalqasimple.hashnode.dev·Mar 15, 2024The Power Of Regex For Data Quality TestingIn our previous articles of ETL Testing Series, we explored the different stages of ETL testing, emphasizing the importance of verifying data integrity throughout the transformation pipeline and various aspect of Data Quality Testing. Today, we’ll de...Discuss·1 likeETL Testingetltesting
shakyapreetitechguru1.hashnode.dev·Feb 27, 2024Getting Started with Data Analytics: A Beginner's OverviewIntroduction: Unlocking valuable insights from vast volumes of data is imperative in today's data-centric landscape. Data analytics stands as a pivotal tool for both individuals and organizations aiming to make informed decisions, streamline processe...DiscussDataStrategy
Yogendra Porwalqasimple.hashnode.dev·Feb 27, 2024ETL: Transformation Layer - A Tester's PerspectiveAs a tester, We need to ensure the accuracy and consistency of information flowing through the ETL pipeline. In previous article we explored Testing of Extraction process but In the heart of this process lies the transformation layer, where raw data ...Discuss·1 likeETL TestingELT
TJ GokcenProtjgokcen.com·Feb 21, 2024Part 2: Data Collection and Preparation for Machine LearningIntroduction: The Foundation of Machine Learning The journey towards creating a robust machine learning model begins long before the first line of code is written—it starts with data. That's right, data is the real hero of our story. The collection a...DiscussAn Introduction to Data Training: Laying the Foundation for Machine LearningMachine Learning
Yogendra Porwalqasimple.hashnode.dev·Feb 18, 2024ETL: Testing of Extraction ProcessIn this article, we will focus on testing of the first step of the ETL process: Extraction. We will explore what extraction is, different types of sources, how to test the extraction process, the support QA needs from developers or product teams, and...Discuss·12 likes·43 readsETL Testingetltesting
Stephen David-Williamsstephendavidwilliams.com·Feb 13, 2024Create a web scraping pipeline with Python using data contractsPreface 💫 This is a practical end-to-end data pipeline demo to show what a data project incorporating data contracts looks like. We’ll be scraping the Premier League table standings for the 2023/24 season, as of 13th February 2024 (the date this art...Vishnu Tiwari and 1 other are discussing this2 people are discussing thisDiscuss·6 likes·134 readsdata contracts
Yogendra Porwalqasimple.hashnode.dev·Feb 12, 2024Introduction To Elt TestingData integration is a critical process in any organization that deals with large volumes of data. Extract, Transform and Load (ETL) is a popular approach used in data integration, where data is first extracted from various sources, then loaded into a...Discuss·1 likeETL Testingetltesting
TJ GokcenProtjgokcen.com·Feb 6, 2024An Introduction to Data Training: Laying the Foundation for Machine LearningReady to embark on an exciting journey into the world of AI and ML? Perfect! Let's start at the very beginning with a concept that's absolutely essential - data training. Now, you might be thinking, "Data training... that doesn't sound too complicate...DiscussAn Introduction to Data Training: Laying the Foundation for Machine LearningData Training
Markmarkjacob.hashnode.dev·Oct 31, 2023Common Challenges of ERP ImplementationERP implementation can be a complex mission as it can adversely impact existing business processes. And to realize the capabilities and capabilities of the new system, businesses often have to modify functionalities and operations accordingly. Compan...DiscussERP
