BuzzGKbuzzgk.hashnode.dev·Nov 7, 2024Data Quality Checks TechniquesEnsuring the accuracy, completeness, and reliability of data is crucial for making informed decisions and maintaining the trust of stakeholders. Implementing data quality checks using SQL and orchestrating them with tools like Apache Airflow can help...Discussdata-quality
Vipinvipinmp.hashnode.dev·Oct 26, 2024Building a Data Quality Testing Framework Using Snowflake and SQLIn the era of data-driven decision-making, maintaining high data quality is crucial. Poor data quality can lead to incorrect insights, impacting business decisions. This blog post will guide you through building a robust data quality testing framewor...Discuss·29 readsdata-quality
Imri ParanforCollate Blogblog.getcollate.io·Oct 15, 2024Data Diff in OpenMetadata and CollateIn large-scale data operations, data is continuously transformed, migrated, and replicated across different systems. Ensuring the consistency of this data—especially between systems like OLTP databases and OLAP warehouses—is a challenging but crucial...Discussdata-quality
Marc Greenbergcodemarc.hashnode.dev·Oct 14, 2024The Modern Data Engineer's JourneyBy Marc J. Greenberg, Seasoned Software Professionaland Former Chief Architect at iWay Software Introduction The world of data has transformed dramatically over the past few decades. As someone who has been deeply involved in this evolution—particula...Discussdata-engineering
pallavi chauhaninnovateitworld.hashnode.dev·Oct 8, 2024Data Analytics in Action: Boosting Business Efficiency and GrowthIn today’s digital age, businesses are inundated with vast amounts of data generated from customer interactions, operational processes, and market trends. The challenge isn't in data collection but in effectively leveraging it. This is where data ana...Discussdata analytics
Mohammed ZeeshanforData Qualitydata-quality.hashnode.dev·Sep 29, 2024Enhancing Data Quality in Snowflake Using a Streamlit FrameworkIntroduction In today's data-driven landscape, organizations rely heavily on accurate and reliable data to make informed decisions. Snowflake, as a leading cloud-based data platform, offers robust solutions for managing vast amounts of data. However,...Discusssnowflake
Ilham OulakbirforEnsuring Data Quality and Governanceensuringdataqualityandgovernance.hashnode.dev·Sep 23, 2024Best Practices for Data Engineers: Ensuring Data Quality and GovernanceIntroduction: In the world of data engineering, ensuring the quality and governance of data is as important as building robust pipelines and scalable architectures. Without proper governance and quality measures, the data you work with can lead to in...Discuss·2 likes·29 readsData Tools
Pronod Bharatiyadata-intelligence.hashnode.dev·Sep 18, 2024Monitoring AI at Scale: A Comprehensive and Layered ApproachIn the dynamic and evolving world of Artificial Intelligence (AI) and Machine Learning (ML), continuous monitoring across the AI lifecycle is critical to ensure optimal performance, maintain quality, and deliver desired business outcomes. As organiza...Discuss·27 readsAIMonitoring
Indrasenindrasen1872.hashnode.dev·Sep 15, 2024Python Data Wrangling and Data QualityWhat is Data Wrangling and Data Quality and why it's important? Data Wrangling Data Wrangling is the process of transforming raw or received data into a format that can be analyzed to create insights. This involves making decisions about the quality ...DiscussPython 3
MSys Technologiesmsystech.hashnode.dev·Jul 24, 2024Data Observability vs. Data Quality: Understanding the Differences and ImportanceIn today’s data-driven world, businesses heavily rely on data to make informed decisions, optimize operations, and drive growth. However, ensuring the reliability and usability of this data is not straightforward. Two crucial concepts that come into ...DiscussData Observability