Feb 12 · 2 min read · Apache Kafka Streaming: Real-Time Data Pipelines The System Crash That Taught Me About Queues Black Friday. Our servers melted. Then we discovered message queues. Everything changed. Table of Contents Async Architecture 2026 Core Concepts 5 Key Patt...
Join discussionFeb 4 · 1 min read · This article addresses the crisis of trust in human intuition in the face of the Big Data revolution. Modern humans, who base their decisions on subjective experience, face the challenge posed by "digital truth serum." The analysis of massive data se...
Join discussionFeb 4 · 1 min read · This text provides a profound analysis of mathematics not only as a computational tool, but above all as a medium shaping social relations and technological development. The author traces the evolution from the Indo-Arabic system, treated as a key ep...
Join discussionFeb 3 · 1 min read · This article examines the phenomenon of dataism—a contemporary movement that replaces traditional introspection and humanistic reason with the analysis of large data sets. Drawing on the work of Seth Stephens-Davidowitz and Yuval Noah Harari, the aut...
Join discussionFeb 2 · 1 min read · This article provides a profound analysis of contemporary capitalism through the lens of George Akerlof and Robert Shiller's concept of phishing. The text deconstructs market mechanisms that, instead of striving for Pareto optimality, systematically ...
Join discussionDec 19, 2025 · 11 min read · Stop treating FinOps as a labeling exercise. Here’s how to build query-level cost attribution for Spark, Trino, and Hive The Slack message came at 2 AM: “Did someone just blow our entire monthly Spark budget over the weekend?” By morning, you’re star...
Join discussionJul 26, 2024 · 4 min read · Data science is a transformative field that extracts valuable insights from raw data. Understanding the data science life cycle is crucial for anyone looking to leverage data effectively, whether in business, research, or other domains. This article ...
Join discussion
Feb 11, 2024 · 9 min read · Hi, welcome to the event! Amazon EMR is like the Rockstar of cloud big data. Picture this: petabyte-scale data parties, interactive analytics shindigs, and even machine learning raves—all happening with cool open-source crews like Apache Spark, Apach...
Join discussion
Jan 14, 2024 · 3 min read · Parquet, a columnar storage file format, is efficient for large-scale data processing. Handling Parquet files in Go allows efficient data storage and retrieval. This guide covers the essentials of working with Parquet files in Go, including reading, ...
RRaghuram commented
Jun 28, 2023 · 4 min read · What is Big data? Big data refers to the large and complex sets of data generated by various sources in today's digital world. Also, any data that can be characterised by the 3 V's is considered to be big data and they are:- Volume: The volume of da...
AAjaydeep commented