PMPere Miquel Brullinblog.getcollate.io·4h ago · 14 min readToken Efficiency in Production: Lessons from a Multi-Agent PlatformIn Why We Built a Native Agentic Harness for Data, our CTO and co-founder, Harsha Chintalapani made the case that the model is only one component of an agent. Around it sits a harness that manages con00
MEMiller Eliasineliasmiller.hashnode.dev·4h ago · 8 min readThe Engineering Reality of JSON to CSV Conversion: Dimensionality Reduction, RFC 4180, and Formula InjectionExporting data from an API response (JSON) into a spreadsheet-compatible format (CSV) is one of the most common requirements in software engineering. Many developers view it as a trivial string concat00
RRRahul Rinrahul-dataeng.hashnode.dev·5h ago · 12 min readStop Reprocessing Everything: Build Incremental Data Pipelines on AWSHow to use AWS Glue, Amazon S3, and PySpark to process only new and changed data without making your pipeline fragile. Imagine you have a data pipeline that processes 100 GB of data every morning. The00
Aareebakhizer7inareebakhizer.hashnode.dev·11h ago · 8 min readPart 4 - The Daily Report and What the Data Told MeThe ETL pipeline runs nightly and by 1am, yesterday's sensor data is sitting in clean Parquet files in S3. But a queryable dataset isn't useful unless something actually queries it. This post covers t00
TPTech prathamintechskills.hashnode.dev·9h ago · 7 min readHow Modern Data Systems Work: From Source Data to Production PipelinesA modern application does not operate on code alone. Behind its interface, many systems generate events, store transactions, update customer records, and send information to other services. Engineerin00
YVYenosh Vinyenosh.hashnode.dev·9h ago · 9 min readBeyond the Dashboard: Modern Data Engineering Strategies for Executive IntelligenceIntroduction: Why Executive Dashboards Need an Engineering-First Approach Executive dashboards have become essential tools for organizations that need to make informed decisions quickly. CEOs, CFOs, C00
PTPlace to Beinplacetobe.hashnode.dev·19h ago · 11 min readWhy Ticketmaster's API shows 32 events in FranceOne query parameter decides whether Ticketmaster's API sees Europe. Ask the Ticketmaster Discovery API for upcoming events in France and it returns 32. Add locale=* and it returns at least 57,764. Pla00
SSiontinsiont-dev.hashnode.dev·1d ago · 9 min readFour ways I tried to ingest data for my League of Legends hobby projectIntro Hello there! My name is Rinat, I'm a senior full stack developer and I'm developing professionally and for fun for more than 11 years now. This spring I started my hobby project Riftmind - a web10
BB2BChatinb2bchat.hashnode.dev·1d ago · 6 min readArchitecting Data Ownership in Distributed Messaging SystemsThe Architecture of Data Ownership in Distributed Messaging In many organizations, the reliance on third-party messaging platforms for professional communication creates a silent, systemic risk. When 00
WWaLookupinwalookup.hashnode.dev·1d ago · 5 min readProgrammatic Identification of Account Types in Messaging MetadataIn modern B2B lead enrichment pipelines, the ability to distinguish between individual and commercial messaging accounts is a fundamental data-cleansing requirement. When building CRM integration laye00
