Yyadavlakshyageetinlakshyajourney.hashnode.dev·Jun 18 · 2 min readDay 14 — A Chill Day, Assignment Progress, and Back to BuildingToday was one of those rare chill Thursdays. No classes. No work. Just had a mate come over, relaxed a bit, and enjoyed having a slower day for once. Not every day has to be a grind-fest. That said, I00
TCTencent Cloud -Cloud Log Serviceintencentcloud-cls.hashnode.dev·Jun 15 · 5 min readDeliver CLS Logs to Tencent Cloud DLC for Spark-Based AnalysisLog platforms often start with search and alerting, then grow into data processing and analytics workflows. Tencent Cloud Log Service (CLS) already supports delivery to Ckafka and COS. The source work00
APAishwarya Patankarinaishwaryapatankar.hashnode.dev·May 11 · 6 min readWhy Payment Systems Break — And How Kafka & Spark Prevent ItEvery day, banks process millions of payments. Most people think the hard part is moving money. It’s not. The hard part is making sure nothing breaks when you're processing 500,000 payments simultaneo10
RLRisingWave Labsinrisingwave.com·Apr 2 · 14 min readRisingWave vs Spark Structured Streaming for Real-Time AnalyticsThe Streaming Decision That Shapes Your Stack Your team needs real-time analytics. Dashboards that update in seconds, not hours. Fraud scores computed before transactions settle. Inventory counts that reflect what is happening on the warehouse floor ...00
SRShahida R. Khaninmodern-data.hashnode.dev·Mar 16 · 9 min readSpark: From Code to Chaos (to Organized Chaos) - A Data OdysseyImagine this: You have a colossal mountain of data. It's so massive, it's basically its own mountain range. And you need to find one tiny, specific diamond hidden somewhere in there. You try to use yo00
ÖOÖmer Oruç ÇELİKinoorucelik.hashnode.dev·Mar 6 · 9 min readFrom 3,600 to 400 API Calls: Optimizing PySpark on AWS Glue with the Yield PatternStack: AWS Glue · PySpark · Step Functions · APIs · Power BI Welcome to my very first technical blog post, I'm Omer and I love many things in life, but for now, you will know only two of them: detail00
BDBiju Devassyinbijudevassy.hashnode.dev·Feb 22 · 5 min readCaching vs Persistence in Spark (PySpark)Introduction Apache Spark is built on lazy evaluation. Transformations such as select, filter, join, and groupBy do not execute immediately. Instead, Spark builds a logical plan (DAG) and executes it 00
DSDishant Sharmaindishantsharma.hashnode.dev·Feb 15 · 6 min readCodex Spark vs Codex 5.3 vs Claude: Which AI Coding Tool Wins?A developer on X posted last week that Codex Spark generated a full SpriteKit game in 20 minutes. He called it "INSANELY FAST". Same day, another engineer warned the model "trades brains for speed". Both were right. OpenAI dropped GPT-5.3-Codex-Spark...00
BDBiju Devassyinbijudevassy.hashnode.dev·Feb 12 · 3 min readBroadcast Join vs Sort Merge Join vs Shuffle Hash Join in Apache SparkWhen working with large-scale data in Apache Spark, understanding join strategies is critical for performance tuning. Spark does not always execute joins the same way. Depending on dataset size and co00
TITech Insights Hubintopperblog.hashnode.dev·Feb 12 · 10 min readSpark Streaming: Real-Time ProcessingApache Spark Streaming: Real-Time Processing Guide for Modern Data Platforms Real-time data processing has become non-negotiable for modern enterprises. When your fraud detection system takes 30 seconds to flag a suspicious transaction, you've alread...00
