May 10 · 10 min read · Originally published on nvarma.com I've been missing a couple of weekends now as I was working towards this post, but life gets busy. This was a fun experiment and a lot of learning. The age of abundance Elon Musk has been predicting an age of abund...
Join discussionMay 6 · 6 min read · match keys between two tables and boom, you get results. That mindset worked fine in SQL databases. Then I started working with Spark on large datasets and my jobs started failing, timing out, or grinding for hours. The reality: Spark join performanc...
Join discussionMay 6 · 4 min read · s one thing I've noticed: most Spark pipelines waste 30-60% of their compute time reading data they don't need or shuffling data that could have been pre-organized. During my recent deep-dive, I spent 8 hours learning two important optimization techn...
Join discussionMay 4 · 5 min read · I saw a SharePoint MVP's post recently. Genuine excitement. Markdown support had landed in SharePoint. Not a joke — real, earned enthusiasm from someone who knows their domain inside out. And I get it. In the SharePoint world, that's real progress. I...
Join discussionApr 27 · 2 min read · Supply Chain Automation is at the forefront of technology evolution, dramatically altering how businesses manage and streamline their operations. This article provides an in-depth look at the architecture and technologies that power effective supply ...
Join discussion