20 essential PySpark operationsTable Of Contents: Setting Up PySpark Loading data Basic operations Column operations Row operations Aggregate functions Window functions Joins Performance Optimisation Best Practices and Tips Conclusion References As a Machine Learning...8 min read路tanupriya.comMar 27, 2025
Demystifying Setup.py: The Blueprint Behind Python Packages 馃摝Ever wondered what makes 'pip install' work? Let's break down the mechanics behind setup.py 馃摝 At its core, setup.py is a Python script that defines your package's identity card. It contains essential metadata about your package - from its name and v...1 min read路tanupriya.comJan 5, 2025
A Beginner's Guide to Spark: Insights from an MLEIntroduction to Spark Spark is a distributed computing system designed for large-scale data processing. Here are key reasons why Spark is suitable for ML pipelines: High Volume of Data: Many ML problems require processing large datasets, which mig...3 min read路tanupriya.comDec 9, 2024
Notes from Andrej Karpathy's 1-Hour Lecture on LLMsBefore we begin, a short excerpt from the book The Defining Decade: The right time to take action is at the sweet spot鈥攚aiting too long or acting too early can lead to missed opportunities. Echoing this idea, I decided to learn about the Generative A...4 min read路tanupriya.comOct 21, 2024
My Journey as a Machine Learning EngineerMachine learning engineer, Guide, ML7 min read路tanupriya.comJul 14, 2023