---
title: "#sparksql articles | Hashnode"
description: "Explore 27 articles tagged #sparksql on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/sparksql"
---

Tag

# #sparksql

27 posts · 68 followers

[Sai Dinesh Konda](https://hashnode.com/@LearningDataEngineer) · [Jan 24](https://hashnode.com/posts/from-software-testing-to-data-engineering-my-learning-journey/6974b3c2938cc57db4ab7a26)

### [From Software Testing to Data Engineering: My Learning Journey](https://learningdataengineering.hashnode.dev/from-software-testing-to-data-engineering-my-learning-journey?utm_source=hashnode&utm_medium=feed)

Documenting my transition into Data Engineering

3 min read · [learningdataengineering.hashnode.dev](https://learningdataengineering.hashnode.dev/from-software-testing-to-data-engineering-my-learning-journey?utm_source=hashnode&utm_medium=feed)

[Deepankar Yadav](https://hashnode.com/@BytesOfDeepankar) · [Dec 22, 2025](https://hashnode.com/posts/postmortem-of-spark-executors-death/694897c71262d7c8b9f5a0bc)

### [Postmortem of Spark Executor's death](https://bytesofdeepankar.hashnode.dev/postmortem-of-spark-executors-death?utm_source=hashnode&utm_medium=feed)

Understanding executor-local shuffle ownership in Apache Spark

4 min read · [bytesofdeepankar.hashnode.dev](https://bytesofdeepankar.hashnode.dev/postmortem-of-spark-executors-death?utm_source=hashnode&utm_medium=feed)

[Abhishek Kumar](https://hashnode.com/@abhi1213) · [Nov 1, 2025](https://hashnode.com/posts/learning-pyspark-with-databricks/69061208c1f21c42c4d938b5)

### [Learning PySpark with Databricks](https://abhi1213.hashnode.dev/learning-pyspark-with-databricks?utm_source=hashnode&utm_medium=feed)

A Beginner-Friendly Guide to PySpark

37 min read · [abhi1213.hashnode.dev](https://abhi1213.hashnode.dev/learning-pyspark-with-databricks?utm_source=hashnode&utm_medium=feed)

[Jidhun Puthuppattu](https://hashnode.com/@Jidhun) · [Aug 29, 2025](https://hashnode.com/posts/data-integration-and-transformation-tools-a-comprehensive-exploration/68b1ab79a5cc3888e3c37ddd)

### [Data Integration and Transformation Tools: A Comprehensive Exploration](https://jidhun.hashnode.dev/data-integration-and-transformation-tools-a-comprehensive-exploration?utm_source=hashnode&utm_medium=feed)

Explore key data tools—Spark SQL, Airflow, Kafka—for scalable analytics and machine learning

4 min read · [jidhun.hashnode.dev](https://jidhun.hashnode.dev/data-integration-and-transformation-tools-a-comprehensive-exploration?utm_source=hashnode&utm_medium=feed)

[Islam Elbanna](https://hashnode.com/@ielbanna) · [May 17, 2025](https://hashnode.com/posts/mastering-apache-spark-sql-create-complex-queries-with-common-table-expressions-cte-with-clause/68287a7489cc91984e9efb1d)

### [Mastering Apache Spark SQL: Create Complex Queries with Common Table Expressions CTE (WITH Clause)](https://practical-software.com/mastering-apache-spark-sql-create-complex-queries-with-common-table-expressions-cte-with-clause?utm_source=hashnode&utm_medium=feed)

Enhance Apache Spark SQL queries with CTEs for improved readability, performance, and reusability in large-scale data processing

5 min read · [practical-software.com](https://practical-software.com/mastering-apache-spark-sql-create-complex-queries-with-common-table-expressions-cte-with-clause?utm_source=hashnode&utm_medium=feed)

[Muhammad Atif Hafeez](https://hashnode.com/@matifhafeez) · [Feb 21, 2025](https://hashnode.com/posts/implementing-scd-type-2-using-spark-sql-and-delta-tables/67b83c0e7da9d6f689b7d91a)

### [Implementing SCD Type 2 Using Spark SQL and Delta Tables](https://databrickssparksqlscdtype2.hashnode.dev/implementing-scd-type-2-using-spark-sql-and-delta-tables?utm_source=hashnode&utm_medium=feed)

In this blog, I will walk you through a straightforward approach to implementing Slowly Changing Dimension (SCD) Type 2 using Spark SQL and Delta Tables. This method ensures atomicity and maintains the history of records effectively. Introduction to ...

5 min read · [databrickssparksqlscdtype2.hashnode.dev](https://databrickssparksqlscdtype2.hashnode.dev/implementing-scd-type-2-using-spark-sql-and-delta-tables?utm_source=hashnode&utm_medium=feed)

[Shreyash Bante](https://hashnode.com/@Shreyash27) · [Aug 22, 2024](https://hashnode.com/posts/apache-spark-architecture/66c6dca3f52af59674e719d3)

### [Apache Spark Architecture](https://bigdatageek.dev/apache-spark-architecture?utm_source=hashnode&utm_medium=feed)

We are talking about spark architecture and how code is executed

4 min read · [bigdatageek.dev](https://bigdatageek.dev/apache-spark-architecture?utm_source=hashnode&utm_medium=feed)

[Kumar Rohit](https://hashnode.com/@krohit-de) · [Aug 15, 2024](https://hashnode.com/posts/hello-spark-on-minikube/66bd5b5bbfa937f877c8430e)

### [Hello Spark on Minikube](https://krohit-de.hashnode.dev/hello-spark-on-minikube?utm_source=hashnode&utm_medium=feed)

Spark, Kubernetes, docker, k8s, minikube, kubernetes, k3s, docker-image, etl, spark-etl, data, data-engineering, data-platforms, containers, image

13 min read · [krohit-de.hashnode.dev](https://krohit-de.hashnode.dev/hello-spark-on-minikube?utm_source=hashnode&utm_medium=feed)

[Mehul Kansal](https://hashnode.com/@mehulkansal) · [Aug 12, 2024](https://hashnode.com/posts/week-12-mastering-hive/66b9c7408698f8b351ec8b32)

### [Week 12: Mastering Hive 📈](https://mehulkansal.hashnode.dev/week-12-mastering-hive?utm_source=hashnode&utm_medium=feed)

Hey fellow data engineers! 👋 This week's blog explores the architecture of Hive, offering insights into its components like data storage and metadata management. It also covers the different types of tables Hive supports, essential optimizations for...

7 min read · [mehulkansal.hashnode.dev](https://mehulkansal.hashnode.dev/week-12-mastering-hive?utm_source=hashnode&utm_medium=feed)

[Turboline LTD](https://hashnode.com/@turboline) · [Jul 10, 2024](https://hashnode.com/posts/data-transformation-using-mistral-and-google-gemini/668eddd931241f57a36a4b33)

### [AI-Based Data Transformation: A Comparison of LLM-Generated PySpark Code (Using Mistral & Google Gemini Advanced)](https://blog.turboline.ai/data-transformation-using-mistral-and-google-gemini?utm_source=hashnode&utm_medium=feed)

Mistral Le Chat Mistral's Le Chat didn't have the functionality to upload CSV files, so I couldn't generate a transformation code. I could have built a lightweight ingestion process using Mistral API and Langchain. However, that was out of scope for ...

4 min read · [blog.turboline.ai](https://blog.turboline.ai/data-transformation-using-mistral-and-google-gemini?utm_source=hashnode&utm_medium=feed)
