Prakhar Srivastavaprakhar1209.hashnode.dev·May 20, 2024DAG in Apache Spark in 10 points🍀Directed Acyclic Graph (DAG): In Apache Spark, the execution plan is represented as a DAG, a directed acyclic graph. It visually outlines the sequence of stages and tasks required to compute the final result. 🍀Logical and Physical Execution Plan...Discussbig data
Sandeep PawarProfabric.guru·Jan 29, 2024Using runMultiple To Orchastrate Notebook Execution in Microsoft FabricUsing runMultiple in MicrosoftFabric notebook isn't new. It was announced, I think, at MS Ignite in November 2023. I tested it and worked beautifully. But the Notebooks team has been quietly adding great features to it and I wanted to show some of th...Parth Lad and 1 other are discussing this2 people are discussing thisDiscuss·3.1K readsmicrosoftfabric
Franklin Obasipythocrypt.hashnode.dev·Feb 20, 2023Creating Data Pipelines as DAGs in Apache Airflow (Part 1)A DAG is a special kind of graph. So, what exactly is a graph? A graph is used to express or illustrate relationships among objects. In more technical terms, graphs are used to describe any set of nodes and the edges (relationships) between the nodes...Discuss·1 like·66 readsapache
Sivaraman Arumugamsivayuvi79.hashnode.dev·Dec 22, 2022Apache Spark - Tutorial 2Spark Submit From Now on we are going to use spark Submit frequently So that we are going to learn the Syntax for Spark Submit first, Once the Spark application build is completed, we use to execute that application via the spark-submit command. spar...Discuss·91 readsApache SparkSpark For Data Science
