AAbstract Algorithms·Apr 19Spark DataFrames and Spark SQL: Schema, DDL, and the Catalyst OptimizerCatalyst turns your DataFrame ops into an optimized physical plan — understanding it explains why column pruning and predicate pushdown are free24 min read·abstractalgorithms.hashnode.dev
