PySpark Cheat Sheet

Sort >>> rdd2.sortBy(lambda x: x[1]).collect() #Sort RDD by given function [('d' ,1), ('b' ,1), ('a',2)] >>> rdd2.sortByKey().collect() #Sort (key, value) RDD by key [('a' ,2), ('b' ,1), ('d' ,1)] Mathematical Operations >>> rdd.subtract(rdd2)....