PySpark UDFs, Spark-NLP, and scrapping unstructured text data on spark clusters — a complete ETL pipeline for BigData architectureText data on spark clusters. Creating UDF in spark. HTML files in spark clusters.5 min read·yogender.hashnode.devApr 12, 2022