---
title: "Discussion on \"PySpark UDFs, Spark-NLP, and scrapping unstructured text data on spark clusters — a complete ETL pipeline for BigData architecture\" | Hashnode"
description: "Discussion on \"PySpark UDFs, Spark-NLP, and scrapping unstructured text data on spark clusters — a complete ETL pipeline for BigData architecture\". Text data on spark clusters.  Creating UDF in spark. HTML files in spark clusters."
url: "https://hashnode.com/posts/pyspark-udfs-spark-nlp-and-scrapping-unstructured-text-data-on-spark-clusters-a-complete-etl-pipeline-for-bigdata-architecture/6255ac256386ed96b050d114"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [PySpark UDFs, Spark-NLP, and scrapping unstructured text data on spark clusters — a complete ETL pipeline for BigData architecture](https://yogender.hashnode.dev/pyspark-udfs-spark-nlp-and-scrapping-unstructured-text-data-on-spark-clusters-a-complete-etl-pipeline-for-bigdata-architecture?utm_source=hashnode&utm_medium=feed)

Text data on spark clusters. Creating UDF in spark. HTML files in spark clusters.

Apr 12, 2022 · 5 min read · yogender.hashnode.dev  
Updated Jul 3, 2022  
Read the article

-   [#spark](https://hashnode.com/tag/spark)
-   [#python](https://hashnode.com/tag/python)
-   [#nlp](https://hashnode.com/tag/nlp)
-   [#big-data](https://hashnode.com/tag/big-data)

## Written by

[Yogender Pal](https://hashnode.com/@yogender)

@yogender

  
[View profile](https://hashnode.com/@yogender)

code tweaker

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
