Processing Multi Char Delimiter Dataset using PySpark
In this blog, we will learn how to process multiple delimited files using PySpark.
input.txt
id@@#name@@#experience
1@|#Naveen,Pn@|#11
2@|#Abdullah Madani@|#12
3@|#Vicken,Abajian@|#12
Approach - 01
Now let's create a DataFrame
df = spark.read.csv(pa...
blog.naveenpn.com1 min read