VUVijay Uradeinshuffleandsort.hashnode.dev·Feb 24, 2023 · 2 min readHadoop Single node cluster quick setupInstalling Javaa. apt-get update.b. apt-get install openjdk-8-jre.c. apt-get install openjdk-8-jdk. Installing ssh (Secure Shell)a. sudo apt-get -y install openssh-serverb. ssh-keygen -t rsac. cd .ssh <press enter>d. cp id_rsa.pub authorized_keyse. s...01A
VUVijay Uradeinshuffleandsort.hashnode.dev·Feb 24, 2023 · 2 min readDataset repartition in Apache SparkAs we know, Apache Spark is one of the fastest big data computational frameworks and it gives the best performance if the data is distributed evenly across nodes or executors. But, we cannot guarantee the partitions in intermittent stages of applicat...00
