© 2023 Hashnode
#hadoop
Installing Javaa. apt-get update.b. apt-get install openjdk-8-jre.c. apt-get install openjdk-8-jdk. Installing ssh (Secure Shell)a. sudo apt-get -y install openssh-serverb. ssh-keygen -t rsac. cd .ssh…
Introduction to the Big Data Big data refers to the large and complex sets of data generated by various sources in today's digital world. With the rise of connected devices and the internet, the amoun…
Introduction to Big Data and Hadoop: Note: These are just study materials I made for myself for career development when I was learning BigData. Overview: Understand the concepts of Big Data. Explain…
Big data is a term used to describe the massive amount of data that organizations need to process and analyze in order to gain insights and make informed decisions. It can be anything from customer da…
What Is A Transactional Database? Transactional data is information captured from day-to-day business activities such as sales, discounts, payment methods, supplier purchase orders, customer support r…
Sometimes in a spark application, we need to share small data across all the machines for processing. For example, if you want to filter some set of words from a large dataset residing in a datalake. Or if we simply just want to know how ma…
What is MapReduce? MapReduce is a software framework for processing large data sets that are distributed over several machines. MapReduce facilitates concurrent processing by splitting petabytes of da…
Hadoop Distributed File System(HDFS) is the world’s most reliable storage system. It is best known for its fault tolerance and high availability. What is Hadoop HDFS? HDFS stores very large files runn…
We cannot use an analytical storage system for transactional requirements and vice versa. But have you ever wondered why is that so? Transactional vs Analytical storage system Transactional storage (e…
Data ingestion is one of the crucial steps in the data lifecycle and when the source is a relational database, Sqoop can be a very easy and simple tool for this. What is Sqoop? Sqoop is a general tool…
