Rajat Srivastavaalgowithrajat.hashnode.dev·Oct 10, 2024Hadoop FrameworkIntroduction What is Hadoop ? With the rise of Big Data, there was need of some sort of framework was required to manage it. Hadoop was, one such, framework which was created by Doug Cutting and Mike Cafarella in 2005. Hadoop was developed to solve...Hadoop framework
xiaohanxiaohan.hashnode.dev·Jul 21, 2024Hdfs如何退出安全模式在使用hdfs时出现Name node is in safe mode.问题， 说明hdfs处于安全模式。 执行如下命令即可退出安全模式。 hadoop dfsadmin -safemode leave 来自 https://www.cnblogs.com/yaoss/p/12555745.htmlhdfs
xiaohanxiaohan.hashnode.dev·Jul 21, 2024如何在两个hdfs集群之间拷贝数据在不同的两个HDFS集群中拷贝数据，我们可以使用distcp命令，集群之间拷贝数据的正确姿势是： hadoop distcp hdfs://master1:9999/foo/bar hdfs://master2:9999/bar/foo 上面的意思是将集群master1上的文件foo/bar拷贝到master2集群上的bar/foo目录下 hadoop distcp hdfs://master1:9999/foo/a hdfs://master1:9999/foo/b hdfs://maste...hdfs
Temiloluwa Oloyetemiloluwaoloye.hashnode.dev·Jun 18, 2024Processing and Visualizing Historical Disaster Events with HDFS, Apache Hive, and HueIntroduction One of the important skills of a Data Scientist is the ability to uncover insights from a large amount of data. In this guide, we will walk through the process of processing and visualizing historical disaster events using HDFS, Apache H...10 likes·30 readshdfs
Sandeepa Bandara Thennakoonosga.hashnode.dev·Jun 6, 2024What is Hadoop ?🤔If You Interested In Big Data analytic Field You Definitely Know This Framework ! Ok Let's See What is Hadoop & How It Works With Big Data analytic Hadoop is an open-source framework that allows for the distributed processing of large data sets acros...18 likesbig data analytics
Vishesh Raghuvanshivisheshraghuvanshi.hashnode.dev·May 24, 2024Cloud Computing - 3Data in the Cloud Data in the cloud refers to storing, managing, and accessing data over the internet through cloud computing platforms. Cloud computing offers a flexible, scalable, and cost-effective solution for handling data, reducing the need for...6 likes·61 readsdynamo
Mark williamstechcapital.hashnode.dev·May 15, 2024HDFS: Taming the Big Data Beast - A Beginner's GuideYo #DataNewbs! Ever wondered how companies handle mountains of data? We're talking social media posts, website clicks, basically everything digital! The answer lies in a powerful tool called HDFS, which stands for Hadoop Distributed File System. Thin...hdfs
Pratyushatechnodiary.hashnode.dev·Dec 9, 2023Unlocking the Basics: Key Concepts and Practical Applications - Part IIIWeek1 - Continuation Article Outline.: HDFS Architecture - Basic Overview Week1 Summary HDFS Architecture - Basic Overview: HDFS, short for Hadoop Distributed File System, caters to applications dealing with large datasets, ranging from gigabyte...Cloud Focused Big Data Serieshdfs commands
samyak jaindataskills.hashnode.dev·Oct 11, 2023Apache Hadoop - Getting Started (Understanding the Basics)Hadoop is an open-source software framework used for storing and processing Big Data in a distributed manner on large clusters of commodity hardware. Hadoop is licensed under the Apache v2 license. Hadoop was developed, based on the paper written by...Big Datahadoop
AATISH SINGHaatishintodata.hashnode.dev·Aug 3, 2023Hadoop Namenode Failure ManagementLet's #hadoop 📌 Some insights on Namenode failure management in Hadoop 📢 ✔ Managing NameNode failures in Hadoop is crucial to ensure high availability and fault tolerance in the Hadoop Distributed File System (HDFS). ✔ The NameNode is a critical co...1 like·104 readshadoop
