Anuj Kumarvandata04.hashnode.dev·Jun 28, 2023Introduction to Big Data and Hadoop (Ecosystem)What is Big data? Big data refers to the large and complex sets of data generated by various sources in today's digital world. Also, any data that can be characterised by the 3 V's is considered to be big data and they are:- Volume: The volume of da...Discuss·2 likes·52 readsBigData
Renjitha Krenjithak.hashnode.dev·Apr 7, 2023Setting up Apache SparkIn this blog, I will be focusing on setting up the workspace for Windows so that we can get started with Apache Spark and do some hands-on in my upcoming series of Apache Kafka. If you haven't taken a look at it and wish to, here is the link https://...Discuss·1 like·86 readsspark
Renjitha Krenjithak.hashnode.dev·Mar 27, 2023Understanding MapReduce: A Beginners GuideMost of us have been hearing the term MapReduce for a long while now, I have been wondering what this term means, Let's try to understand the basics of the same. So, MapReduce is a powerful programming model and software framework for processing larg...Discuss·192 readsBigData
Priyank Patelpriyankpatel.dev·Feb 18, 2023Balancing Performance and Scalability with Elasticsearch Shards and ReplicasDisclaimer The entire article is based on a Stack Overflow response about shards and replicas, and all credit goes to Javanna for providing an outstanding explanation. The explanation is so simple that even if you have no idea what the hell shard an...Discuss·69 readselasticsearch
Natalia Zotkinanataly.hashnode.dev·Feb 2, 2023Personalization at Scale: Using Big Data to Create Tailored ProductsIn the digital age, getting a product or a service tailored exactly for you is no longer a pipe dream. Moreover, an increasing number of modern businesses strive to personalize their offerings to meet the expectations of every client. In this fierce ...Discuss·70 likes·25.8K readsPersonalization
Evan Chanevanchan.hashnode.dev·Jan 16, 2023Windowing Operations in PySpark(Note: this is adapted from my talk at 2021 Scale by the Bay, Location-Based Data Engineering for Good) If you are a data scientist, chances are you are coding Python and most likely using pandas. You might have heard of or are learning Apache Spark,...Discuss·149 readsPython
Uche Okoyeafewfigures.hashnode.dev·Jan 15, 2023Big DataBig data is a term used to describe the massive amount of data that organizations need to process and analyze in order to gain insights and make informed decisions. It can be anything from customer data, financial data, social media, healthcare recor...Discuss·2 likes·29 readsdata
