Rafal Jackiewiczjackiewicz.hashnode.dev·Oct 7, 2024Building Large Language Models (LLMs) from Scratch: The Role of CUDA and AVXLarge Language Models (LLMs) like GPT, BERT, and their derivatives have gained significant traction in the field of natural language processing. Behind the scenes, these models rely on complex mathematical operations to process data and generate resp...DiscussAVX-512
Likesh Klikesh27.hashnode.dev·Jun 17, 2024Serial vs Parallel: A Comparative Study in Computing Efficiency using Machine Learning algorithms.In the exploration of computing efficiency, the comparison between serial and parallel processing stands as a pivotal discussion point. This blog delves into the core differences, advantages, and applications of each approach, aiming to shed light on...Discuss·10 likes#parallel computing
Garvit Singhgarvit05.hashnode.dev·Nov 29, 2023Basics Of Parallel ComputingIntroduction This article is a part of my series on System Design topics. In this article, I have explained the fundamental concepts behind parallel computing, the hardware architectures and the approaches adopted for parallel systems. What is Paral...Discuss·21 likes·36 reads#parallel computing
Krishna N Mehtakrishnanmehta.hashnode.dev·Sep 10, 2023Into Parallel Architectures - Part 1In the realm of parallel computing, Amdahl's Law stands as a guiding principle, reminding us that even with an infinite number of processors, certain portions of a program remain stubbornly sequential. As we journey deeper into the intricacies of par...Discussparallelism
Krishna N Mehtakrishnanmehta.hashnode.dev·Aug 31, 2023Parallel Programming Paradigms - Part 2Welcome back to our exploration of parallel programming paradigms. In our previous articles, we delved into shared memory architecture and its intricacies. Now, let's continue by learning distributed memory systems and delve into some key concepts th...Discussparallelism
Pronod Bharatiyadata-intelligence.hashnode.dev·Apr 28, 2023Cache Mapping - The BasicsIntroduction Cache mapping is the process of determining how cache memory is used to store data from the main memory. It determines which memory addresses in the main memory are mapped to which locations in the cache memory. In this article first I w...Discuss·68 readscache
Renjitha Krenjithak.hashnode.dev·Mar 27, 2023Understanding MapReduce: A Beginners GuideMost of us have been hearing the term MapReduce for a long while now, I have been wondering what this term means, Let's try to understand the basics of the same. So, MapReduce is a powerful programming model and software framework for processing larg...Discuss·187 readsBigData
Rishabh Bassirishabhbassi.hashnode.dev·Feb 26, 2023Introduction to Parallel Computing -MPI and C++ Blog SeriesIn the Previous Blog, we already highlighted various factors on the basis of which we should decide what technique to use. In this series of blog posts, we will explore the basics of parallel computing using MPI and C++. We will start by understandin...Discuss·1 like·32 readsMPI
Rishabh Bassirishabhbassi.hashnode.dev·Feb 19, 2023Parallel Computing Decision FactorsParallel computing is the use of multiple processors or computers to solve a computational problem simultaneously. The technique has become increasingly popular as a means of accelerating the performance of computationally intensive tasks, such as si...Discuss·1 like#parallel computing
Rituraj Buddhisagarrituraj.hashnode.dev·Dec 27, 2022Container Orchestrators and Parallel Computing"Technology is the answer, but what was the question?" Find it interesting that this quote of Cedric Price is relatable to many situations in technological problem-solving. Years ago was part of solutioning on Grid computing using OpenMosix and SunGr...Discusscontainers
