haroune hassineiaaroun.hashnode.dev·Dec 23, 2024A Guide to Setting Up Nvidia Driver and Cuda Toolkit On Ubuntu (20.04)Overview Training deep learning models is very costing task in terms of the required amount of calculations, specifically matrix operations, that need to be done to update the model’s trainable parameters. Using CPU to train deep learning models is n...NVIDIA
OM SHINTREforCompilers for Parallel Machinesintroduction-to-parallel-machines.hashnode.dev·Nov 28, 2024Compilers for Parallel Machines: A Beginner's GuideIntroduction to Parallel Machines: In today’s digital era, parallel computing has revolutionized the way machines process data. By dividing tasks into smaller subtasks that run simultaneously, parallel computing contrasts with the step-by-step approa...40 likesparallel machines
Rafal Jackiewiczjackiewicz.hashnode.dev·Oct 7, 2024Building Large Language Models (LLMs) from Scratch: The Role of CUDA and AVXLarge Language Models (LLMs) like GPT, BERT, and their derivatives have gained significant traction in the field of natural language processing. Behind the scenes, these models rely on complex mathematical operations to process data and generate resp...54 readsAVX-512
Likesh Klikesh27.hashnode.dev·Jun 17, 2024Serial vs Parallel: A Comparative Study in Computing Efficiency using Machine Learning algorithms.In the exploration of computing efficiency, the comparison between serial and parallel processing stands as a pivotal discussion point. This blog delves into the core differences, advantages, and applications of each approach, aiming to shed light on...10 likes#parallel computing
Garvit Singhgarvit05.hashnode.dev·Nov 29, 2023Basics Of Parallel ComputingIntroduction This article is a part of my series on System Design topics. In this article, I have explained the fundamental concepts behind parallel computing, the hardware architectures and the approaches adopted for parallel systems. What is Paral...21 likes·36 reads#parallel computing
Pronod Bharatiyadata-intelligence.hashnode.dev·Apr 28, 2023Cache Mapping - The BasicsIntroduction Cache mapping is the process of determining how cache memory is used to store data from the main memory. It determines which memory addresses in the main memory are mapped to which locations in the cache memory. In this article first I w...76 readscache
Renjitha Krenjithak.hashnode.dev·Mar 27, 2023Understanding MapReduce: A Beginners GuideMost of us have been hearing the term MapReduce for a long while now, I have been wondering what this term means, Let's try to understand the basics of the same. So, MapReduce is a powerful programming model and software framework for processing larg...187 readsBigData
Rishabh Bassirishabhbassi.hashnode.dev·Feb 26, 2023Introduction to Parallel Computing -MPI and C++ Blog SeriesIn the Previous Blog, we already highlighted various factors on the basis of which we should decide what technique to use. In this series of blog posts, we will explore the basics of parallel computing using MPI and C++. We will start by understandin...1 like·33 readsMPI
Rishabh Bassirishabhbassi.hashnode.dev·Feb 19, 2023Parallel Computing Decision FactorsParallel computing is the use of multiple processors or computers to solve a computational problem simultaneously. The technique has become increasingly popular as a means of accelerating the performance of computationally intensive tasks, such as si...1 like#parallel computing
Rituraj Buddhisagarrituraj.hashnode.dev·Dec 27, 2022Container Orchestrators and Parallel Computing"Technology is the answer, but what was the question?" Find it interesting that this quote of Cedric Price is relatable to many situations in technological problem-solving. Years ago was part of solutioning on Grid computing using OpenMosix and SunGr...containers
