Rafal Jackiewiczjackiewicz.hashnode.dev·Oct 7, 2024Building Large Language Models (LLMs) from Scratch: The Role of CUDA and AVXLarge Language Models (LLMs) like GPT, BERT, and their derivatives have gained significant traction in the field of natural language processing. Behind the scenes, these models rely on complex mathematical operations to process data and generate resp...36 readsAVX-512
Coder of the Cellarcoderofthecellar.hashnode.dev·Aug 5, 2024The not-so-obvious parallelism inside CPUsSince the advent of multi-cores x86 CPUs more than 20 years ago, everybody knows that they can do multiple things at once - true multi-tasking instead of the time-slicing trickery - but there are other forms of parallelism that are present, for a lon...61 readscpu
Mustafif Khanmufiz-news.mustafif.com·Mar 3, 2024SIMD in Mufi-LangWhile working on the v0.6.0 Mars Release for MufiZ, I decided to try something way beyond what I'm used to doing and decided to try and figure out how to implement SIMD into Mufi. The Problems So, let's start with the problems. Firstly, our Value str...avx
