ASAdi Shikinopeningthehood.hashnode.dev·4d ago · 10 min readThe Inside of a Model - Part D: TransformersPreviously, we talked about MLPs, how models learn, and why raw MLPs, CNNs, and RNNs eventually led us here. This post is about the architecture that changed modern AI more than any other architecture00
ASAdi Shikinopeningthehood.hashnode.dev·Aug 6 · 13 min readThe Inside of a Model - Part C: Why MLPs Were Not EnoughUp until now, we talked about MLPs, how they process vectors, and how they learn using backpropagation. We saw that a neural network can take an input vector, pass it through layers, calculate a loss,00
ASAdi Shikinopeningthehood.hashnode.dev·Jul 29 · 11 min readThe Inside of a Model - Part B: How a Model LearnsIn this post, we finally get to the question that makes neural networks feel almost magical: how does a model actually “learn”? Small recap from the last post: we talked about MLPs and how they proces00
ASAdi Shikinopeningthehood.hashnode.dev·Jul 20 · 9 min readInside the Model, Part I: From Vector to PredictionWe all heard about neural networks. The idea sounds exciting: make a machine that thinks like a human. I hate to be the one to break it down, but neural networks do not really “think” like humans. At 00
ASAdi Shikinopeningthehood.hashnode.dev·Jul 13 · 11 min readWhen the Embedding Is Wrong, Everything After It Is WrongIn the last post, I wrote about fine-tuning and why I think the next wave of applied AI will be about moving from using models to shaping them. This time, I want to go one level deeper into a real use00
