@retzam

BERT, Dense Passage Retrieval, and how RAG was invented

6d ago · 6 min read · Hello 👽, Welcome to another mid-series special 🎉. I know I said we're done with BERT, but this is truly insightful 🤗, enjoy. While pretraining and fine-tuning the BERT (Bidirectional Encoder Repres

Code: 20 Million Parameter BERT Model For SQuAD Tasks

Mar 23 · 7 min read · Hello 👽, Finally, we'll pretrain and finetune a BERT (Bidirectional Encoder Representations from Transformers) model from scratch in this chapter, brace up 🦾 Before we proceed, I want to believe you

The Distillation Dilemma: Anthropic, OpenAI, and the Security Predicament for Frontier AI Labs

Mar 9 · 6 min read · Hello 👽, This is going to be maybe the first back-to-back mid-series special, enjoy it while it lasts 😁. Let's do what we've come here to do 🕶️ A few weeks ago, Anthropic made a post on Twitter (I

Research: The Best AI Agents Failed at 96% of Jobs

Mar 2 · 6 min read · Hello 🤖, Welcome to another Mid-Series Special 👻 The International AI Safety Report 2026, released on February 3, 2026, contained a new study that found AI failed in 96% of jobs. The study itself, h

BERT in its Elements

Feb 23 · 8 min read · Hello 👽, I know, still on BERT, right? 😀. Well, it’s a lot to learn, and it’s worth it, no shortcuts 🦾. We learned about General Language Pre-training and a little about the architecture of BERT. W