Apr 7 · 7 min read · Could an AI forget your name mid-conversation? This isn't science fiction; it's a common symptom of an LLM decoding memory bound. This occurs when an AI's ability to generate output is hampered by its capacity to access and process stored information...
Join discussionMar 9 · 15 min read · TLDR: An LLM doesn't "write" text — it generates a probability distribution over all possible next tokens and then uses a decoding strategy to pick one. Greedy, Beam Search, and Sampling are different rules for that choice. Temperature controls the c...
Join discussionFeb 10 · 29 min read · Part 1: Encoding and Decoding What is Encoding? Encoding is the process of converting data from one format to another. It's about representation, not security. Think of it like translation: you're changing the language, but the message is still reada...
Join discussion
Oct 13, 2025 · 6 min read · Building projects isn’t just about shipping the final product. It’s about the journey: the small iterations, the late-night bug fixes, the “aha!” moments when a feature finally clicks. For the Frontend Mentor Weather App Challenge, I wanted to docume...
Join discussion
Oct 12, 2025 · 5 min read · 1. Encoding: Making Data Usable and Compatible What it is: Encoding is the process of converting data from one format into another. Its primary goal is to ensure data can be correctly interpreted, stored, or transmitted across different systems or me...
Join discussion
Sep 2, 2025 · 10 min read · Introduction In LLM text generation, two steps are involved: (1) inference, where the model predicts raw scores called logits (raw score before turning it into a probability), The bigger the logit, the model thinks the token is more likely. But logit...
Join discussion
Aug 16, 2025 · 2 min read · What is a Tokenizer? A tokenizer is a tool that breaks text into smaller pieces called tokens. Tokens can be words, subwords, or characters AI models cannot understand entire sentences directly Tokenizer assigns each token a unique ID so the model...
Join discussion
Apr 26, 2025 · 4 min read · “Your dost and your career ghost” 🤖 Hi, I’m your AI Don’t be afraid of me i am like your personal Doraemon😼,I'm here to help you, just like Doraemon helps Nobita, i am not a job replacer or a automation threat on this planet. My mission is to: “Zin...
Join discussion
