ITIshan Tripathiinish4n10.hashnode.dev·Mar 8 · 6 min readImplementing GPT Architecture From Scratch: Training and OutputThis is a follow-up of my previous post "Implementing GPT Architecture From Scratch: A Deep Dive into Transformers and Attention" This will be a very short post explaining how i trained the untrained00
ITIshan Tripathiinish4n10.hashnode.dev·Mar 6 · 13 min readImplementing GPT Architecture From Scratch: A Deep Dive into Transformers and AttentionI highly recommend to have a knowledge of machine learning models or atleast the basics The Core Idea: Transformers Before transformers, the industry relied on RNNs and LSTMs. The paper "Attention 00
ITIshan Tripathiinish4n10.hashnode.dev·Apr 13, 2025 · 9 min readAn SMT solver from scratch - Part 2: SMT Theories and LogicsI have covered the basics of a SAT solver and their working mechanism in detail in the first part, in this part I'll try to delve deep-inside SMT theory and how they function being built on-top of a SAT solver. Table of Contents Basic Terminologies ...00
ITIshan Tripathiinish4n10.hashnode.dev·Apr 6, 2025 · 6 min readAn SMT solver from scratch - Part 1: TheorySAT, CDCL and Theories In the first post of the series, I'll discuss the main idea of an SMT solver and the theories involved to understand the algorithm behind the SMT solver such as Z3. Table of Contents Basic Terminologies What is a SAT Solver? ...00