ish4n10.hashnode.devImplementing GPT Architecture From Scratch: A Deep Dive into Transformers and AttentionI highly recommend to have a knowledge of machine learning models or atleast the basics The Core Idea: Transformers Before transformers, the industry relied on RNNs and LSTMs. The paper "Attention 11h ago·13 min read
ish4n10.hashnode.devAn SMT solver from scratch - Part 2: SMT Theories and LogicsI have covered the basics of a SAT solver and their working mechanism in detail in the first part, in this part I'll try to delve deep-inside SMT theory and how they function being built on-top of a SAT solver. Table of Contents Basic Terminologies ...Apr 13, 2025·9 min read
ish4n10.hashnode.devAn SMT solver from scratch - Part 1: TheorySAT, CDCL and Theories In the first post of the series, I'll discuss the main idea of an SMT solver and the theories involved to understand the algorithm behind the SMT solver such as Z3. Table of Contents Basic Terminologies What is a SAT Solver? ...Apr 6, 2025·6 min read