@ish4n10

Implementing GPT Architecture From Scratch: Training and Output

Mar 8 · 6 min read · This is a follow-up of my previous post "Implementing GPT Architecture From Scratch: A Deep Dive into Transformers and Attention" This will be a very short post explaining how i trained the untrained

Implementing GPT Architecture From Scratch: A Deep Dive into Transformers and Attention

Mar 6 · 13 min read · I highly recommend to have a knowledge of machine learning models or atleast the basics The Core Idea: Transformers Before transformers, the industry relied on RNNs and LSTMs. The paper "Attention

An SMT solver from scratch - Part 2: SMT Theories and Logics

Apr 13, 2025 · 9 min read · I have covered the basics of a SAT solver and their working mechanism in detail in the first part, in this part I'll try to delve deep-inside SMT theory and how they function being built on-top of a SAT solver. Table of Contents Basic Terminologies ...

An SMT solver from scratch - Part 1: Theory

Apr 6, 2025 · 6 min read · SAT, CDCL and Theories In the first post of the series, I'll discuss the main idea of an SMT solver and the theories involved to understand the algorithm behind the SMT solver such as Z3. Table of Contents Basic Terminologies What is a SAT Solver? ...