---
title: "Discussion on \"Building a Mini-GPT From Scratch: A JAX and Flax Guide to Small Language Models\" | Hashnode"
description: "Discussion on \"Building a Mini-GPT From Scratch: A JAX and Flax Guide to Small Language Models\". Everyone's talking about small language models (SLMs) right now distilled, quantized, edge-deployable versions of the giants that still punch above their weight. But most tutorials on building one sto"
url: "https://hashnode.com/posts/building-a-mini-gpt-from-scratch-a-jax-and-flax-guide-to-small-language-models/6a36d9d9c0100b81b3ab0c9b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building a Mini-GPT From Scratch: A JAX and Flax Guide to Small Language Models](https://advancedideamechanics.hashnode.dev/building-a-mini-gpt-from-scratch-a-jax-and-flax-guide-to-small-language-models?utm_source=hashnode&utm_medium=feed)

Everyone's talking about small language models (SLMs) right now distilled, quantized, edge-deployable versions of the giants that still punch above their weight. But most tutorials on building one sto

Jun 20 · 13 min read · advancedideamechanics.hashnode.dev  
Read the article

## Written by

[Bhavya Shingari](https://hashnode.com/@bhavyashingari)

@bhavyashingari · Faridabad, India

  
[View profile](https://hashnode.com/@bhavyashingari)

Azure Data Scientist Associate & Beta MLSA at Microsoft | IBM Z Community Lead | A.I developer and ML engineer | Cybersecurity Analyst |

Passionate about leveraging innovation to drive positive change, I am a full stack web developer and a Machine Learning Engineer with a proven track record in Google DSC, datacamp and Microsoft Azure Developer Community. With a keen eye for detail and a commitment to excellence, I thrive in dynamic environments where I can apply my expertise in Python, C++, 3D Animation, SQL, Machine Leaning, React.js, Django and OpenAI to solve complex challenges. My journey has equipped me with a solid foundation in data science, and I am excited to contribute my skills and enthusiasm to projects that make a meaningful impact. Let's connect and explore opportunities to collaborate!

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
