---
title: "Discussion on \"Fitting AI in your pocket with quantization\" | Hashnode"
description: "Discussion on \"Fitting AI in your pocket with quantization\". Every time I tried to run a decent open-weights model on my own laptop, I hit the same wall. The model was \"only\" 7 or 13 billion parameters, and my GPU still choked on it. Either it wouldn't load, or"
url: "https://hashnode.com/posts/fitting-ai-in-your-pocket-with-quantization/6aa2e9be37e241e1d07f7db9"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Fitting AI in your pocket with quantization](https://advancedideamechanics.hashnode.dev/fitting-ai-in-your-pocket-with-quantization?utm_source=hashnode&utm_medium=feed)

Every time I tried to run a decent open-weights model on my own laptop, I hit the same wall. The model was "only" 7 or 13 billion parameters, and my GPU still choked on it. Either it wouldn't load, or

Sep 10 · 10 min read · advancedideamechanics.hashnode.dev  
Read the article

## Written by

[Bhavya Shingari](https://hashnode.com/@bhavyashingari)

@bhavyashingari · Faridabad, India

  
[View profile](https://hashnode.com/@bhavyashingari)

Azure Data Scientist Associate & Beta MLSA at Microsoft | IBM Z Community Lead | A.I developer and ML engineer | Cybersecurity Analyst |

Passionate about leveraging innovation to drive positive change, I am a full stack web developer and a Machine Learning Engineer with a proven track record in Google DSC, datacamp and Microsoft Azure Developer Community. With a keen eye for detail and a commitment to excellence, I thrive in dynamic environments where I can apply my expertise in Python, C++, 3D Animation, SQL, Machine Leaning, React.js, Django and OpenAI to solve complex challenges. My journey has equipped me with a solid foundation in data science, and I am excited to contribute my skills and enthusiasm to projects that make a meaningful impact. Let's connect and explore opportunities to collaborate!

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
