---
title: "Discussion on \"What quantisation actually trades off and when that trade-off is yours to make\" | Hashnode"
description: "Discussion on \"What quantisation actually trades off and when that trade-off is yours to make\". This is for people trying to run AI models locally on a personal machine. Say you want to run Llama locally on a MacBook Air, you visit Hugging Face and see a number printed on every model card that a"
url: "https://hashnode.com/posts/what-quantisation-actually-trades-off-and-when-that-trade-off-is-yours-to-make/6a969e1bb45e6987e7f6afdb"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [What quantisation actually trades off and when that trade-off is yours to make](https://leveragepoints.io/what-quantisation-actually-trades-off-and-when-that-trade-off-is-yours-to-make?utm_source=hashnode&utm_medium=feed)

This is for people trying to run AI models locally on a personal machine. Say you want to run Llama locally on a MacBook Air, you visit Hugging Face and see a number printed on every model card that a

Sep 1 · 5 min read · leveragepoints.io  
Read the article

## Written by

[Abdulwaheed A A](https://hashnode.com/@habiz)

@habiz

  
[View profile](https://hashnode.com/@habiz)

Building Products

I lead the strategy and delivery of products and systems that solve real problems, support commercial goals and scale across teams and markets. My work spans platform foundations, user-facing experiences, commercial tools and developer products, and I adapt my approach to the needs of each domain. My experience covers early-stage, scale-up and enterprise product environments, combining hands-on delivery with team leadership and award-winning work recognised across several innovative organisations.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.