---
title: "Discussion on \"Quantization: GPTQ vs AWQ\" | Hashnode"
description: "Discussion on \"Quantization: GPTQ vs AWQ\". Compare post-training quantization models for squeezing massive LLMs onto standard GPUs."
url: "https://hashnode.com/posts/quantization-gptq-awq-byte/6a45c4da88d4e6848b7e4b57"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Quantization: GPTQ vs AWQ](https://abstractalgorithms.hashnode.dev/quantization-gptq-awq-byte?utm_source=hashnode&utm_medium=feed)

Compare post-training quantization models for squeezing massive LLMs onto standard GPUs.

Jul 2 · 1 min read · abstractalgorithms.hashnode.dev  
Read the article

-   [#quantization](https://hashnode.com/tag/quantization)
-   [#performance](https://hashnode.com/tag/performance)
-   [#gpus](https://hashnode.com/tag/gpus)
-   [#inference](https://hashnode.com/tag/inference)

## Written by

[Abstract Algorithms](https://hashnode.com/@abstractalgorithms)

@abstractalgorithms

  
[View profile](https://hashnode.com/@abstractalgorithms)

Exploring the fascinating world of algorithms, data structures, and software engineering through clear explanations and practical examples.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.