---
title: "Discussion on \"Bits Don't Lie: Datatypes in Modern LLMs\" | Hashnode"
description: "Discussion on \"Bits Don't Lie: Datatypes in Modern LLMs\". Let’s talk about the different datatypes that are being used in modern LLMs like GPT, LLaMa and the like. The most common ones that you might have heard: FP32, BFloat16, Float16, INT8, etc. These are all standard data types and available in PyTorch a..."
url: "https://hashnode.com/posts/bits-dont-lie-datatypes-in-modern-llms/6839a06496fd310e54f38d84"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Bits Don't Lie: Datatypes in Modern LLMs](https://galacodes.hashnode.dev/bits-dont-lie-datatypes-in-modern-llms?utm_source=hashnode&utm_medium=feed)

Let’s talk about the different datatypes that are being used in modern LLMs like GPT, LLaMa and the like. The most common ones that you might have heard: FP32, BFloat16, Float16, INT8, etc. These are all standard data types and available in PyTorch a...

May 30, 2025 · 6 min read · galacodes.hashnode.dev  
Read the article

-   [#bf16](https://hashnode.com/tag/bf16)
-   [#llm](https://hashnode.com/tag/llm)
-   [#ai](https://hashnode.com/tag/ai)
-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#tpu](https://hashnode.com/tag/tpu)
-   [#gpu](https://hashnode.com/tag/gpu)
-   [#nvidia](https://hashnode.com/tag/nvidia)
-   [#google](https://hashnode.com/tag/google)
-   [#pytorch](https://hashnode.com/tag/pytorch)

## Written by

[Jay Gala](https://hashnode.com/@Jaygala223)

@Jaygala223 · Mumbai, India

  
[View profile](https://hashnode.com/@Jaygala223)

AI Software Engineer at Intel

Currently working as an AI Software Engineer at Intel

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
