---
title: "Discussion on \"Fundamentals of Large Language Models: Understanding LLM Architectures\" | Hashnode"
description: "Discussion on \"Fundamentals of Large Language Models: Understanding LLM Architectures\". What is an LLM?\nAn LLM (Large Language Model) is fundamentally a probabilistic model that predicts distributions over vocabulary tokens. At its core, an LLM understands a fixed set of words called a vocabulary and assigns probabilities to each word a..."
url: "https://hashnode.com/posts/fundamentals-of-large-language-models-understanding-llm-architectures/692ecafb4623c7bb2dc89abb"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Fundamentals of Large Language Models: Understanding LLM Architectures](https://ryan-giggs.hashnode.dev/fundamentals-of-large-language-models-understanding-llm-architectures?utm_source=hashnode&utm_medium=feed)

What is an LLM? An LLM (Large Language Model) is fundamentally a probabilistic model that predicts distributions over vocabulary tokens. At its core, an LLM understands a fixed set of words called a vocabulary and assigns probabilities to each word a...

Dec 2, 2025 · 6 min read · ryan-giggs.hashnode.dev  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#deep-learning](https://hashnode.com/tag/deep-learning)
-   [#nlp-transformers](https://hashnode.com/tag/nlp-transformers)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)

## Written by

[Ryan Giggs](https://hashnode.com/@Derrick-Ryan-Giggs)

@Derrick-Ryan-Giggs · Eldoret, Kenya

  
[View profile](https://hashnode.com/@Derrick-Ryan-Giggs)

Data enthusiast

Ryan Giggs is on a path to Data Engineering

## Responses

Markdown supported · ⌘↵ to post

No responses yet.