---
title: "Discussion on \"LLMs and context window and why do we use ReLU than Softmax\" | Hashnode"
description: "Discussion on \"LLMs and context window and why do we use ReLU than Softmax\". Large Language Models (LLMs) like GPT, Claude, and LLaMA have reshaped how we interact with machines. They can write essays, generate code, summarize documents, and even reason through complex problems. Yet behind this apparent intelligence are archi..."
url: "https://hashnode.com/posts/llms-and-context-window-and-why-do-we-use-relu-than-softmax/694eee8e8004297040dbab77"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [LLMs and context window and why do we use ReLU than Softmax](https://tanvis-blogs.hashnode.dev/llms-and-context-window-and-why-do-we-use-relu-than-softmax?utm_source=hashnode&utm_medium=feed)

Large Language Models (LLMs) like GPT, Claude, and LLaMA have reshaped how we interact with machines. They can write essays, generate code, summarize documents, and even reason through complex problems. Yet behind this apparent intelligence are archi...

Dec 26, 2025 · 5 min read · tanvis-blogs.hashnode.dev  
Read the article

-   [#llms](https://hashnode.com/tag/llms)
-   [#deep-neural-networks](https://hashnode.com/tag/deep-neural-networks)

## Written by

[Tanvi Virappa Patil](https://hashnode.com/@tanvi-patil)

@tanvi-patil

  
[View profile](https://hashnode.com/@tanvi-patil)

Problem Solver at ❤️

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
