---
title: "Discussion on \"Building LLMs From Scratch\" | Hashnode"
description: "Discussion on \"Building LLMs From Scratch\". DeepSeekV3\nYou can find the full code here: https://github.com/pandey-ps/solvingpapers/tree/main/deepseekv3\n8x2 MoE DeepSeekV3 model from scratch in pytorch; this is a decoder only transformer with op"
url: "https://hashnode.com/posts/building-llms-from-scratch/69c9806d5282e6ac9ce7435d"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building LLMs From Scratch](https://prashantpandey.hashnode.dev/building-llms-from-scratch?utm_source=hashnode&utm_medium=feed)

DeepSeekV3 You can find the full code here: https://github.com/pandey-ps/solvingpapers/tree/main/deepseekv3 8x2 MoE DeepSeekV3 model from scratch in pytorch; this is a decoder only transformer with op

Mar 29 · 1 min read · prashantpandey.hashnode.dev  
Updated Jul 14  
Read the article

-   [#llms](https://hashnode.com/tag/llms)
-   [#deepseek-v3](https://hashnode.com/tag/deepseek-v3)

## Written by

[Prashant Pandey](https://hashnode.com/@prashantpandey)

@prashantpandey

  
[View profile](https://hashnode.com/@prashantpandey)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.