---
title: "Discussion on \"Kimi K3 has 2.8T parameters. Moving them was the hard part.\" | Hashnode"
description: "Discussion on \"Kimi K3 has 2.8T parameters. Moving them was the hard part.\". Inside Stable LatentMoE and Attention Residuals — the two changes that made a 3T-class model trainable."
url: "https://hashnode.com/posts/kimi-k3-has-2-8t-parameters-moving-them-was-the-hard-part/6a769f693e4681a62cc1b73a"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Kimi K3 has 2.8T parameters. Moving them was the hard part.](https://minhleduc.hashnode.dev/kimi-k3-has-2-8t-parameters-moving-them-was-the-hard-part?utm_source=hashnode&utm_medium=feed)

Inside Stable LatentMoE and Attention Residuals — the two changes that made a 3T-class model trainable.

Aug 8 · 15 min read · minhleduc.hashnode.dev  
Read the article

## Written by

[minhleduc](https://hashnode.com/@firefrog)

@firefrog · Ho Chi Minh City, Vietnam

  
[View profile](https://hashnode.com/@firefrog)

Just another Dev guy.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
