---
title: "#flashattention articles | Hashnode"
description: "Explore 4 articles tagged #flashattention on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/flashattention"
---

Tag

# #flashattention

4 posts · 0 followers

[Kashif](https://hashnode.com/@ifkash) · [Feb 8](https://hashnode.com/posts/smol-llama-pretraining/698898652fb502a9301f0a63)

### [I Pretrained a 360M LLaMA-Style Language Model from Scratch on 6B FineWeb Tokens (Single H100)](https://blog.ifkash.dev/smol-llama-pretraining?utm_source=hashnode&utm_medium=feed)

Explore pretraining a 360M LLaMA-style language model on 6B tokens using a single H100 GPU, with reproducible results

5 min read · [blog.ifkash.dev](https://blog.ifkash.dev/smol-llama-pretraining?utm_source=hashnode&utm_medium=feed)

[Gasym A. Valiyev](https://hashnode.com/@GasymV) · [Aug 1, 2025](https://hashnode.com/posts/the-ai-engineers-guide-to-inference-optimization-making-models-faster-and-cheaper/688ca60402b9ffbffbd3c61a)

### [The AI Engineer's Guide to Inference Optimization: Making Models Faster & Cheaper](https://ai-engineering-study.hashnode.dev/the-ai-engineers-guide-to-inference-optimization-making-models-faster-and-cheaper?utm_source=hashnode&utm_medium=feed)

Welcome to a deep dive into one of the most critical and fascinating areas of AI Engineering: Inference Optimization. While building powerful models is one part of the equation, making them run efficiently—faster, cheaper, and at scale—is what makes ...

47 min read · [ai-engineering-study.hashnode.dev](https://ai-engineering-study.hashnode.dev/the-ai-engineers-guide-to-inference-optimization-making-models-faster-and-cheaper?utm_source=hashnode&utm_medium=feed)

[Alex Smith](https://hashnode.com/@alexbsr) · [Jun 1, 2025](https://hashnode.com/posts/flashattention-explained-fast-transformer-attention-and-smarter-gpu-optimization/683c86663a0bd3bfe735601f)

### [FlashAttention Explained: Fast Transformer Attention and Smarter GPU Optimization](https://greenit.hashnode.dev/flashattention-explained-fast-transformer-attention-and-smarter-gpu-optimization?utm_source=hashnode&utm_medium=feed)

FlashAttention is a high-performance implementation of the attention mechanism in Transformers. It delivers 2–4x speedups and significant memory savings—especially valuable when training large models with long sequences. In this article, we’ll explai...

4 min read · [greenit.hashnode.dev](https://greenit.hashnode.dev/flashattention-explained-fast-transformer-attention-and-smarter-gpu-optimization?utm_source=hashnode&utm_medium=feed)