---
title: "#flash-attention articles | Hashnode"
description: "Explore 3 articles tagged #flash-attention on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/flash-attention"
---

Tag

# #flash-attention

3 posts · 0 followers

[Vlad Butacu](https://hashnode.com/@vlad-omniforge) · [Apr 15](https://hashnode.com/posts/your-local-llm-is-slow-because-of-five-config-flags/69e00519f95c47e87f56f05b)

### [Your Local LLM Is Slow Because of Five Config Flags](https://omniforge.online/blog/your-local-llm-is-slow-because-of-five-config-flags?utm_source=hashnode&utm_medium=feed)

KV cache, context size, and batch size control more of the performance budget than most people realize

8 min read · [omniforge.online](https://omniforge.online/blog/your-local-llm-is-slow-because-of-five-config-flags?utm_source=hashnode&utm_medium=feed)

[Kashif](https://hashnode.com/@ifkash) · [Feb 8](https://hashnode.com/posts/smol-llama-pretraining/698898652fb502a9301f0a63)

### [I Pretrained a 360M LLaMA-Style Language Model from Scratch on 6B FineWeb Tokens (Single H100)](https://blog.ifkash.dev/smol-llama-pretraining?utm_source=hashnode&utm_medium=feed)

Explore pretraining a 360M LLaMA-style language model on 6B tokens using a single H100 GPU, with reproducible results

5 min read · [blog.ifkash.dev](https://blog.ifkash.dev/smol-llama-pretraining?utm_source=hashnode&utm_medium=feed)

[Venkat Raman](https://hashnode.com/@Venkat2811) · [Apr 18, 2024](https://hashnode.com/posts/the-power-of-mechanical-sympathy-in-software-engineering/66215db1ef2e5749dd8dafd6)

### [The power of Mechanical Sympathy in Software Engineering](https://venkat.eu/the-power-of-mechanical-sympathy-in-software-engineering?utm_source=hashnode&utm_medium=feed)

Exploring Locality of Reference, LMAX Disruptor & Flash Attention

22 min read · [venkat.eu](https://venkat.eu/the-power-of-mechanical-sympathy-in-software-engineering?utm_source=hashnode&utm_medium=feed)
