Tag feed

#flash-attention

3 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

VBVlad Butacuomniforge.onlineApr 15 · 8 min read

Your Local LLM Is Slow Because of Five Config Flags

Your model fits in memory. You load it up, send a prompt, and watch it choke halfway through a conversation. Or it runs, but at 3 tokens per second on hardware that should do better. You picked the ri

0

KKashifblog.ifkash.devFeb 8 · 5 min read

I Pretrained a 360M LLaMA-Style Language Model from Scratch on 6B FineWeb Tokens (Single H100)

Pretraining an LLM from scratch usually sounds like “big-lab-only” territory. I wanted to test how far a smaller, practical setup can go while keeping the process transparent and reproducible. This post documents an end-to-end run of training a ~360M...

0

VRVenkat Ramanvenkat.euApr 18, 2024 · 22 min read

The power of Mechanical Sympathy in Software Engineering

Introduction Modern software programming languages, compilers, and frameworks abstract away underlying complexities and details, allowing developers to focus on building systems and applications to solve business problems. This design enables enginee...

0

#flash-attention

Search Hashnode

#flash-attention

Explore Hashnode

Trending tags this week

Your Local LLM Is Slow Because of Five Config Flags

I Pretrained a 360M LLaMA-Style Language Model from Scratch on 6B FineWeb Tokens (Single H100)

The power of Mechanical Sympathy in Software Engineering