I Run LLMs on a 768GB IBM POWER8 Server (And It's Faster Than You Think)

title: "I Run LLMs on a 768GB IBM POWER8 Server (And It's Faster Than You Think)" published: true description: "An IBM POWER8 S824 with 512GB RAM, 128 hardware threads, and a novel vec_perm optimizati