I Run LLMs on a 768GB IBM POWER8 Server (And It's Faster Than You Think)

The machine nobody wants I bought an IBM POWER8 S824 server — 16 cores, 128 hardware threads (SMT8), 768GB of DDR3 RAM (512GB active across 2 NUMA nodes), and 1.8TB of SAS storage. It's a datacenter-class PowerPC system from 2014 that originally cost...