CCunzheincunzhe.site·Apr 13 · 16 min readUnderstanding Pathways: How Google Scales to Thousands of TPUsPhoto: Vincent Tjeng Google presented the Pathways vision back in 2021: train a single large model that can do millions of things. At the time, ChatGPT didn't exist yet, and this idea felt genuinely 20
CCunzheincunzhe.site·Apr 3 · 9 min readNever Trust the ModelPhoto & Feedback: Vincent Tjeng Case 1: The SIGSEGV That Had No Pattern We had a server crash caused by segfault. No obvious pattern, binary rollback didn't help, core dumps didn't provide useful inf00
CCunzheincunzhe.site·Apr 2 · 9 min readFrom Adam to Mixed PrecisionPhoto: Vincent Tjeng I've spent four years as an ML Infra engineer working on the platform layer — AI agents, serving infrastructure, search and recommendation systems. The work I enjoy most is the k00
