Understanding Pathways: How Google Scales to Thousands of TPUsPhoto: Vincent Tjeng Google presented the Pathways vision back in 2021: train a single large model that can do millions of things. At the time, ChatGPT didn't exist yet, and this idea felt genuinely 2Apr 13 · 16 min readcunzhe.site
Never Trust the ModelPhoto & Feedback: Vincent Tjeng Case 1: The SIGSEGV That Had No Pattern We had a server crash caused by segfault. No obvious pattern, binary rollback didn't help, core dumps didn't provide useful infApr 3 · 9 min readcunzhe.site
From Adam to Mixed PrecisionPhoto: Vincent Tjeng I've spent four years as an ML Infra engineer working on the platform layer — AI agents, serving infrastructure, search and recommendation systems. The work I enjoy most is the kApr 2 · 9 min readcunzhe.site
