CCunzheincunzhe.site20Understanding Pathways: How Google Scales to Thousands of TPUsApr 13 · 16 min read · Photo: Vincent Tjeng Google presented the Pathways vision back in 2021: train a single large model that can do millions of things. At the time, ChatGPT didn't exist yet, and this idea felt genuinely Join discussion
CCunzheincunzhe.site00Never Trust the ModelApr 3 · 9 min read · Photo & Feedback: Vincent Tjeng Case 1: The SIGSEGV That Had No Pattern We had a server crash caused by segfault. No obvious pattern, binary rollback didn't help, core dumps didn't provide useful infJoin discussion
CCunzheincunzhe.site00From Adam to Mixed PrecisionApr 2 · 9 min read · Photo: Vincent Tjeng I've spent four years as an ML Infra engineer working on the platform layer — AI agents, serving infrastructure, search and recommendation systems. The work I enjoy most is the kJoin discussion