Google designed Ironwood TPU around large-scale inference
Google announced Ironwood, its seventh-generation TPU, with configurations scaling to 9,216 chips and a stated 42.5 exaflops of FP8 compute per pod for demanding inference workloads.
Why it matters: The design reflected the industry's shift from training-only scaling toward serving reasoning, retrieval and agent workloads at fleet scale.