Google Announces TPU v8t Sunfish and TPU v8i Zebrafish
…The downside is that anything that does not map cleanly to large dense matmuls, specifically dynamic shapes, irregular sparsity patterns, MoE routing with uneven token distribution, or graph neural networks, is harder…