Scaling the Memory Wall: The Rise and Roadmap of HBM
… We are on the cusp of 12-high HBM becoming the mainstream configuration Adding more HBM stacks per package adds more bandwidth and capacity Here we can see this in Nvidia’s roadmap. HBM capacity explodes from the A100’s 80 GB of HBM2E to a 1024 GB of HBM4E for Rubin Ultra. …
