… TPM: With HBM4, you’re not going to skip right to HBM4E, are you? Praveen Vaidyanathan: No, no. We have a strong position, and with HBM4 we want to maintain that position. We are excited about Micron’s HBM leadership roadmap for the rest of this decade. …
… Equally importantly, SambaNova has kept the HBM memory bandwidth roughly the same at 1.84 TB/sec and the capacity of the HBM memory the same at 64 GB even as it doubles up the cores and more than doubles the performance – and even backstepped to HBM2E memory in the SN50 from HBM3 memory used in the… …
… Nvidia will have sixteen banks of HBM4E memory against those four Rubin GPU chips, for 1 TB of capacity and 32 TB/sec. In theory, that HBM4E memory could run at 64 TB/sec, and we are wondering why Nvidia is gearing it down – perhaps for power consumption and heat dissipation reasons. …
… The MTIA 450 is a fast-following upgrade to the MTIA 400, we think moving from the HBM3E memory used in the MTIA 400 to HBM4 memory. That doubles up the memory bandwidth on the devices to a very respectable 18.4 TB/sec against a 1.75X increase in peak MX4 throughput. …