… Let's go through how HBM is used, and where the pressures are. HBM Usage in Inference In LLM inference, all the model weights reside permanently in the on-package HBM memory so the GPU can fetch them without delay. Alongside the weights, HBM also holds the KVcache. …
… It is expected to be used by HBM5E , the 9th Gen HBM solution from the Korean semiconductor company. The 1c DRAM is currently being used across three generations of HBM products, including HBM4, HBM4E, and HBM5 . …
… The future HBM4 memory coming from Micron will use its well-established 1-beta process, and will have a custom logic base die that will help its HBM4 memory deliver more than 2 TB/sec per HBM4 stack, which is 60 percent more bandwidth than a stack of HBM3E memory. …
… Read all comments on Memory Shortages Are Actually So Terrible That Samsung Is Shifting HBM Production Towards DDR5, to Ensure That It Gets “Maximized Profits”
… Related Story Sharp Memory Price Jumps Will Be Felt More Severely In Dell’s PC, Server Markets In Coming Months, Says Bank This comes as the operating profit of Samsung's semiconductor unit in Q1 2026 surged by an unbelievable 48x year-over-year on record-breaking demand for memory products, with t… …
… More than 2,500 members recently left Samsung's largest union, objecting to what they viewed as memory-focused demands that offered little to employees outside the chip business. …
… The other part of the supply chain that is just as critical is memory. This is where we believe the key constraint lies. HBM Is the Bottleneck We believe HBM production is the bottleneck . …
… Samsung is planning to deliver some of the first samples of its HBM4e product shortly. …
… Switching from using HBM to cheaper GDDR7 memory reduces the cost per GB by more than 50%. Memory speeds will likely be at 32Gbps with a 512-bit bus. This results in 2TB/s of memory bandwidth per Rubin CPX compared to 20.5TB/s of memory bandwidth per R200. …
… However, according to a new report by Omdia via Chosun , the Korean giant has regained its throne in the memory markets, driven by the DRAM supercycle and by the company's aggressive shift in its HBM strategy. …
