HBM is the DRAM industry’s attempt to short-circuit the slowing pace of Moore’s Law by using 3D chip-packaging technology. Each HBM chip is made up of as many as 12 thinned-down DRAM chips called dies. Each die contains a number of vertical connections called through-silicon vias. The dies are piled atop each other and connected by arrays of microscopic solder balls aligned to the TSVs. This DRAM tower—well, at about 750 micrometers thick, it’s more of a brutalist office block than a tower—is then stacked atop what’s called the base die, which shuttles bits between the memory dies and the proc
How Will the Tech Industry Handle the DRAM Shortage?Many readers are doubtless salivating at the idea of spending less on HBM and are thinking: Why not curtail the amount of memory in a system even further? If a typical prefill sequence length means a memory utilization of low double digits or even single digits - why not reduce memory capacity to 1/10th the size? Does this mean doom for HBM demand and memory demand in general? However, things are not so simple in technology. What Rubin CPX does is reduce the cost of pre-fill and tokens. Lower cost of tokens increases demand, which means more demand for decode increases as well. Like many other
Another Giant Leap: The Rubin CPX Specialized Accelerator & RackScaling the Memory Wall: The Rise and Roadmap of HBM HBM4, Custom Base Die, Shoreline Expansion, Process Flow, China Domestic Production, Samsung Qualification The first portion of this report will explain HBM, the manufacturing process, dynamics between vendors, KVCache offload, disaggregated pref… …
… This article appears in the April 2026 print issue as the feature “ AI is a Memory Hog.” The sidebar from that article is here “ Low-Cost Computers Nearly Double in Price as RAM Shortage Hits. “ From Your Site Articles A Radical Proposal: Replace Hard Disks With DRAM › Hynix Makes No-Capacitor DRAM…
… Switching from using HBM to cheaper GDDR7 memory reduces the cost per GB by more than 50%. Memory speeds will likely be at 32Gbps with a 512-bit bus. This results in 2TB/s of memory bandwidth per Rubin CPX compared to 20.5TB/s of memory bandwidth per R200. …
… Samsung Samsung memory Hbm4e Hbm High memory bandwidth Ai Report a problem with this article
… Memory is already in short supply and HBM is among the scarcest. This is where being a South Korean company with close ties to both the SK chaebol and Samsung comes in handy. SK Hynix and Samsung are the largest suppliers of HBM in the world. …
… Samsung is planning to deliver some of the first samples of its HBM4e product shortly. …
… The other part of the supply chain that is just as critical is memory. This is where we believe the key constraint lies. HBM Is the Bottleneck We believe HBM production is the bottleneck . …
… Samsung's HBM4 Modules Are Claimed to Be at a 90% Logic Yield, Making Mass Production Inevitable HBM4 is one of the most 'prestigious' computing essentials in the modern-day markets, mainly since the memory module will be responsible for scaling up AI performance. …
… Right, one of the things that we know is there is an enormous amount of capacity that is being built by the memory manufacturers to bring more production online, and that more production online is going to focus on DDR, LPDDR, HBM, like the newer memory technologies." "I don't expect a lot of DDR4 … …
… The new standards offer more than just speed improvements, with the highlights listed below: Related Story Micron Warns Memory Crunch Will Outlast 2026 as AI Demand Outpaces What HBM, DRAM and NAND Can Supply 10nm-class DRAM Process Tech 1c 4nm Logic Process 11.7-13.0 Gbps Pin speeds 3.3 TB/s Bandw… …