Light Flips Memory to Feed Hungry AI Chips With Less Energy
… These processors don’t often have room for all the parameters that make up AI models , so the additional data is stored in dynamic random-access memory DRAM . …
Search
Tracked topic
DRAM
DRAM, or dynamic random-access memory, is a volatile computer memory technology that stores bits in capacitors and requires periodic refreshing to maintain data.
Live now
DDR4 pricing risk is elevated as DRAM suppliers prioritize HBM, potentially causing a major DDR4 price jump in Q3.
Live sources:
WCCFTech
Solid-State Circuits, in 3-D!
… Chip firms this week are reporting progress in 3-D integration for all types of memory—dynamic random-access memory DRAM , static random-access memory SRAM , and NAND flash—as well as in image sensors and wireless pressure sensors . …
Majestic’s 128TB AI Server Aims to Smash the LLM Memory Wall
… Nvidia’s current servers have fast high-bandwidth memory HBM , which is typically used to read in an LLM’s model weights. In addition, there’s an often larger but slower pool of dynamic random access memory DRAM , which handles LLM and server overhead. …