… The role calls for highly optimized CPUs advanced capabilities in areas from core counts and memory to I/O, bandwidth, and power efficiency to help manage complex AI workloads while driving performance and reining in some of the costs. …
… Disk arrays are very costly. You can get the same I/O from a couple of flash cards today, but they ain’t cheap, either. And getting more expensive by the minute, in fact, just like main memory. …
… There will have to be variants of Google TPUs and Amazon Trainiums aimed specifically at agentic AI inference and presenting a better balance between memory bandwidth and compute while also not sacrificing memory capacity. …
… Even if business is up, costs for memory and flash are going up faster, and companies like Hewlett Packard have to work harder to find and select profitable deals. …
… The MTIA 450 is a fast-following upgrade to the MTIA 400, we think moving from the HBM3E memory used in the MTIA 400 to HBM4 memory. That doubles up the memory bandwidth on the devices to a very respectable 18.4 TB/sec against a 1.75X increase in peak MX4 throughput. …
… If you want to do a full accounting of the network costs for AI hardware, companies also have to beef up their front end networks linking application to AI clusters, too, because these are generally painfully slow compared to the scale out networks that comprise the outer rings or branches dependin… …
… Robbins said that Cisco is changing contracts to have provisions for flex pricing on memory so it can pass through higher costs – memory prices have doubled in a year and probably will triple before the year is out is what we are hearing – to customers. …
… If you take this high-end and low-cost server memory out of the mix along with HBM, then the remaining DRAM business accounted for $8.99 billion in my model, up 128.2 percent. Still not bad, and illustrative of the across-the-board memory boom we are in. …
… Some of that comes with expensive GPUs being used now for AI workloads that less costly and more efficient CPUs can handle. The Intel Xeon 6 chips come with more cores up to 128 cores per CPU and better memory bandwidth through MRDIMM. …
… So that’s the overall thought process: if you look at these four vectors for memory, and you add acquisition cost and TCO, the choices will evolve very naturally, and you will see why certain memory fits into one use case and not in others. …