Microsoft Committed To Doubling AI Infrastructure In Two Years
… What is clear is that to service that OpenAI commitment, Microsoft is going to have to invest in AI infrastructure at the crazy rates of its peers: AWS, Google, and Meta Platforms. …
Search
Broadcom May Become The Biggest Counterbalance To Nvidia
… Infrastructure Software revenues will rise by 9 percent to $7.2 billion, which means more profits in the coffer to invest in the AI buildout. xpu google ethernet connect bytedance broadcom apple anthropic ai openai switch
The Twin Engine Strategy That Propels AWS Is Working Well
… Our model suggests that AWS spent around $115 billion on IT infrastructure, and of this around $105 billion was for AI infrastructure. …
Nvidia Software Pushes MLPerf Inference Benchmarks To New Highs
… Salvatore echoed Huang’s argument made at GTC, that Nvidia’s platforms – while expensive – improves token generation. “Increases in token generation or increases in performance basically generate more revenue, they reduce costs, they get you more value from the same infrastructure,” he said. “This … …
Some Game Theory On That Nvidia-Meta Platforms Partnership
… The “Grace-Hopper” superchip pairing of the CG100 CPU and the H100 GPU accelerator was very much aimed at recommendation engines. …
The Second Time Will Be The IPO Charm For Cerebras
… In March this year, Cerebras inked a “binding term sheet” with AWS to marry CS-3 systems to its homegrown and current Trainium 3 and as well as its future Trainium 4 AI systems, which Cerebras characterized as a multi-year deal “to bring fast inference to an even bigger scale through global distrib… …
Attacking Interconnects And Networks Across All Scales
… But given the advent of rackscale AI infrastructure, which will dominate the systems market for the coming decade and, for Nvidia at least, has NVSwitch for scale up memory interconnects and Spectrum-X for scale out and scale across networks, it is reasonable to wonder how Arista will do more than … …
NextSilicon Takes Aim At CPUs And GPUs With “Maverick-2” Dataflow Engine
… What we do know is that NextSilicon says that the Arbel core can “stand toe-to-toe” with Intel’s “LionCove” Xeon core and AMD’s “Zen5” Epyc core. dataflow processor nextsilicon maverick-2 maverick-1 hpc gpu risc-v dataflow engine cpu compute arbel Chip Capacity Constraints Put A Governor On AI Spen…
With TPU 8, Google Makes GenAI Systems Much Better, Not Just Bigger
… To be fair, Google has had versions of prior TPUs, specialized and homegrown AI accelerators that the search engine, advertising, media mogul, and now AI model maker first put into the field way back in 2015. …
Eridu Cuts To The AI Networking Chase With High Radix Switch System
… This is a fairly substantial amount of money, which is what you need if you want to take on Nvidia NVSwitch and Spectrum-X on its home AI turf and if you are also competing against Broadcom, Cisco Systems, Marvell, and a handful of others who are building ASICs for scale up and scale out networks f… …