If you're not a hyperscaler, neocloud, model dev, LPX is probably not for you. The sheer number of LPUs required to serve large open models will likely put Nvidia's LPX platform out of reach for most enterprises. Speaking to press ahead of this week's keynote, Buck said Nvidia is focusing primarily on model builders and service providers that need to serve trillion-plus-parameter models with token rates exceeding 500 to 1,000 a second. Having said that, in a technical blog, Nvidia presented another use case for the LPUs as a speculative decode accelerator, something we suggested the company mi
A closer look at Nvidia's Groq-powered LPX rack systems… Nvidia has validated and benchmarked the array's performance for workloads of up to 128 GPUs, conducted functional tests for enterprise-grade availability and reliability, and confirms that the storage layer efficiently feeds data to accelerated computing resources to deliver faster model training,… …
… Oracle previously raised $18 billion in debt and has since outlined plans to raise far more, as it funds datacenter investments aimed at meeting surging demand from AI model builders and enterprise customers. …
… Announcing an expansion of its AI Agent Studio for Fusion Applications, Oracle said the technology would be "capable of reasoning, taking action across business systems, and continuously executing processes" such that its software could "actively run the business, with the governance, trust, and se… …
… The machine also had no RAM expansion whatsoever. Presumably, this limited its appeal for many traditional buyers, and the machine never saw an M3 or M4 model, let alone the M5 SoC that The Register covered shortly before Bloomberg called the Arm64 cheesegrater's fate. …
… Nvidia proposes hosting the draft model on LPUs and the larger target model on a set of GPUs. Since draft models tend to be fairly small, this might present an opportunity for Nvidia to sell LPUs to enterprise customers. …