AI Nvidia Software Pushes MLPerf Inference Benchmarks To New Highs For years, co-founder and chief executive officer Jensen Huang and other higher-ups at Nvidia have been banging on the message that the company is more than its GPUs, that the chips that have become crucial to the rapid expansion of… …
… Hyperscalers and cloud builders want to control their entire stack – as does Nvidia, which can afford to open source its Nemotron models because it is so rich on hardware . But trust me, when you buy Nvidia GPUs, you are paying for all that free software. …
… Micron is Nvidia’s sole supplier for this, and it has just began shipping an LPDDR5 SOCAMM2 module that will allow Nvidia to quadruple the main memory capacity on the Vera CPU to 2 TB compared to a peak 512 GB for the Grace CPU. …
… Even assuming most of that software cash flow is invested in share buybacks, dividends, and development of AI tools to update and change its software estate, Oracle can plow its OpenAI revenues back into building up the GPU fleet until it hits the point the two companies have agreed upon. …
… When you add up all that Windows Server systems software extracting out databases, development tools, and other stuff that is not base systems software like operating systems and hypervisors and container controllers. and add in all that Azure cloud capacity that is rented for compute, storage, and… …
… Nvidia and AMD can pay for the bleeding edge nodes because they can charge the big bucks for CPUs and GPUs. …