… This new data revealed by Google chief executive officer Sundar Pichai does not include tokens processed for GenAI training, and it doesn’t look like it includes Google’s internal services use of Gemini because it does not map to the data Google’s Mark Lohmeyer showed off at the AI Hardware Summit … …
New Google Networks Tuned Up For GenAI Inference And Training It is almost certainly not a coincidence that a networking expert at Google has risen to the top to be put in charge of the infrastructure development at the search engine, advertising, and now AI model giant. …
… One of the key areas for Nvidia is developing and making available open source advanced AI foundation and physical AI models that run on its infrastructure, a move that comes as the AI industry shifts its emphasis from model training to inferencing . …
… The first workload is called prefill, and the same kind of machinery that can do prefill can also do GenAI training, which is sometimes called pre-training to distinguish this model weight creation process from reinforcement learning and other kinds of AI model tuning. …
… David Noy, vice president of product management, took the view from AI training and inferencing perspectives. For those running training operation, cleaning and preparing the data is critical for ensuring the models are as accurate as possible. …
… So does the company’s CEO. “Google Cloud is differentiated because we are the only provider to offer first party solutions across the entire enterprise AI stack,” Pichai said on the call. “Our growth in revenue, operating margin, and backlog highlights this differentiation. …
… According to a Goldman Sachs Research report, an OpenAI ChatGPT query needs almost 10 times the electricity to process as a Google search does and the energy demand emanating from AI jobs promises to grow. …
… Moreover, many companies are doing classical machine learning as well as GenAI, and in many cases they do not need rackscale compute nodes to do their inference. And if they need rackscale nodes for training, they can – and often do – rent them from a big cloud builder or a neocloud. …
… AI researchers at Microsoft will also use the Maia 200 to generate synthetic data for training in-house models. …
… Net income was $38.46 billion, aided by a $7.6 billion gain from its 27 percent stake in OpenAI. In Q1 F2026, OpenAI’s books put a $3.1 billion loss on Microsoft’s books. The remaining $2.4 billion in Other income came from interest and other stuff. …