Nvidia CEO Jensen Huang famously said in March this year that if an Nvidia engineer on $500,000 a year wasn't using at least $250,000 of tokens in that same period, he'd be alarmed. This isn't a rare sentiment, though. Many company CEOs are now bragging about the extent of their AI use, as if that alone equates to performance increases. As Business Insider reports, Airbnb's CEO proudly told investors that 60% of the company's code was now AI-generated. Chime claimed it was shipping 84% AI code earlier this year, and even Google is claiming 50% of its code is AI-generated (though crucially, alw
AI costs begin to bite as agents may increase token demand by 24 times, says Goldman Sachs report — Uber and Microsoft among companies feeling the bite of tokenized billing… We've long emphasized the importance of high single-threaded performance for a fast and responsive experience for client PCs, and it seems like AI agents are going to end up placing similar demands on hardware as they do their thing. …
… Nvidia says that the incredible efficiency of the RTX Spark platform “transforms what a high-performance laptop looks like,” so buyers in the promised agentic AI age will no longer need to choose between high performance or thin chassis with long battery life. …
… Goldman Sachs' recent AI agent report suggests that the massive efficiency gains coming from next-generation inferencing chips would make AI use so much cheaper that investment can continue unabated, and profit should follow, with AI agents increasing the revenue at AI companies enormously. …
… The rate of growth has now doubled to 35% a year, AMD claims , and will become a $120 billion market by the end of the decade. “What AMD and Arm's results are telling us is that this is a structural, not cyclical requirement,” said Roger Cummings, CEO of PEAK:AIO, in an interview with Tom’s Hardwar… …
… It also introduced a competitive yardstick it hasn't used before, claiming the most AI agents per watt, per dollar, and per rack, though its own endnotes state those agent counts are estimated from CPU thread resources used as a proxy. …
… You might wonder what all these AI agent bots are actually up to, particularly if you’re not running your own army of digital helpers. Thankfully, Cloudflare has addressed the scope of AI bot activity in previous articles and blogs. …
… And since Nvidia and its partners both laptop makers and Microsoft are pitching RTX Spark as the agentic computing platform of the future, Spark laptops get all the RAM that portable, local AI PCs could ask for – up to 128GB of LPDDR5X. …
… In fact, KV cache and enhanced AI inference performance are among the key advantages of the new SSD controller platform. “KV Cache has become a critical factor in AI inference performance, driving the need for sustained high random read/write throughput and low-latency data access,” said Nelson Dua… …
… Here's the response it gave: "Per-core performance under a fully loaded socket is important because agentic AI and RL run many sandboxes concurrently, while each agent step remains sequential and latency-sensitive. …
… We’ve already gone in depth on new performance data around the Vera CPU and how it helps to accelerate agentic AI workloads, but that’s not all Nvidia is sharing today. …