You’re about to feel the AI money squeeze
…AI companies have broken ground on data centers around the world, dedicating billions of dollars with promises of better models, lower costs, and AI for everyone. Even stemming the flow of losses…
Search
All sources
blogs.nvidia.com
19
wccftech.com
16
developer.nvidia.com
10
techcrunch.com
9
tomshardware.com
8
theregister.com
8
huggingface.co
6
amd.com
5
theverge.com
2
androidauthority.com
2
engadget.com
2
pcworld.com
2
People also ask
What Are the Factors That Lower Token Cost?
Understanding how to optimize token cost requires looking at the equation for calculating cost per million tokens. In this equation, many enterprises evaluating AI infrastructure focus on the numerator: the cost per GPU per hour. For cloud deployments, this is the hourly rate paid to a cloud provider; for on-premises deployments, it’s the effective hourly cost derived from amortizing owned infrastructure. The real key to reducing token cost, however, lies in the denominator: maximizing the delivered token output. That denominator carries two business implications. Minimize token cost: When thi
Rethinking AI TCO: Why Cost per Token Is the Only Metric That MattersWhy Does Cost per Token Matter Much More Than FLOPS per Dollar?
The following data for the DeepSeek-R1 AI model demonstrates the difference between theoretical and actual business outcomes. Looking at compute cost alone, the NVIDIA Blackwell platform appears to cost roughly 2x more than NVIDIA Hopper — but compute cost says nothing about the output that investment buys. An analysis of mere FLOPS per dollar suggests a 2x NVIDIA Blackwell advantage compared with the NVIDIA Hopper architecture. However, the actual outcome is orders of magnitude different: Blackwell delivers more than 50x greater token output per watt than Hopper, resulting in nearly 35x lower
Rethinking AI TCO: Why Cost per Token Is the Only Metric That MattersVideos
More videos
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
NVIDIA Delivers the Lowest Token Cost
Inside AI Tokenomics: Profitably Turn Tokens Into Business Value
Understanding the AI Tokenomics Equation
Unfortunately, I Was Right
Building the Future of Voice-First Sovereign AI: Sarvam & NVIDIA
GPT 5.2: OpenAI Strikes Back
Getting started with OpenClaw (VPS Set-Up simply + secure) Tutorial
Paperless-ngx + Local AI (Optional): Better OCR, Self-Hosted, No Cloud
COLLAPSE of Personal Computing | Investigation Into the Destruction of Ownership
AMD Instinct MI355X GPU Sets a New Bar for DeepSeek Inference
…Cost per Token and Fleet Economics Cost per token is where infrastructure decisions become business decisions. The right evaluation uses a transparent ownership model at the interactivity target each application requires. Starting…
The Many Aspects of Inference Performance
…GB300 (SGLang and TRT-LLM). Source: SemiAnalysis InferenceX™, Mar 7, 2026. To illustrate the impact of software optimization on cost per token : since February, MI355X GPU cost per token has dropped significantly…
Is this the dawn of the Tokenpocalypse? | TechCrunch
…Can these AI labs collapse that cost [and] progress the tech enough in a way that it eventually meets in the middle with customers’ appetite for spending? A funny thing to think…
Top stories
Ditching the cloud for local AI — how I use two mini PCs to process millions of tokens a day and save money on costly API fees
1w agoOpenAI debuts Jalapeño, its first custom AI chip to cut ChatGPT costs and reduce Nvidia dependency
10h agoMicrosoft Risks Trump's Ire By Abandoning The Costly OpenAI And Anthropic Models For China-Based DeepSeek's V4 Model For Enterprise Workloads
1w agoTensordyne's 3nm Napier AI Chip Promises 13x Higher Token Throughput Than Blackwell & Blazes Past Rubin With 1000 Tokens/s In Multi-Trillion Parameter Models
1w agoWhat Drives AI Inference Profitability?
…NVIDIA’s codesigned, full-stack AI infrastructure is built to deliver the computational demand and help solve for the complexity of inference, while achieving greater efficiency and lowest cost per token. AI…
Nvidia Software Pushes MLPerf Inference Benchmarks To New Highs
…For large language models (LLMs) and reasoning models, the coin of the realm are tokens – Huang last month called them the “new commodity” – and token generation, both the speed and the cost…
Companies are scrambling to stop employees from maxing out AI budgets with small tasks | TechCrunch
…COO, and CIO level, are still asking the question of whether they’re getting value from what we’re spending on in the context of AI.” The cost of tokens has thrown…
Discussions and forums
Show HN: AI agent token cost calculator for Codex and Claude Code loops
Show HN: AI agent token cost calculator for Codex and Claude Code loops
2
Value for Money Is All You Need
Value For Money is All You NeedA reflection on the future of token consumption in artificial intelligenceToken consumption now sits at the center of the growing use of artificial intelligence by businesses and individual…
1
Zai replaced the network architecture running GLM-5.1 inference and the gains are pretty wild
Been following the infrastructure side of AI more lately and stumbled on this from Zai. They upgraded the network architecture on a thousand-GPU cluster running GLM-5.1 coding inference from the standard ROFT setup to so…
Show HN: Token Usage Meter 12 Providers and Coding Agent
Here once again A Token Usage Meter for 12+ AI Providers Anthropic, OpenAI, Google, Alibaba qween, Moonshot Kimi, MiniMax, ElevenLabs, Deepgram, Perplexity. Qlaud.ai provides token usage meter / AI billing layer. Also Ql…
2
Show HN: Open-source CLI to see your AI coding token usage and compare it
I use Claude Code, Codex, Cursor every day and had no idea how much I was actually burning across all of them combined. Each tool shows its own usage (most don't) in its own place, if at all, and I just wanted one number…
2
Building for the Rising Complexity of Agentic Systems with Extreme Co-Design | NVIDIA Technical Blog
…400k token contexts at competitive costs. AI-generated content may summarize information incompletely. Verify important information. Learn more Generative AI’s explosive first chapter was defined by humans sending requests and models…
'What a joke': Github Copilot's new token-based billing spurs consternation among devs | TechCrunch
…Microsoft provided this billing method and they kept making it easier and easier to burn through massive numbers of tokens on single premium requests that could churn for hours or even days…
Dell Launches Local ‘Deskside Agentic AI’ Workstations to Slash Cloud Token Costs
…As AI agents grow more capable and always-on, the volume of tokens they consume can send public cloud API costs spiraling. Dell says organizations that shift those workloads to local hardware…