AI hit the memory wall — now it needs a new context tier

As inference workloads evolve from discrete question-and-answer exchanges into persistent, multi-step agentic systems, GPU ...
Tech Times

OpenAI Halves Inference Costs With Software Alone: GPUs Drop to Hundreds

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...
Forbes

The $20 Billion Bet On Inference: What Every AI Infrastructure Team Needs To Get Right

Nvidia just paid $20 billion for Groq's inference technology in what is the semiconductor giant's largest deal ever. The question is: Why would the company that already dominates AI training pay this ...
Tech Times

Nvidia and AWS Deepen Ties to Speed AI Inference and Vector Search

Nvidia and AWS have expanded their partnership to make AI cheaper to run at production scale, detailed by Nvidia on June 24.
VentureBeat

5% GPU utilization: The $401 billion AI infrastructure problem enterprises can't keep ignoring

For the last 24 months, one narrative justified every over-provisioned data center and bloated IT budget: the GPU scramble. Silicon was the new oil, and H100s traded like contraband. Reserve capacity ...
SiliconANGLE

QumulusAI and the shift from GPU scarcity to GPU efficiency

Neocloud provider QumulusAI announced today that it has secured more than $124 million in customer subscriptions for three-year terms with Hyperbolic and another leading artificial intelligence ...