AI hit the memory wall — now it needs a new context tier

As inference workloads evolve from discrete question-and-answer exchanges into persistent, multi-step agentic systems, GPU ...
Tech Times

OpenAI Halves Inference Costs With Software Alone: GPUs Drop to Hundreds

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...
Forbes

The $20 Billion Bet On Inference: What Every AI Infrastructure Team Needs To Get Right

Nvidia just paid $20 billion for Groq's inference technology in what is the semiconductor giant's largest deal ever. The question is: Why would the company that already dominates AI training pay this ...
Forbes

How AI Inference Can Unlock The Next Generation Of SaaS

Roman Chernin is the CBO and cofounder of AI infrastructure company Nebius. His career spans over 20 years in the tech industry. Every major advance in AI begins with model training, but the ...
VentureBeat

5% GPU utilization: The $401 billion AI infrastructure problem enterprises can't keep ignoring

For the last 24 months, one narrative justified every over-provisioned data center and bloated IT budget: the GPU scramble. Silicon was the new oil, and H100s traded like contraband. Reserve capacity ...
SiliconANGLE

QumulusAI and the shift from GPU scarcity to GPU efficiency

Neocloud provider QumulusAI announced today that it has secured more than $124 million in customer subscriptions for three-year terms with Hyperbolic and another leading artificial intelligence ...