Nvidia's GTC Summit Becomes Referendum on AI Spending Boom as Inference Era Looms

Nvidia's annual GTC conference has evolved from a developer gathering into a high-stakes forum where the chipmaker must justify the AI industry's unprecedented capital spending cycle. This year's event carries added weight after a blockbuster earnings report failed to move the company's stock, raising questions about investor confidence in the durability of data center buildouts.

Analysts expect Huang to address the industry's pivot toward inference—running trained AI models—where Nvidia faces intensifying competition from cloud providers and specialized startups. The Wall Street Journal reported in February that Nvidia is preparing an inference-focused product incorporating technology from AI startup Groq, with OpenAI expected as a key customer. The chip's design could signal a strategic shift away from high-bandwidth memory, which remains in tight supply, toward SRAM-based architectures more common in inference workloads.

The conference also serves as a proving ground for Nvidia's next-generation Rubin Ultra systems, which are expected to demand significantly more power than previous architectures. Investors will scrutinize whether hyperscale cloud providers are willing to support the transition, according to William Blair analyst Sebastien Naji. Nvidia has invested $2 billion each in laser manufacturers Lumentum and Coherent, betting on co-packaged optics to speed chip-to-chip communication inside massive data centers, though production volumes remain far below current chip shipments.

"Inference is a different ballgame," said Sid Sheth, founder and CEO of inference chip startup d-Matrix. He argued that CUDA, Nvidia's software moat that has locked developers into its ecosystem for training workloads, holds less sway in inference markets where running finished models requires different programming approaches.

The broader AI chip market is expected to continue growing, but analysts told Reuters that Nvidia's share may shrink as the industry shifts toward AI agents that move between applications performing tasks autonomously. This architectural change favors specialized inference chips over the massive GPU clusters used to train foundation models.

(Nvidia's GTC conference has expanded beyond its traditional developer audience, with past events featuring Denny's pop-ups and Taiwan-inspired night markets. Polymarket users are wagering on how many times Huang will say "GPU" onstage.)

Nvidia's dominance in AI training remains largely unchallenged, but the inference market represents a structural shift in how AI workloads are deployed. Cloud giants including Amazon, Google, and Microsoft have all announced custom inference chips, while a wave of venture-backed startups targets specific inference use cases. The emergence of AI agents and orchestration layers—middleware that manages fleets of autonomous agents—could further fragment demand away from general-purpose GPUs.

The U.S. power industry is embarking on an AI-driven grid expansion that promises to be one of the most expensive infrastructure projects since World War II, with costs shared between power-hungry AI companies and consumers. Nvidia's ability to demonstrate energy-efficient architectures at GTC will influence whether utilities and regulators continue supporting data center growth at current rates.