Smart news for curious minds.

Nerd News Network
AI

The AI compute gap: Enterprises are buying infrastructure faster than they can measure what it costs

Across 107 enterprises, AI infrastructure spending is accelerating well ahead of the ability to see or steer its economics.

Lead image for “The AI compute gap: Enterprises are buying infrastructure faster than they can measure what it costs”.
Image: VentureBeat — AI
Share

Across 107 enterprises, AI infrastructure spending is accelerating well ahead of the ability to see or steer its economics.

The short version

  • Most organizations run their AI on a familiar base of hyperscalers and model-provider APIs, yet the next dollar is aimed at specialized compute almost none of them use today; a majority intend to switch or add providers within the year, many within a quarter.
  • The result is a compute gap — heavy, fast-moving investment running ahead of the visibility needed to control it.
  • The central finding is a compute gap — the distance between how aggressively enterprises are investing in AI infrastructure and how little of its economics they can see.

What happened

Meanwhile the compute already in place runs cold — 83% report GPU utilization of 50% or less — and fewer than half (44%) can rigorously track what their AI compute costs. Enterprises are buying more infrastructure faster than they can account for what they already own.

Why it matters

Enterprises are not settled on their infrastructure vendors, either: A clear majority (64%) plan to switch or add an infrastructure provider within twelve months, and 38% within the next quarter — unusually high churn intent for a category this foundational.

Summary by Nerd News Network. Read the full article at VentureBeat — AI via the links above and below.

Share