Microsoft Switches Off Oracle-Leased AI Servers as GPU Generations Turn Over
Microsoft declined to renew a 2023 Oracle contract built around Bing and is switching off the rented AI servers, because Oracle's hardware ran older-generation Nvidia chips that no longer matched Microsoft's specs. Under per-GPU-hour pricing, a Blackwell GPU delivers several times the inference output of an H100, so Hopper and Ampere hours now buy far less work. The move highlights how frontier mixture-of-experts models, with heavy memory and interconnect demands, are pushing AI capacity procurement from single-GPU performance toward rack-scale systems.
Full Report
Rohan Paul (@rohanpaul_ai) · 2026-11-06 19
Bloomberg: Microsoft is switching off AI servers it rented from Oracle after declining to renew a 2023 contract built around Bing.
The capacity lost value over time because Oracle’s hardware ran older-generation Nvidia chips that no longer matched Microsoft’s specifications, according to people familiar with the matter.
Basically, Microsoft pays per GPU-hour. A Blackwell GPU produces several times more inference output than an H100 for similar power, so each Hopper or Ampere hour now buys far less work.
Current frontier models, often large mixture-of-experts designs, need lots of memory and fast links between GPUs. An H100 has 80GB of memory and talks quickly to only 8 GPUs in its server. Blackwell racks link 72 GPUs as one unit, with 192 to 288GB each. Big models either don’t fit on the old boxes or run slowly across their slower network.
Oracle says demand for its AI infrastructure remains strong, and in September it renewed contracts for 4-year-old GPUs at a 20% premium to the original price.
