Nvidia dominated the AI arena in 2024, with shipments of its Hopper GPUs more than tripling to over two million among its 12 largest customers, according to estimates from Omdia.
Omdia's estimates tracked MI300X shipments across four vendors – Microsoft, Meta, Oracle, and GPU bit barn TensorWave – which totaled 327,000.AMD's ramp is no less notable as its MI300-series accelerators have only been on the market for a year now. Prior to that, AMD's GPUs were predominantly used in more traditional high-performance computing applications like Oak Ridge National Laboratory's 1.35 exaFLOPS Frontier supercomputer.
The MI300X boasts 5.3 TBps of memory bandwidth, versus 3.3 TBps on the H100 and 4.8 TBps for the 141 GB H200. Together, this means that the MI300X should in theory be able to serve larger models faster than Nvidia's Hopper GPUs. Going into the New Year, Galabov believes that AMD has an opportunity to gain even more share."AMD executes well. It communicates well with clients, and it's good at talking about its strengths and its weaknesses transparently," he said.
Best Omdia can figure, Google placed orders for about a million TPU v5e and 480,000 TPU v5p accelerators this year.