Technology

scale-up networking

1 synchronized story carry this tag.

Microsoft previews Maia 300 for 2027 inference deployments

Microsoft announced Azure Maia 300, a rack-scale inference system planned for production deployments beginning in 2027. A rack combines 96 accelerators, 27.6 terabytes of high-bandwidth memory and 1.7 petabytes per second of aggregate memory bandwidth at 167 kilowatts. Microsoft claims up to seven times Maia 200's rack-scale token throughput and more than 2.5 times its performance per watt.

Why it matters: A vertically designed accelerator, network, rack and software stack can change Azure inference capacity and economics. The announcement is planning evidence, however, not a purchasable service or delivered customer capacity.

Read storyOriginal source · blogs.microsoft.com