Unveiling the Future of AI: How Microsoft & Nvidia Collaborate on an Incredible Cloud-Based Supercomputer

Mimi Thian/Unsplash

Nvidia and Microsoft announced Wednesday a multi-year collaboration to build an AI supercomputer in the cloud, adding tens of thousands of Nvidia GPUs to Microsoft Azure .

Featured

How to disable ACR (and greatly reduce ads) on every TV model - and why you should
I replaced my Samsung Galaxy S24 Ultra with the Pixel 9 Pro XL for two weeks - and can’t go back
Linus Torvalds talks AI, Rust adoption, and why the Linux kernel is ‘the only thing that matters’
The best mini PCs you can buy: Expert recommended

The new agreement makes Azure the first public cloud to incorporate Nvidia’s full AI stack – its GPUs, networking, and AI software.

By beefing up Azure’s infrastructure with Nvidia’s full AI suite, more enterprises will be able to train, deploy, and scale AI – including large, state-of-the-art models.

“AI technology advances as well as industry adoption are accelerating,” Manuvir Das, Nvidia’s VP of enterprise computing, said in a statement. “The breakthrough of foundation models has triggered a tidal wave of research, fostered new startups, and enabled new enterprise applications.”

Also: 8 ways to reduce AI burnout

Azure instances already feature Nvidia A100 GPUs paired with Nvidia Quantum 200Gb/s InfiniBand networking. Future instances will be integrated with Nvidia H100 GPUs and Nvidia Quantum-2 400Gb/s InfiniBand networking.

Newsletters

ZDNET Week in Review

Too busy for a daily newsletter? ZDNET’s Week in Review delivers our editors’ picks of the week’s most important innovation and technology stories.

See all

Meanwhile, Nvidia’s software suite, Nvidia AI Enterprise, is certified and supported on Microsoft Azure instances with A100 GPUs. Support for Azure instances with H100 GPUs will be added in a future software release.

Azure enterprise customers will also get access to Nvidia’s full stack of AI workflows and software development kits, optimized for Azure. The companies will also collaborate to optimize Microsoft’s DeepSpeed deep learning optimization software.

The new deal also gives Nvidia the chance to use Azure VMs to advance its research in generative AI.