Nvidia, Microsoft Working to Build Massive AI Computer Which Will Operate on Azure Cloud

Nvidia said Azure would be the first public cloud to use its Quantum-2 InfiniBand networking technology.

By Reuters | Updated: 16 November 2022 21:21 IST

Nvidia, Microsoft Working to Build Massive AI Computer Which Will Operate on Azure Cloud

Photo Credit: Reuters

Nvidia would also be a customer of Microsoft’s AI cloud computer

Highlights

The AI computer will use Nvidia's most powerful H100 and A100 chips
Nvidia declined to say how much the deal is worth
Nvidia will develop AI applications on Microsoft to offer services

The US chip designer and computing firm Nvidia on Wednesday said it is teaming up with Microsoft to build a “massive” computer to handle intense artificial intelligence computing work in the cloud.

The AI computer will operate on Microsoft's Azure cloud, using tens of thousands of graphics processing units (GPUs), Nvidia's most powerful H100 and its A100 chips. Nvidia declined to say how much the deal is worth, but industry sources said each A100 chip is priced at about $10,000 (nearly Rs. 8,14,700) to $12,000 (nearly Rs. 9,77,600), and the H100 is far more expensive than that.

“We're at that inflection point where AI is coming to the enterprise and getting those services out there that customers can use to deploy AI for business use cases is becoming real,” Ian Buck, Nvidia's general manager for Hyperscale and HPC told Reuters. “We're seeing a broad groundswell of AI adoption... and the need for applying AI for enterprise use cases.”

In addition to selling Microsoft the chips, Nvidia said it will partner with the software and cloud giant to develop AI models. Buck said Nvidia would also be a customer of Microsoft's AI cloud computer and develop AI applications on it to offer services to customers.

The rapid growth of AI models such as those used for natural language processing have sharply boosted demand for faster, more powerful computing infrastructure.

Nvidia said Azure would be the first public cloud to use its Quantum-2 InfiniBand networking technology which has a speed of 400Gbps. That networking technology links servers at high speed. This is important as heavy AI computing work requires thousands of chips to work together across several servers.

© Thomson Reuters 2022

Is the new expensive 10th generation iPad worth buying instead of its predecessor? We discuss this on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.