Nvidia H100 Chip Unveiled, Touted as ‘Engine’ of AI Infrastructure

The H100 will be used to build Nvidia's new Eos supercomputer.

By Reuters | Updated: 23 March 2022 14:08 IST

Nvidia H100 Chip Unveiled, Touted as ‘Engine’ of AI Infrastructure

Photo Credit: Reuters

Nvidia also introduced a new Grace CPU Superchip that is based on Arm technology

Highlights

The announcements were made at Nvidia's AI developers conference online
Nvidia H100 chip has been touted as the "engine" of AI infrastructure
Meta announced it would build world's fastest AI supercomputer this year

Nvidia's graphic chips (GPU), which initially helped propel and enhance the quality of videos in the gaming market, have become the dominant chips for companies to use for AI workloads. The latest GPU, called the H100, can help reduce computing times from weeks to days for some work involving training AI models, the company said.

The announcements were made at Nvidia's AI developers conference online.

"Data centres are becoming AI factories — processing and refining mountains of data to produce intelligence," said Nvidia Chief Executive Officer Jensen Huang in a statement, calling the H100 chip the "engine" of AI infrastructure.

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

Companies have been using AI and machine learning for everything from making recommendations of the next video to watch to new drug discovery, and the technology is increasingly becoming an important tool for business.

The H100 chip will be produced on Taiwan Manufacturing Semiconductor Company's cutting edge four nanometer process with 80 billion transistors and will be available in the third quarter, Nvidia said.

The H100 will also be used to build Nvidia's new "Eos" supercomputer, which Nvidia said will be the world's fastest AI system when it begins operation later this year.

Nvidia Says It's Investigating a Potential Cyberattack

Facebook parent Meta announced in January that it would build the world's fastest AI supercomputer this year and it would perform at nearly 5 exaflops. Nvidia on Tuesday said its supercomputer will run at over 18 exaflops.

Exaflop performance is the ability to perform 1 quintillion — or 1,000,000,000,000,000,000 - calculations per second.

Nvidia also introduced a new processor chip (CPU) called the Grace CPU Superchip that is based on Arm technology. It's the first new chip by Nvidia that uses Arm architecture to be announced since the company's deal to buy Arm fell apart last month due to regulatory hurdles.

Nvidia, Jaguar Land Rover Ally in Vehicle Software Arms Race

The Grace CPU Superchip, which will be available in the first half of next year, connects two CPU chips and will focus on AI and other tasks that require intensive computing power.

More companies are connecting chips using technology that allows faster data flow between them. Earlier this month Apple unveiled its M1 Ultra chip connecting two M1 Max chips.

Nvidia said the two CPU chips were connected using its NVLink-C2C technology, which was also unveiled on Tuesday.

Nvidia May Scrap $40-Billion Acquisition of Arm: Here's Why

Nvidia, which has been developing its self-driving technology and growing that business, said it has started shipping its autonomous vehicle computer "Drive Orin" this month and that Chinese electric vehicle maker BYD and luxury electric car maker Lucid would be using Nvidia Drive for their next generation fleets.

Danny Shapiro, Nvidia's vice president for automotive, said there was $11 billion (roughly Rs. 83,827 crore) worth of automotive business in the "pipeline" in the next six years, up from $8 billion (roughly Rs. 60,970 crore) that it forecast last year. The growth in anticipated revenue will come from hardware and from increased, recurring revenue from Nvidia software, said Shapiro.

Nvidia shares were relatively flat in midday trade.

Asus India's Arnold Su joins this week's Orbital, the Gadgets 360 podcast, to talk about how the PC maker is planning to grow its presence in the country. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.