Nvidia CEO Says ‘Reasoning’ AI Will Depend on Cheaper Computing

Nvidia is facing attempts to loosen its grip on the market with data center operators like AWS and Microsoft developing in-house alternatives.

By Ian King, Bloomberg | Updated: 10 October 2024 19:27 IST

Nvidia CEO Says ‘Reasoning’ AI Will Depend on Cheaper Computing

Photo Credit: Reuters

Advanced Micro Devices, already an Nvidia rival in gaming chips, has emerged as an AI contender

Highlights

Nvidia CEO bets big on AI services that can reason
Jensen Huang said he uses ChatGPT everyday
Nvidia is planning to boost its chip performance every year

Nvidia Chief Executive Officer Jensen Huang said that the future of Artificial Intelligence (AI) will be services that can “reason,” but such a stage requires the cost of computing to come down first.

Next-generation tools will be able to respond to queries by going through hundreds or thousands of steps and reflecting on their own conclusions, he said during a podcast hosted by Arm Holdings Plc CEO Rene Haas. That will give this future software the ability to reason and set it apart from current systems such as OpenAI's ChatGPT, which Huang said he uses every day.

Nvidia will set the stage for these advances by boosting its chip performance every year by two to three times, at the same level of cost and energy consumption, Huang said. This will transform the way AI systems handle inference — the ability to spot patterns and draw conclusions.

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

“We're able to drive incredible cost reduction for intelligence,” he said. “We all realize the value of this. If we can drive down the cost tremendously, we could do things at inference time like reasoning.”

The Santa Clara, California-based company has more than 90 percent of the market for so-called accelerator chips — processors that speed up AI work. It has also branched out to selling computers, software, AI models, networking and other services — part of a push to get more companies to embrace artificial intelligence.

Nvidia is facing attempts to loosen its grip on the market. Data center operators such as Amazon.com Inc.'s AWS and Microsoft are developing in-house alternatives. And Advanced Micro Devices, already an Nvidia rival in gaming chips, has emerged as an AI contender. AMD plans to share the latest on its AI products at an event Thursday.

Nvidia's Market Value Tumbles by $279 Billion as Wall Street Drops

(This story has not been edited by NDTV staff and is auto-generated from a syndicated feed.)

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.