Intel Xeon 6 Processors and Gaudi 3 AI Accelerators With Ability to Handle Advanced AI Workloads Launched

Intel's Xeon 6 processor has P-cores and is claimed to offer twice the performance of its predecessor due to increased core count.

Written by Akash Dutta, Edited by David Delima | Updated: 26 September 2024 20:34 IST

Intel Xeon 6 Processors and Gaudi 3 AI Accelerators With Ability to Handle Advanced AI Workloads Launched

Photo Credit: Intel

Gaudi 3 AI Accelerator is currently being used by Dell Technologies and IBM

Highlights

Intel’s Gaudi 3 AI Accelerator offers up to 20 percent more throughput
Gaudi 3 is optimised for inference of LLaMa 2 70B
Xeon 6 processor is designed to power data centres

Intel recently unveiled new hardware focused at improving artificial intelligence (AI) workflows. The company introduced the Xeon 6 processor with new Performance-cores (P-cores) and Gaudi 3 AI Accelerator for enterprise customers and data centres on Tuesday. The chipmaker claims that the new hardware will offer both higher throughput and better cost optimisation to enable optimal performance per watt and lower total cost of ownership. These devices were launched to enable enterprises to handle the continuously increasing workload demands from more advanced AI models, according to the chipmaker.

Intel Xeon 6 Processor Launched

The chipmaker says that its new Intel Xeon 6 is equipped with Performance-cores. These processors are not meant for retail consumers and instead will power data centres for enterprises to help them run cloud servers.

Intel claims the Xeon 6 processor offers twice the performance of its predecessor due to increased core count. It also offers double the memory bandwidth and AI acceleration capabilities.

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

Since it is hardware-based acceleration, it can run support very large language models (LLMs) with ease. It can “meet the performance demands of AI from edge to data centre and cloud environments,” according to Intel.

Intel Unveils Gaudi 3 AI Accelerators

Gaudi 3 is a new-generation AI Accelerator from Intel. These are specialised hardware chips designed to help machines in speeding up AI tasks, especially those related to deep learning, machine learning, and neural networks. These include GPUs, Application-Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), and Neural Processing Units (NPUs).

The Gaudi 3 AI Accelerator features 64 Tensor processor cores and eight matrix multiplication engines (MMEs) which are designed to accelerate deep neural network computations. It sports 128GB of HBM2e memory for training and inference, and 24 200GB Ethernet ports that enable scaling up the servers.

Intel's new AI Accelerator is compatible with the PyTorch framework and advanced Hugging Face transformer and diffuser models. The company has already tied up with IBM to deploy Gaudi 3 for IBM Clouds. Dell Technologies is also using the infrastructure for its data centres.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Intel, AI, Artificial Intelligence

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More