• Home
  • Ai
  • Ai News
  • Intel Xeon 6 Processors and Gaudi 3 AI Accelerators With Ability to Handle Advanced AI Workloads Launched

Intel Xeon 6 Processors and Gaudi 3 AI Accelerators With Ability to Handle Advanced AI Workloads Launched

Intel's Xeon 6 processor has P-cores and is claimed to offer twice the performance of its predecessor due to increased core count.

Intel Xeon 6 Processors and Gaudi 3 AI Accelerators With Ability to Handle Advanced AI Workloads Launched

Photo Credit: Intel

Gaudi 3 AI Accelerator is currently being used by Dell Technologies and IBM

Highlights
  • Intel’s Gaudi 3 AI Accelerator offers up to 20 percent more throughput
  • Gaudi 3 is optimised for inference of LLaMa 2 70B
  • Xeon 6 processor is designed to power data centres
Advertisement

Intel recently unveiled new hardware focused at improving artificial intelligence (AI) workflows. The company introduced the Xeon 6 processor with new Performance-cores (P-cores) and Gaudi 3 AI Accelerator for enterprise customers and data centres on Tuesday. The chipmaker claims that the new hardware will offer both higher throughput and better cost optimisation to enable optimal performance per watt and lower total cost of ownership. These devices were launched to enable enterprises to handle the continuously increasing workload demands from more advanced AI models, according to the chipmaker.

Intel Xeon 6 Processor Launched

 The chipmaker says that its new Intel Xeon 6 is equipped with Performance-cores. These processors are not meant for retail consumers and instead will power data centres for enterprises to help them run cloud servers.

Intel claims the Xeon 6 processor offers twice the performance of its predecessor due to increased core count. It also offers double the memory bandwidth and AI acceleration capabilities.

Since it is hardware-based acceleration, it can run support very large language models (LLMs) with ease. It can “meet the performance demands of AI from edge to data centre and cloud environments,” according to Intel.

Intel Unveils Gaudi 3 AI Accelerators

Gaudi 3 is a new-generation AI Accelerator from Intel. These are specialised hardware chips designed to help machines in speeding up AI tasks, especially those related to deep learning, machine learning, and neural networks. These include GPUs, Application-Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), and Neural Processing Units (NPUs).

The Gaudi 3 AI Accelerator features 64 Tensor processor cores and eight matrix multiplication engines (MMEs) which are designed to accelerate deep neural network computations. It sports 128GB of HBM2e memory for training and inference, and 24 200GB Ethernet ports that enable scaling up the servers.

Intel's new AI Accelerator is compatible with the PyTorch framework and advanced Hugging Face transformer and diffuser models. The company has already tied up with IBM to deploy Gaudi 3 for IBM Clouds. Dell Technologies is also using the infrastructure for its data centres.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Intel, AI, Artificial Intelligence
Akash Dutta
Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More
Dubai's VARA Announces Stricter Regulations for Crypto Marketing
Facebook Gadgets360 Twitter Share Tweet Snapchat LinkedIn Reddit Comment google-newsGoogle News

Advertisement

Follow Us
© Copyright Red Pixels Ventures Limited 2024. All rights reserved.
Trending Products »
Latest Tech News »