Hot on the heels of Nvidia’s latest GPU launch, Intel has teased the Gaudi3 processor — an AI accelerator with in-built memory to rival the H100 – one of the best graphics cards.
The 5nm Gaudi3, the successor to the 7nm deep learning training processor Gaudi2, has four-times brain floating 16 (BF16) power, twice the networking power and 1.5-times the bandwidth of high-bandwidth memory, according to Serve the Home.
The component, which is set to launch in 2024, will be fitted with up to 128GB HBM3e RAM, the publication estimates, which would trounce its predecessor’s 96GB HBM2e on-board memory and lead to serious performance gains in AI learning and training.
New Intel chips to rival Nvidia
It’s effectively Intel’s answer to the GH200 superchip, which is fitted with 141GB of HBM3e memory that accompanies Nvidia’s latest GPU. With Gaudi2 in the same ballpark as the H100 – it’s likely Gaudi3 will boast performance levels in the same region as the H200.
Intel teased the capabilities of its Gaudi3 chip alongside the Intel Max Series 1550 graphics card, which is fitted into the newly online Aurora supercomputer. This is the second ever exascale supercomputer, and will likely be the most powerful of all time once it’s fully tuned.
It’s widely expected to outpace the Frontier supercomputer once it’s fully up to speed and reach performance levels of up to two exaFLOPs — approximately two billion, billion calculations per second.
This is vastly more powerful at handling AI training workloads than comparable systems fitted with AMD and Nvidia GPUs, according to the company.
The Intel Max 1550 GPU registered a score of 48.4 samples per second when put through the CosmicTagger single GPU training throughput benchmark, with AMD’s MI250 and Nvidia’s A100 scoring 31.2 and 14.7 respectively.
This is comporable to figures registered in the CosmicTagger single node training benchmark, with Intel’s GPU scoring 280 samples per second vs 120 and 54.9 for AMD and Nvidia’s GPUs respectively.
Although there aren’t comparable benchmarking figures available for Nvidia’s H100 or H200 GPUs, these results make the Intel Max 1550 a more than competent candidate to power systems that run AI training and inference workloads.
More from TechRadar Pro
Today’s best Black Friday deals
Gigabyte G5: now $799.99 at Best Buy (was $1,099.99)
This Gigabyte G5 pairs a 12th Gen Intel CPU with an Nvidia GeForce RTX 4060, getting you to the crucial 8GB VRAM threshhold. You’ll also get 16GB of system memory and 512GB of storage, which is pretty great for this price.View Deal
Gigabyte G5 RTX 4060: $1,099 $799 @ Best Buy
Save $300 on the Gigabyte G5 with Nvidia’s powerful GeForce RTX 4060 GPU inside. Gigabyte manufactures some of the industry’s best gaming laptops and the G5 aims to elevate your gameplay. Though we didn’t take this laptop for a spin, Gigabyte G5 reviews from happy owners praise its performance and price point.
Features: 15.6-inch 1080p 144Hz display, Intel Core i7-12650H 12-core CPU, 16GB RAM, RTX 4060 GPU, 512GB SSD. View Deal