Intel Xeon CPU Max Series

Overview:

Over the last decade, peak compute has increased significantly as has the integration of AI, but workload performance hasn’t kept pace due to inefficiencies in feeding the cores with data. The Intel Xeon CPU Max Series supercharges the Intel® Xeon® platform and is the only x86-based processor with high bandwidth memory architected to unlock and accelerate memory-bound HPC and AI workloads.

From weather forecasting, to human genome mapping and helping to cure the world’s deadliest diseases, to designing more energy-efficient materials, high-performance computing (HPC) touches every part of our lives. Advances in HPC and AI drive competitiveness and bring scientific computing demand to new heights, but there is no one-size-fits-all solution. There is incredible diversity in traditional HPC software, and if you look at common workloads by vertical and characteristic, some are memory bound. Others are compute bound. Some have small kernels with a lot of control flow. Others have large, data-parallel kernels. Most involve extremely large data sets.

The Intel Xeon CPU Max Series supercharges Intel Xeon Scalable processors with high bandwidth memory (HBM) and is architected to unlock performance and speed discoveries in data-intensive workloads, such as modeling, artificial intelligence, deep learning, high performance computing (HPC) and data analytics.

Key Features

Reduce the bottlenecks of memory-bound applications to deliver breakthrough performance with:

30+ Customer Designs

Channel Partners

¹ Visit intel.com/performanceindex (Events: Supercomputing 22) for workloads and configurations. Results may vary.
² 2S Intel Xeon Max CPU vs. 2S AMD EPYC 7773X and 2S 3rd Gen Intel® Xeon® 8380
³ Numenta BERT-Large AMD Milan: Tested by Numenta as of 11/28/2022. 1-node, 2x AMD EPYC 7R13 on AWS m6a.48xlarge, 768 GB DDR4-3200, Ubuntu 20.04 Kernel 5.15, OpenVINO 2022.3, BERT-Large, Sequence Length 512, Batch Size 1. Intel® Xeon® 8480+: Tested by Numenta as of 11/28/2022. 1-node, 2x Intel® Xeon® 8480+, 512 GB DDR5-4800, Ubuntu 22.04 Kernel 5.17, OpenVINO 2022.3, Numenta-Optimized BERT-Large, Sequence Length 512, Batch Size 1. Intel® Xeon® Max 9468: Tested by Numenta as of 11/30/2022. 1-node, 2x Intel® Xeon® Max 9468, 128 GB HBM2e 3200 MT/s, Ubuntu 22.04 Kernel 5.15, OpenVINO 2022.3, Numenta-Optimized BERT-Large, Sequence Length 512, Batch Size 1.
⁴ On pre-production silicon on Crossroads. View https://arxiv.org/abs/2211.05712 for workloads and configurations. Results may vary.

Features:

Maximize performance with improved bandwidth

The Intel Xeon CPU Max Series features a new microarchitecture and supports a rich set of platform enhancements, including increased core counts, advanced I/O and memory subsystems, and built-in accelerators that will speed delivery of life-changing discoveries. Intel Max Series CPUs feature:

• Up to 56 performance cores constructed of four tiles and connected using Intel’s embedded multi-die interconnect bridge (EMIB) technology, in a 350-watt envelope.
• 64 GB of high bandwidth in-package memory, as well as PCI Express 5.0 and CXL 1.1 I/O. Xeon Max CPUs will provide memory (HBM) capacity per core, enough to fit most common HPC workloads.
• Up to 20x performance speed-up on Numenta AI technology for natural language processing (NLP) with HBM compared to other CPUs.

Accelerate scientific innovation

Enable fast discoveries and more effective research. With the Intel Xeon CPU Max Series and 4th Gen Intel Xeon Scalable processors, you gain the performance and power efficiency required for the most challenging workloads and the most built-in accelerators of any CPU on the market. Achieve more efficient CPU utilization, lower electricity consumption and higher ROI with key accelerators for HPC and AI workloads, including:

• Intel Advanced Matrix Extensions (Intel AMX) — Significantly accelerate deep learning inference and training on the CPU with Intel AMX, which boosts AI performance and delivers 8x peak throughput over AVX-512 for INT8 with INT32 accumulation operation.
• Intel Data Streaming Accelerator (Intel DSA) — Drive high performance for data-intensive workloads by improving streaming data movement. With Intel® DSA, achieve up to 79% higher storage I/O per second (IOPS) with as much as 45% lower latency when using NVMe over TCP.4
• Intel Advanced Vector Extensions 512 (Intel AVX-512) — Accelerate performance with vectorization to contribute faster calculations on larger data sets for scientific simulations, AI/deep learning, 3D modeling and analysis, and other intensive workloads. Intel AVX-512 is the latest x86 vector instruction set to accelerate performance for your most demanding computational tasks.
• I/O and memory subsystem advancements including:
  • DDR5 — Improve compute performance by overcoming data bottlenecks with higher memory bandwidth. DDR5 offers up to 1.5x bandwidth improvement over DDR4.4
  • PCI Express Gen 5 (PCIe 5.0) — Unlock new I/O speeds with opportunities to enable the highest possible throughput between the CPU and devices. 4th Gen Intel Xeon Scalable and Intel Xeon Max Series processors have up to 80 lanes of PCIe 5.0, double the I/O bandwidth of PCIe 4.0.4
  • Compute Express Link (CXL) 1.1 — Gain support for high-fabric bandwidth and attached accelerator efficiency.
• Easy integration on Intel Xeon platforms — Easily add Max Series CPUs to 4th Gen Intel Xeon Scalable platforms by leveraging the same socket configuration resulting in no code changes on most deployments.

Specifications:

Product Name	# of Cores	Max Turbo Frequency	Processor Base Frequency	Cache	TDP
Intel Xeon CPU Max 9462 Processor (75M Cache, 2.70 GHz)	32	3.50 GHz	2.70 GHz	75 MB	350 W
Intel Xeon CPU Max 9480 Processor (112.5M Cache, 1.90 GHz)	56	3.50 GHz	1.90 GHz	112.5 MB	350 W
Intel Xeon CPU Max 9470 Processor (105M Cache, 2.00 GHz)	52	3.50 GHz	2.00 GHz	105 MB	350 W
Intel Xeon CPU Max 9460 Processor (97.5M Cache, 2.20 GHz)	40	3.50 GHz	2.20 GHz	97.5 MB	350 W
Intel Xeon CPU Max 9468 Processor (105M Cache, 2.10 GHz)	48	3.50 GHz	2.10 GHz	105 MB	350 W