AWS Unveils 192-Core Graviton5 Server Processor

AWS and Annapurna Labs debut the Graviton5, a 3nm chiplet-based processor with 192 Arm V3 cores for server and AI inferencing workloads.

Designed by Annapurna Labs, the AWS Graviton5 is an in-house server processor built for infrastructure and AI inferencing. The package features four chiplets manufactured on the TSMC 3 nm node, delivering a total of 192 Arm V3 performance cores. Each core includes 1 MB of dedicated cache, while the chiplets maintain full cache coherency via a 420 GB/s die-to-die interconnect. Hardware specifications include a 12-channel DDR5 memory interface supporting speeds up to DDR5-8800 and over 800 GB/s of bandwidth. Connectivity is handled by a 96-lane PCI-Express Gen 6 root complex. Each individual chiplet houses 48 cores, a 3-channel memory controller, and 24 PCIe lanes. AWS targets a 25% performance gain over G4 instances powered by Intel Xeon Cascade Lake or AMD EPYC Genoa processors.