Meta and AWS sign agreement to deploy AWS Graviton chips to power Agentic AI

Meta continues to bet heavily on Agentic AI, as the company has signed an agreement with Amazon to deploy AWS Graviton processors at scale. In late February, Meta signed a deal with AMD to deploy 6 gigawatts of AI hardware. In March, Arm released the Arm AGI CPU for Agentic AI, built in collaboration with Meta. The new partnership with AWS is another step in the same direction for the company.

Recently, we have been seeing a significant shift in the compute demands for Agentic AI workloads. While GPUs remain the dominant force behind most AI workloads, CPUs are slowly gaining significance, thereby increasing demand. This is why Meta is now partnering with Amazon's AWS to deploy tens of millions of Graviton cores to its compute portfolio.

The Graviton5 chip is a 192-core chip built on the AWS Nitro System and features a cache that is five times larger than its previous generation. AWS claims an "up to 33%" improvement in core-to-core latency, greater bandwidth, and the ability for Meta to run its own virtual machines without compromises to performance or security.

The official Amazon AWS announcement goes on to claim that Graviton5 is built on a 3nm production process, with AWS controlling the entire production process from design to the final rollout. This translates into more granular control over the chip's performance, efficiency, compatibility, and optimization, which other competing Agentic AI chips can't match. The claimed performance improvement over the previous generation is 25%, though that will need to be verified by third-party sources first.

Regardless, this deal is quite significant for both Meta and AWS as it makes Meta one of the largest Graviton customers in the world. We have recently seen Google and Intel join forces to deploy Intel Xeon processors for AI workloads, and now a similar deal has been struck here. Meta has also partnered with Broadcom to develop custom AI silicon and has multiple MITA accelerators already deployed.