AMD launches the Instinct MI350P GPU with 144GB of HBM3E and a 600W TBP

Today, AMD unveiled its new Instinct MI350P GPU accelerator, targeted at AI workloads. The company is marketing the MI350P as a cost-effective, drop-in upgrade for companies that want to expand their AI infrastructure. The MI350P is a dual-slot PCIe GPU accelerator that can be easily installed in existing air-cooled servers without extensive reconfiguration.

The key marketing point is definitely its PCIe form factor and relatively affordable price. AMD, in its press release, is directly targeting enterprises that want to adopt AI without having to invest heavily in new infrastructure. The company is offering air-cooled systems with up to eight Instinct MI350P accelerator cards, designed for small and medium-sized AI deployments.

3

Under the hood, the Instinct MI350P has 128 compute units, equaling 8,192 stream processors, along with 512 Matrix cores. The GPU uses the CDNA 4 architecture built on TSMC's 3nm production process. The core is in a 4-XCD configuration, boosting to 2200 MHz. The single I/O die is based on TSMC's 6nm FinFET process, and the GPU also houses 128MB of LLC in the form of Infinity Cache.

The GPU is paired with 144GB of HBM3E memory at 4 TB/s using a 8192-bit bus. In terms of power, AMD has rated the card at a TBP (total board power) of 600W, but it can be configured down to 450W if needed. The card receives power through a 16-pin connector and uses the PCIe Gen 5 host interface.

3

With those specs, the MI350P PCIe GPU delivers an estimated 2,299 teraflops (TFLOPS) of performance, peaking at 4,600 TFLOPS at MXFP4, the highest performance currently available in an enterprise PCIe card. The accelerator card also supports native MXFP6 and MXFP4 at lower precision, and provides sparsity support for most mainstream 8 and 16-bit precisions.

AMD also claims to offer a fully open ecosystem with an Enterprise-Ready AI software stack and ROCm support. Looking at the enterprise GPU market, the MI350P is poised to go head-to-head with NVIDIA's H200 NVL PCIe card based on the Hopper architecture with 141GB of HBM3E memory.

AMD says that the Instinct MI350P PCIe GPUs are now available across a variety of partners.