Additional InformationAs part of the Instinct MI350 Series, the AMD MI350P GPU features a PCIe 5.0 x16 interface and is a full-height, full-length, 2-slot design with passive cooling. It draws up to 600W typical board power (TBP), configurable down to 450W, via a 12V-2x6 connector. Its multi-chip design includes 4x accelerated compute dies and a single I/O die, delivering 128 compute units, 8,192 stream processors, and 512 matrix cores at a peak engine clock of 2,200 MHz. The GPU can also be partitioned into up to 4x instances of 36GB each.
The MI350P comes with 144GB of HBM3E memory spread across 4x HBM3E stacks. It uses a 4,096-bit interface and delivers up to 4 TB/s of memory bandwidth. The card also includes 128 MB of AMD Infinity Cache as a last-level cache. Full-chip ECC is supported, along with page retirement and page avoidance.
- 4th Gen AMD CDNA architecture
- 144GB HBM3e
- 4 TB/s
- 4096 bits
- 128MB
- FHFL 2-slot PCIe CEM Card
- 600W (configurable to 450W)
- 1x PCIe Gen5 x16 (128 GB/s)
- Physical Partitions: Up to 4 @ 36GB
- Memory Partitions: 1
- 128
- 512
- 8192
- 2.2 GHz
- FP16 VECTOR (TFLOPS): 72
- FP16 VECTOR (TFLOPS) with Sparsity: N/A
- FP16 MATRIX (TFLOPS): 1150
- FP16 MATRIX (TFLOPS) with Sparsity: 2300
- BF16 (TFLOPS): 1150
- BF16 (TFLOPS) with Sparsity: 2300
- INT8 MATRIX (TOPS): 2300
- INT8 MATRIX (TOPS) with Sparsity: 4600
- MXFP8 (TFLOPS): 2300
- MXFP8 (TFLOPS) with Sparsity: N/A
- OCP-FP8 (TFLOPS): 2300
- OCP-FP8 (TFLOPS) with Sparsity: 4600
- MXFP6 (TFLOPS): 4600
- MXFP6 (TFLOPS) with Sparsity: N/A
- MXFP4 (TFLOPS): 4600
- MXFP4 (TFLOPS) with Sparsity: N/A
- FP64 VECTOR (TFLOPS): 36
- FP32 VECTOR (TFLOPS): 72
- FP64 MATRIX (TFLOPS): 36
- FP32 MATRIX (TFLOPS): 72
- 2 groups for HEVC/H.265,AVC/H.264, VP9, or AV1
- 20 cores, 10 cores per group
- TSMC 3nm/6nm FinFET
- 1
- Full-chip ECC memory, page retirement, page avoidance