Product Details:
AMD INSTINCT MI350P AI GPU 144GB 8192 STREAM CORES MEMORY INTERFACE 4096 BIT HBM3E MEMORY BANDWIDTH 4TB/S PCIE GRAPHICS PROCESSING UNIT AI ACCELERATOR CARD - CDNA4 ARCHITECTURE PCI-E 5.0 X16 PASSIVE COOLING 600W MAX POWER ( 1 ) ONE 16 PIN PWR CONNECTOR ( 12P+4P ) - DUAL SLOT DIMENSIONS 10.5 INCH ( L )
MANUFACTURER: AMD
PART NUMBER: AMD MI350P
CONTENT INCLUDES: ( 1 ) ONE AMD INSTINCT MI350P AI GPU ACCELERATOR ONLY - NO CABLES INCLUDED
NOTE:
- PLEASE CONSULT YOUR IT CREATIONS REPRESENTATIVE FOR AVAILABLE OPTIONS
ENGINE SPECS:
ENGINE ARCHITECTURE: CDNA4
STREAM CORES: 8,192
MATRIX CORES: 512
COMPUTE UNITS: 128
GPU CLOCK: 1000 MHZ
BOOST CLOCK: 2200 MHZ
PEAK MICROSCALING FOUR BIT PRECISION MATRIX ( MXFP4 ) PERFORMANCE: 4.6 PFLOPS
PEAK MICROSCALING SIX BIT PRECISION MATRIX ( MXFP6 ) PERFORMANCE: 4.6 PFLOPS
PEAK MICROSCALING EIGHT BIT PRECISION MATRIX ( MXFP8 ) PERFORMANCE: 2.3 PFLOPS
PEAK OPEN COMPUTE PROJECT EIGHT BIT PRECISION MATRIX ( OCP-FP8 ) PERFORMANCE ( E5M2 / E4M3 ): 2.3 PFLOPS
PEAK OPEN COMPUTE PROJECT EIGHT BIT PRECISION MATRIX ( OCP-FP8 ) PERFORMANCE WITH STRUCTURED SPARSITY ( E5M2 / E4M3 ): 4.6 PFLOPS
PEAK HALF PRECISION MATRIX ( FP16 ): 1.15 PFLOPS
PEAK HALF PRECISION MATRIX ( FP16 ) WITH STRUCTURED SPARSITY: 2.3 PFLOPS
PEAK HALF PRECISION ( FP16 ): 72 TFLOPS
PEAK SINGLE PRECISION MATRIX ( FP32 ): 72 TFLOPS
PEAK SINGLE PRECISION ( FP32 ): 72 TFLOPS
PEAK DOUBLE PRECISION MATRIX ( FP64 ): 36 TFLOPS
PEAK DOUBLE PRECISION ( FP64 ): 36 TFLOPS
PEAK INT8 MATRIX: 2.3 POPS
PEAK INT8 MATRIX WITH STRUCTURED SPARSITY: 4.6 POPS
PEAK BFLOAT16 ( BF16 ) MATRIX: 1.15 PFLOPS
PEAK BFLOAT16 ( BF16 ) MATRIX WITH STRUCTURED SPARSITY: 2.3 PFLOPS
TRANSISTOR COUNT: 73 BILLION
MEMORY:
MEMORY CONFIGURATION: 144GB
LAST LEVEL CACHE ( LLC ): 128MB
MEMORY INTERFACE: HBM3E
INFINITY CACHE: YES
MEMORY INTERFACE WIDTH: 4096 BIT
MEMORY BANDWIDTH: 4,000GB/S ( 4TB/S )
MEMORY CLOCK: 2,000MHZ
ERROR CORRECTION CODE ( ECC ): YES ( FULL CHIP )
SUPPORT:
BUS SUPPORT: PCI-E 5.0
PHYSICAL BUS INTERFACE: PCI-E 5.0 X16 ( 128GB/S )
SUPPORTED TECHNOLOGIES: AMD CDNA 4 ARCHITECTURE, 4TH GEN AMD INFINITY ARCHITECTURE, AMD ROCm - ECOSYSTEM WITHOUT BOARDS, RAS SUPPORT, PAGE RETIREMENT, PAGE AVOIDANCE, SR-IOV, OPENMP, OPENCL, HIP, TENSORFLOW, PYTORCH, ONYX-RT, SGLANG, JAX, TRITON, KOKKOS, RAJA, PCI EXPRESS GEN5
OPERATING SYSTEM: LINUX X86 64 BIT
CONNECTIONS:
POWER CONNECTORS: ( 1 ) ONE 16 PIN ( 12P+4P )
THERMAL AND POWER SPECS:
TOTAL POWER CONSUMPTION ( W ): 450-600W ( CONFIGURABLE )
SYSTEM REQUIREMENTS:
RECOMMENDED PSU ( W ): 1000W
MEMORY SIZE: GREATER THAN OR EQUAL TO GPU MEMORY; TWICE THE GPU MEMORY IS RECOMMENDED
NOTE:
- THE RECOMMENDED POWER IS RATED AT A LOWER END CONFIGURATION. MID END TO HIGH END SYSTEM CONFIGURATION WILL REQUIRE A HIGHER WATTAGE PSU
- PLEASE CONSULT YOUR IT CREATIONS REPRESENTATIVE FOR AVAILABLE OPTIONS
COOLING SYSTEM:
- PASSIVE
FORM FACTOR:
- DUAL SLOT
DIMENSIONS:
- 4.4 INCH ( H ) X 10.5 INCH ( L )