Designed for next-generation supercomputers, the AMD Instinct MI300A APU is designed for applications in enterprise data centers to tackle the most profound computing quandaries. With 128GB of HBM3 memory it delivers and astounding 5.3TB of memory bandwidth at peak theoretical performance, with a memory interface of 8192 bits and a memory clock of 5.2TB. Scale out bandwidths supported include 400 Gb/s Ethernet or InfiniBand.
With air and liquid cooling a maximum thermal design power rating of 550W is recommended. All liquid cooling will increase the maximum TDP limit allowed to 760W. this APU is optimized AI applications delivering highly efficient data gathering delivering peak performance for FP64, FP32, FP16, BF16, TF32, FP8, and INT8 data types. It uses a chiplet technology to stack a multi-chip architecture enabling dense compute and high-bandwidth memory integration. In a multi-APU configuration, each APU can provide 1TB/s of bidirectional connectivity using 8x 128GB/s AMD Infinity Fabric interfaces. 4x Infinity Fabrics are dedicated, while 4x others can supplement the Infinity Fabric connection or be assigned to deliver PCIe 5.0 connectivity.