Along the front of the chassis there are 8x EDSFF E1.S hot-swap drive bays. Those drives are directly connected to an NVIDIA Conect-X-8 (CX8) mezzanine network card for super-fast data transfers. The unit features air cooling provided by 8x standard dual rotor cooling fans and Direct Liquid Cooling (DLC). This system is part of a fully configured rack solution, with servers, networking, power, and cooling infrastructure. At full scale per rack, up to 72x Blackwell ultra-GPUs are connected via NVLink at up to 1.8TB/s.
The Dell PowerEdge XE9712 AI Server offers high-performance dense compute for a rack-scale AI and high-performance computing applications including AI training and inference. As an OCP server, it enables rapid deployment and integration with a modular standards-based rack design. This system also provides operational efficiency with direct liquid cooling and integrated power delivery through an ORV3 compatible rack offering a blind connect Bus Bar for power delivery. This 1RU system is part of an integrated rack solution supported by the 48 Rack Unit (RU) IR9048 Orv3 rack.
For networking, there are four x16 CX8 ports and a 1G LAN on Motherboard (LOM) port. Management of the system is provided by Dell OpenManage and an integrated RJ45 dedicated iDRAC port, which can access an ASPEED AST2600 baseboard management controller (BMC). There is also a BMC-to-NVIDIA hardware management console (HMC) for hardware performance monitoring (HPM).
- 2x NVIDIA Grace with 72 cores per processor
DIMM Speed
- Up to 5200 MT/s
Memory Type
- LP DDR5X memory with error-correction code (ECC)
Memory Module Slots
- NA
Maximum RAM
- 480 GB of LP DDR5 memory with error-correction code (ECC) / CPU
- 288 GB HBM3e / GPU
Front Bays
- Up to 8x EDSFF E1.S hot-swappable NVMe drives
Boot Drives
- 1x M.2 Boot
- 4x Blackwell Ultra GPUs
- 900GB/s of coherent memory through NVLINK CPU-GPU interconnect
PCIe
- Up to 2x FHHL Gen5, front risers only
- 2x Mezzanine- Gen5/Gen6
PCIe Cards
- 1x BF3 SuperNIC Full Height Half Length
Network Options
- 1x 1GbE LOM
Front Ports
- 1x USB3
- 1x RJ45 Mgmt LAN
- 1x miniDP
- 1x USB2.0 Micro Type-B
- 1x 1Gb LOM
- IR9048 rack consists of Power Shelf 33kW (PS33) that supports 6 x 5500 W AC PSUs
- PS33 supplies up to 54 VDC to the XE9712 through Power bus bar located on IR9048 rack
- Air cooling
- Direct Liquid Cooling (DLC)
- 8x standard cooling fans
Embedded
- Aspeed AST2600 BMC DC-SCI compatible
- OpenBMC
Form Factor
- IR9048 is a 48 RU (Rack Units) rack
- Each XE9712 sled is 1 RU
Note: 1 RU = 1.75 in. (44.45 mm) height, and 9 in.(438 mm) width
Height: 90.3" (2294 mm)
Width: 29.52" (750 mm)
Depth: 47.24" (1200 mm)
Depth with Stabilizers: 57.75" (1340 mm)
Cabinet wet weight: 3505.35 pounds (1590 kg)
- IR9048 is a 48 RU (Rack Units) rack
- Each XE9712 sled is 1 RU
Note: 1 RU = 1.75" (44.45 mm) height, and 19" (482.6 mm) width