Compute Resources
This cluster configuration includes three server specifications. Detailed parameters are as follows:
Nvidia A100
| Category | Details |
|---|---|
| CPU | 2 Intel Xeon Platinum 8358 CPUs, 32 cores per CPU, 2.6GHz |
| Memory | 16 x 32GB 3200MHz DDR4 ECC REG memory modules |
| Hard drives | 2 x 480GB enterprise SSDs, 1 x 1.92TB NVMe SSD |
| RAID | 1 x high-performance 2GB cache RAID card with power-loss protection |
| Network | 2 or 4 Mellanox ConnectX®-6 VPI HDR 200Gb/s high-speed NICs; 2 x 10GbE ports with full original optical modules; 1 x 1GbE port (with integrated IPMI functionality) |
| GPU cards | 8 x NVIDIA A100 40GB GPU cards with NVLink interface |
| Single-card performance | FP16 peak performance: 312 TFLOPS |
| Whole-machine 8-card performance | FP16 peak performance: 2496 TFLOPS |
Cambricon MLU 290
| Category | Details |
|---|---|
| CPU | 2 Intel Xeon Platinum 8358 CPUs, 32 cores per CPU, 2.6GHz |
| Memory | 16 x 32GB 3200MHz DDR4 ECC REG memory modules |
| Hard drives | 2 x 480GB enterprise SSDs, 6 x 8TB enterprise SATA drives, 8 x 1.92TB NVMe SSDs |
| RAID | 1 x high-performance 2GB cache RAID card with power-loss protection |
| Network | 4 x Mellanox ConnectX®-6 VPI HDR 200Gb/s high-speed NICs 1 x Mellanox ConnectX®-6 VPI HDR100 100Gb/s high-speed NIC 2 x dual-port 25G Mellanox CX-5 NICs |
| GPU cards | 8 x Cambricon MLU290 intelligent accelerator cards |
| Single-card performance | INT8 peak performance: 512 TOPS |
| Whole-machine 8-card performance | INT8 peak performance: 4096 TOPS |
Cambricon MLU 270
| Category | Details |
|---|---|
| CPU | 2 Intel Xeon Platinum 8358 CPUs, 32 cores per CPU, 2.6GHz |
| Memory | 16 x 32GB 3200MHz DDR4 ECC REG memory modules |
| Hard drives | 2 x 480GB enterprise SSDs, 2 x 960GB enterprise SSDs, 6 x 8TB enterprise SATA drives |
| RAID | 1 x high-performance 2GB cache RAID card with power-loss protection |
| Network | 1 x Mellanox ConnectX®-6 VPI HDR100 100Gb/s high-speed NIC 2 x Mellanox CX-5 dual-port 25G Ethernet NICs |
| GPU cards | 8 x Cambricon MLU270-X5K intelligent accelerator cards, |
| Single-card performance | INT8 peak performance: 140 TOPS |
| Whole-machine 8-card performance | INT8 peak performance: 1120 TOPS |