LUMI’s Full System Architecture Revealed

November 22, 2021 / Internal News
asd

“The AMD MI250X GPU is in a class of its own now and for a long time to come. The technical supremacy and performance per watt were the primary reasons why AMD’s MI250X GPUs were selected for LUMI,” explains Pekka Manninen, Director of LUMI Leadership Computing Facility.

The full system architecture of LUMI is the following:

  • The LUMI system is supplied by Hewlett Packard Enterprise (HPE), based on an HPE Cray EX supercomputer.
  • The GPU partition will consist of 2560 nodes, each node with one 64 core AMD Trento CPU and four AMD MI250X GPUs.
  • Each GPU node features four 200 Gbit/s network interconnect cards, i.e. has 800 Gbit/s injection bandwidth.
  • Each MI250X GPU consists of two compute dies, each with 110 compute units each, and each compute unit has 64 stream processors for a total of 14080 stream processors.
  • The committed Linpack performance of LUMI-G is 375 Pflop/s.
  • The MI250X GPU comes with a total of 128 GB of HBM2e memory offering over 3.2 TB/s of memory bandwidth.
  • A single MI250X card is capable of delivering 42.2 TFLOP/s of performance in the HPL benchmarks.
  • In addition to the GPUs in LUMI there is another partition (LUMI-C) using CPU only nodes, featuring 64-core 3rd-generation AMD EPYC™ CPUs, and between 256 GB and 1024 GB of memory. There are 1,536 dual-socket CPU nodes in total. LUMI-C was #5 on the November 2021 Graph500 list and #76 on the November 2021 Top500 list.
  • LUMI also has a partition with large memory nodes, with a total of 32 TB of memory in the partition.
  • When completed LUMI will take over 150m2 of space, which is about the size of a tennis court. The weight of the system is nearly 150 000 kilograms (150 metric tons).

Click here to read more.