...
Mellanox Infiniband or Cornelis Networks OmniPath? You know OmniPath from Ollie. We have mixed experiences. The MPI performance is very good for the typical codes at AWI, however, Intel declared it deprecated and as a consequence, bugs in BeeGFS in the interplay with OmniPath were never fixed. At the time of the procurement, Infiniband was the only option. However, as NVIDIA acquired Mellanox, Intel decided to revive OmniPath with a spin-off, Cornelis Networks. Due to NVIDIA's policy and the long delays to obtain the infiniband hardware, OmniPath with similar performance seems to have a good new start and is already part of new installations. However, NEC is careful and they will test OmniPath thoroughly in new hardware at their test center before they give a recommendation for Albedo. Differences matter: OmniPath puts more load onto the CPUs of the compute nodes and file servers, but comes with better latencies in return. Also, internal configuration options differ.