Brussels / 1 & 2 February 2025

schedule

EuroHPC FP: a Federated Platform for HPC Infrastructure in Europe, Built with Open Source Software


Currently a scientist being granted compute resource from the EuroHPC JU can expect to create fully separate accounts and projects through completely different processes for each supercomputer they need to access. Various machines also provide differing levels of features for novice users or users whose field of science has been historically less "low-level HPC" oriented. All this combined creates extra work and a higher barrier to entry to the users in need of compute resources.

We present the EuroHPC federation platform which once completed will provide users with a single federated identity across all EuroHPC JU Supercomputers; uniform access both via the command line and web browser; and advanced features like interactive graphical usage, multi-machine workflows and a common software stack across all machines.

The platform place a great emphasis on modularity and open-source technologies, with most of the core functionality being based on open-source components. Key components include:

  • Waldur: Allocating, managing, and monitoring of the resources integrated with the platform (https://waldur.com)
  • LEXIS: Automatized workflows across Cloud and HPC systems (https://docs.lexis.tech/)
  • Open OnDemand: Graphical web interface providing interactive applications and file management across the federated resources (https://openondemand.org)
  • European Environment for Scientific Software Installations (EESSI): Shared stack of optimized scientific software installations (https://www.eessi.io)
  • Authentication and Authorization Infrastructure (AAI) leveraging MyAccessID: SSH Certificate Authorities for access (https://wiki.geant.org/display/MyAccessID)

The talk presents the architecture for the federation platform and how it leverages open-source to achieve the lofty goals.

Speakers

Sebastian von Alfthan