Brussels / 2 & 3 February 2019

schedule

Setting up an HPC lab from scratch

with Mr-Provisioner, Jenkins and Ansible


At Linaro, we have an HPC lab where we can setup multiple clusters and machines, install OpenHPC, run the test-suite, benchmarks using Mr-Provisioner, Jenkins and Ansible automation. This allows us to test new kernels/initrd, new versions of OpenHPC, compilers, applications, etc. on different architecture at the same time, from scratch. The work we did is open source, on GitHub, and is intended to be used by other people. We started with hard-coded rules but are slowly moving towards generic configuration-based setup from the ground up, so that anyone else can clone, change the configuration files and run the Ansible playbooks. From scratch.

These are the repositories that we contribute to / use:

Mr-Provisioner, the bare metal provisioner that installs OSs on all our servers (Arm or Intel): https://github.com/Linaro/mr-provisioner

Our infrastructure scripts, setting up Jenkins and running the jobs logic: https://github.com/Linaro/hpclabjenkins

Our benchmark harness, which runs benchmarks in a repeatable way: https://github.com/Linaro/benchmark_harness

Our OpenHPC Ansible scripts, which install OpenHPC on bare-metal/VM, clusters (Arm or Intel): https://github.com/Linaro/ansible-playbook-for-ohpc

Speakers

Renato Golin

Links