Learning how to use HPC infrastructure (part III: Submitting jobs, using containers, checkpointing, workflows)

Using a Checkpoint/restart program to overcome time limits

19 Oct 2023, 15:15

45m

Maxwell/Shannon (first floor) (Louvain-La-Neuve)

Speaker

Olivier Mattelaer (UCLouvain/CISM)

Description

Checkpointing and Restarting, or the art of stopping some computations to continue them later, or on another computer, is a very convenient way to get past time limits set on the clusters, and to protect against hardware or software failure on the compute nodes.
Contents: Use and challenges of checkpointing The different approaches Checkpointing in Slurm Using DMTCP for checkpointing	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.) Passive knowledge of either C, Fortran, Octave, Python or R
Type: Hands-on Target audience: Everyone Must: This session is a must-have for anyone feeling oppressed by time limits.

Presentation materials

23_10_checkpointing.pdf

demo_materiel.tgz