Learning how to use HPC infrastructure (part IV: Submitting jobs, using containers, checkpointing, workflows)

Preparing, submitting and managing jobs with Slurm

17 Oct 2024, 09:30

2h 30m

CYCL09b (Louvain-La-Neuve)

Speaker

Damien François (UCLouvain/CISM)

Description

Slurm is the job manager installed on all CÉCI clusters. The session teaches attendees how to prepare a submission script, how to submit, monitor, and manage jobs on the clusters.

 

Contents: Role of a job scheduler  Creating and submitting a job  Setting job constraints and parameters  Managing and monitoring jobs  Working interactively  Getting accounting information  How priorities are computed  Creating basic submission scripts Best practice	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities Follow-up: Checkpointing to make jobs fit maximum allowed time Workflows to organise jobs and experiments Advanced Slurm to write more complex parallel submission scripts.
Type: Hands-on Target audience: Everyone Must: This session is mandatory.

Presentation materials

slurm2024-1.pdf