Speaker
Damien François
(UCLouvain/CISM)
Description
Whenever one has to deal with multiple jobs on an HPC system, the idea of automating parts or all of the job management process naturally leads to the concept of workflows. Workflow management solutions range from basic scheduler features such as job arrays and dependencies to sophisticated workflow engines capable of coordinating large-scale computational campaigns. This session helps participants identify the most appropriate workflow solution for their needs and teaches best practices to reduce manual job management and improve reproducibility.
| Contents | Information |
|---|---|
| • Introduction to workflows • Types of workflow management systems • Choosing a workflow management system • Using scheduler features such as job arrays and dependencies • An example workflow implementation with Maestro • Best practices for automating computational campaigns |
Prerequisite: • Being able to use SSH with private keys • Being familiar with a text editor • Mastering the Linux |