Going Parallel (part I: linux tools, advanced Slurm, MPI programming)

Introduction to parallel computing

21 Nov 2023, 09:30

1h 30m

Shanon (building Maxwell, first floor) (Louvain-La-Neuve)

Speaker

Damien François (UCLouvain/CISM)

Description

Before diving into the concrete programming examples with MPI and OpenMP, this session introduces some theoretical concepts and presents the several paradigms and tools offered by Linux for parallel computing when a program itself is not able to run in parallel.
Contents: Theoretical concepts: parallelism, speedup, scaling, overhead, etc. Common parallel computing paradigms (SPMD, Map/Reduce, etc.) GNU tools for parallel computing (xargs and GNU parallel) Parallel computing with pipelines (UNIX pipes and FIFO files)	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)
Type: Hands-on Target audience: Everyone Must: This session is a nice-to-have.

Presentation materials

parcomp2023.pdf