Learning How to program on HPC cluster (part IV: advanced python/debugging/parallel)

Introduction to parallel computing

14 Nov 2024, 09:30

1h 30m

CYCL09b (Louvain-La-Neuve)

Speaker

Damien François (UCLouvain/CISM)

Description

Before diving into the concrete programming examples with MPI and OpenMP, this session introduces some theoretical concepts and presents the several paradigms and tools offered by Linux for parallel computing when a program itself is not able to run in parallel.
Contents: Theoretical concepts: parallelism, speedup, scaling, overhead, etc. Common parallel computing paradigms (SPMD, Map/Reduce, etc.) GNU tools for parallel computing (xargs and GNU parallel) Parallel computing with pipelines (UNIX pipes and FIFO files)	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)
Type: Hands-on Target audience: Everyone Must: This session is a nice-to-have.

Presentation materials

parcomp2024.pdf