Going Parallel (part I)

Monday 5 Dec 2022, 09:00 → 17:00 Europe/Brussels

Banque nationale: BN/055 (Namur)

Going parallel is crucial to speed up your gain and to use the full power of HPC center. In this session, we will start by an introduction to teach you various strategy/trick of parallelism and then deep dive into MPI, the method to share computation between different computer with communication between the various computer to organise the computation/share results,....
Contents: Introduction to parallel computing Parallel programming with MPI python with MPI Must: This session is a must-have for anyone writing or even simply using MPI programs Type: Hands-on	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.) Passive knowledge of C or Fortran Target audience: Rookie programmer

1 Introduction to parallel computing

Before diving into the concrete programming examples with MPI and OpenMP, this session introduces some theoretical concepts and presents the several paradigms and tools offered by Linux for parallel computing when a program itself is not able to run in parallel.
Contents: Theoretical concepts: parallelism, speedup, scaling, overhead, etc. Common parallel computing paradigms (SPMD, Map/Reduce, etc.) GNU tools for parallel computing (xargs and GNU parallel) Parallel computing with pipelines (UNIX pipes and FIFO files)	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)
Type: Hands-on Target audience: Everyone Must: This session is a nice-to-have.

Speaker: Damien François (UCLouvain/CISM)

parcomp2022.pdf

2 Parallel programming with MPI (1)

MPI is a standard for passing messages between processes running on distinct computers. It offers high-level primitives for efficient communication.
Contents: Parallel programming paradigms Shared-memory vs message passing Compiling an MPI program Collective communication Reduction operations Communication modes	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.) Passive knowledge of C or Fortran
Type: Hands-on Target audience: Rookie programmer Must: This session is a must-have for anyone writing or even simply using MPI programs

Speaker: Orian Louant (Université de Liège)

CECI-MPI-Dec22.pdf

mpi-examples.zip

3 Parallel programming with MPI (2)

MPI is a standard for passing messages between processes running on distinct computers. It offers high-level primitives for efficient communication.
Contents: Parallel programming paradigms Shared-memory vs message passing Compiling an MPI program Collective communication Reduction operations Communication modes	Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.) Passive knowledge of C or Fortran
Type: Hands-on Target audience: Rookie programmer Must: This session is a must-have for anyone writing or even simply using MPI programs

Speakers: Ariel Lozano (ULB), Orian Louant (Université de Liège)