Introduction to parallel computing

• Damien François (UCLouvain/CISM)

Room: Banque nationale: BN/055 <table border="0" cellpadding="10px"> <tbody> <tr> <td colspan="2"> <p>Before diving into the concrete programming examples with MPI and OpenMP, this session introduces some theoretical concepts and presents the several paradigms and tools offered by Linux for parallel computing when a program itself is not able to run in parallel.&nbsp;</p> </td> </tr> <tr> <td rowspan="2"> <p><strong>Contents:</strong></p> <ul> <li>Theoretical concepts: parallelism, speedup, scaling, overhead, etc.</li> <li>Common parallel computing paradigms (SPMD, Map/Reduce, etc.)</li> <li>GNU tools for parallel computing (xargs and GNU parallel)</li> <li>Parallel computing with pipelines (UNIX pipes and FIFO files)</li> </ul> </td> <td> <p><strong>Prerequisite:</strong></p> <ul> <li>Being able to use SSH with private keys&nbsp;</li> <li>Being familiar with a text editor&nbsp;</li> <li>Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)</li> </ul> </td> </tr> <tr> <td> <p><strong>Type</strong>: Hands-on<br /> <strong>Target audience</strong>: Everyone<br /> <strong>Must:&nbsp;</strong>This session is a nice-to-have.</p> </td> </tr> </tbody> </table>

Parallel programming with MPI (1)

• Orian Louant (Université de Liège)

Room: Banque nationale: BN/055 <table border="0" cellpadding="10px"> <tbody> <tr> <td colspan="2"> <p>MPI is a standard for passing messages between processes running on distinct computers. It offers high-level primitives for efficient communication.&nbsp;</p> </td> </tr> <tr> <td rowspan="2"> <p><strong>Contents:</strong></p> <ul> <li>Parallel programming paradigms</li> <li>Shared-memory vs message passing</li> <li>Compiling an MPI program</li> <li>Collective communication</li> <li>Reduction operations</li> <li>Communication modes</li> </ul> </td> <td> <p><strong>Prerequisite:</strong></p> <ul> <li>Being able to use SSH with private keys&nbsp;</li> <li>Being familiar with a text editor&nbsp;</li> <li>Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)</li> <li>Passive knowledge of C or Fortran</li> </ul> </td> </tr> <tr> <td> <p><strong>Type</strong>: Hands-on<br /> <strong>Target audience</strong>: Rookie programmer<br /> <strong>Must:&nbsp;</strong>This session is a must-have for anyone writing or even simply using MPI programs</p> </td> </tr> </tbody> </table>

Parallel programming with MPI (2)

• Orian Louant (Université de Liège)
• Ariel Lozano (ULB)

Room: Banque nationale: BN/055 <table border="0" cellpadding="10px"> <tbody> <tr> <td colspan="2"> <p>MPI is a standard for passing messages between processes running on distinct computers. It offers high-level primitives for efficient communication.&nbsp;</p> </td> </tr> <tr> <td rowspan="2"> <p><strong>Contents:</strong></p> <ul> <li>Parallel programming paradigms</li> <li>Shared-memory vs message passing</li> <li>Compiling an MPI program</li> <li>Collective communication</li> <li>Reduction operations</li> <li>Communication modes</li> </ul> </td> <td> <p><strong>Prerequisite:</strong></p> <ul> <li>Being able to use SSH with private keys&nbsp;</li> <li>Being familiar with a text editor&nbsp;</li> <li>Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)</li> <li>Passive knowledge of C or Fortran</li> </ul> </td> </tr> <tr> <td> <p><strong>Type</strong>: Hands-on<br /> <strong>Target audience</strong>: Rookie programmer<br /> <strong>Must:&nbsp;</strong>This session is a must-have for anyone writing or even simply using MPI programs</p> </td> </tr> </tbody> </table>