HLRS High Performance Computing Center Stuttgart: Parallelization with MPI

Prerequisites and content levels

Prerequisites:

Familiarity with Linux and Linux editors is recommended.
Basics/principles of programming (in C, C++ or Fortran).
For doing the hands-on labs all you need is a C/C++ or Fortran compiler and a recent MPI library. Participants can choose between using their own laptops or any system they have access to that provides these, it's even possible to do the exercises in Google Colab. Alternatively, participants can ask for a training user account at the VSC for the duration of the course.

Content levels:

Basic: 6 hours
Intermediate: 4 hours
Advanced: 2 hours

Learn more about course curricula and content levels.

Instructors

Claudia Blaas-Schenner (VSC Research Center, TU Wien),
David Fischak (tutor; VSC Research Center, TU Wien)

Agenda

1st day – 17 May 2022

08:15 Join online
08:30 Welcome (talk)
08:35 MPI overview (talk+demo)
10:00 Breakout-Rooms - meet your exercise group
10:15 Process model and language bindings (talk+demo+practical)
11:30 Break
11:40 Messages and point-to-point communication (talk+practical)
13:00 End of first day

2nd day – 18 May 2022

08:15 Join online
08:30 Ping pong benchmark - solution and results (talk+discussion)
08:40 Nonblocking communication (talk+demo+practical)
10:00 Break
10:15 Collective communication (talk+demo+practical)
11:30 Break
11:45 Optimizing MPI communication - a real world example (talk+discussion)
12:00 Short Tour: other MPI topics (talk)
12:30 Fortran and MPI - only for Fortran participants (talk)
13:00 End of second day

3rd day – 19 May 2022

08:15 Join online
08:30 Groups & Communicators (talk+practical)
09:30 Break
09:45 Virtual topologies (talk+practical)
11:30 Break
11:45 Derived datatypes (talk+demo+practical)
13:00 End of third day

4th day – 20 May 2022

08:15 Join online
08:30 One-sided Communication (talk+practical)
10:00 Break
10:15 Shared Memory One-sided Communication (talk+practical)
11:30 Break
11:45 Short Tour: MPI I/O (talk)
12:15 Best practice, Summary, Q&A (talk+discussion)
13:00 End of fourth day (course)

Handout

A link to the course material (slides and exercises) will be available at course start

Registration information

Please register via the PRACE registration page with your official e-mail address to prove your affiliation.

events.prace-ri.eu/event/1360/registrations/1007/

Registration period is from 25 February 2022 to 3 May 2022, and follows the "first come – first served" principle. For the online course we can take a maximum of 40 persons. Additional registrations will be added to a waiting list.

Contact

Claudia Blaas-Schenner, training(at)vsc.ac.at

Official course URL(s)

https://www.hlrs.de/training/2022/VSC2 or https://vsc.ac.at/training/2022/MPI (at VSC)

Further courses

See the training overview and the Supercomputing Academy pages.

https://vsc.ac.at/training (at the VSC Research Center, TU Wien)

High-Performance Computing Center Stuttgart

Parallelization with MPI

Location

Prerequisites and content levels

Prerequisites:

Content levels:

Instructors

Agenda

Handout

Registration information

Contact

Official course URL(s)

Further courses

Related training

Parallelization with MPI and OpenMP

Efficient Parallel Programming with GASPI

Optimization of Scaling and Node-level Performance on Hawk

Six-day course in parallel programming with MPI/OpenMP

Parallel Programming Workshop (Train the Trainer)

Parallel Programming Workshop (MPI, OpenMP and Advanced Topics)

Supercomputing Akademie: Paralleles Programmieren mit MPI