Parallel Programming Workshop (MPI, OpenMP and Advanced Topics)

Distributed memory parallelization with the Message Passing Interface MPI (Mon, for beginners):
On clusters and distributed memory architectures, parallel programming with the Message Passing Interface (MPI) is the dominating programming model. The course gives an introduction into MPI-1. Hands-on sessions (in C and Fortran) will allow users to immediately test and understand the basic constructs of the Message Passing Interface (MPI).

Shared memory parallelization with OpenMP (Tue, for beginners):
The focus is on shared memory parallelization with OpenMP, the key concept on hyper-threading, dual-core, multi-core, shared memory, and ccNUMA platforms. This course teaches shared memory OpenMP parallelization. Hands-on sessions (in C and Fortran) will allow users to immediately test and understand the directives and other interfaces of OpenMP. Race-condition debugging tools are also presented.

Intermediate and advanced topics in parallel programming (Wed-Fri):
Topics are advanced usage of communicators and virtual topologies, one-sided communication, derived datatypes, MPI-2 parallel file I/O, hybrid mixed model MPI+OpenMP parallelization, parallelization of explicit and implicit solvers and of particle based applications, parallel numerics and libraries, and parallelization with PETSc. MPI-3.0 introduced a new shared memory programming interface, which can be combined with MPI message passing and remote memory access on the cluster interconnect. It can be used for direct neighbor accesses similar to OpenMP or for direct halo copies, and enables new hybrid programming models. These models are compared in the hybrid mixed model MPI+OpenMP parallelization session with various hybrid MPI+OpenMP approaches and pure MPI. Further aspects are domain decomposition, load balancing, and debugging.

Veranstaltungsort

HLRS, University of Stuttgart
Nobelstraße 19
70569 Stuttgart, Germany
Room 0.439 / Rühle Saal
Location and nearby accommodations

Veranstaltungsort

HLRS, University of Stuttgart
Nobelstraße 19
70569 Stuttgart, Germany
Room 0.439 / Rühle Saal
Location and nearby accommodations

Veranstaltungsbeginn

10. Okt. 2022
08:30

Verstaltungsende

14. Okt. 2022
17:00

Sprache

Englisch

Einstiegslevel

Basis

Themenbereiche

Paralleles Programmieren

Themen

MPI

OpenMP

Zurück zur Liste

Prerequisites and content levels

Prerequisites

Unix / C or Fortran (or Python for the MPI part)

Content levels

Basic: 14 hours
Intermediate: 12 hours
Advanced: 10:30 hours
Community: 0:45 hours

Learn more about course curricula and content levels.

Instructors

Dr. Rolf Rabenseifner and Prof. Dr.-Ing. Rainer Keller.

Learning outcomes

Please refer to the course overview.

This course provides scientific training in Computational Science, and in addition, the scientific exchange of the participants among themselves.

Agenda

All times are local times in the Central European Summer Time zone (Berlin).

See link to detailed program (preliminary program)

Handouts

Most MPI exercises are (in addition to C and Fortran) also available for Python+mpi4py+numpy.

On-site course & COVID rules

Besides the content of the training itself, another important aspect of this event is the scientific exchange among the participants. We try to facilitate such communication by

offering common coffee and lunch breaks and
working together in groups of two during the exercises (if desired by the individual participants and permitted by the COVID-19 rules).

For your safety, we will only allow fully vaccinated or fully recovered or COVID-19 negative tested participants on all days. You must wear a medical face mask or FFP2 mask everywhere on site. If a distance of 1.5 m cannot be guaranteed inside, e.g., if you are working in pairs in exercises, it must be an FFP2 mask. Details can be found on the registration page.

We strongly recommend to choose travel options and hotels with the possibility to cancel (even close to the event) because we might be forced to deliver the course as an online course.

Registration information

Fees

Monday-Tuesday: This is an HLRS course with the following fees:

Students without master’s degree or equivalent at a German university: 30 EUR.
Students without master’s degree or equivalent at a university in an EU, EU-associated or PRACE country: 30 EUR.
PhD student or employee at a German university or public research institute: 60 EUR.
PhD student or employee at a university or public research institute in an EU, EU-associated or PRACE country other than Germany: 120 EUR.

Wednesday-Friday: For participants of the above categories, this course is sponsored by the PRACE PATC program, i.e., there are no course fees if you register only for Wednesday-Friday.

For all other participants (Mo-Fri), this course is an HLRS course with the following fees:

Students without master’s degree or equivalent at a university outside of EU, EU-associated or PRACE countries: 40 EUR.
PhD students or employees at a university or public research institute outside of EU, EU-associated or PRACE countries: 360 EUR.
Other participants, e.g., from industry, other public service providers, or government: 960 EUR.

Link to the EU and EU-associated (Horizon Europe), and PRACE countries.

Our course fees include coffee breaks (in classroom courses only).

Contact

Khatuna Kakhiani phone 0711 685 65796, kakhiani(at)hlrs.de
Michael Schlottke-Lakemper phone 0711 685 87223, m.schlottke-lakemper(at)hlrs.de

Train the Trainer - TtT

In conjunction with this course, a Train the Trainer Program is provided. Whereas this regular course teaches parallel programming, the Train the Trainer Program is an education for future trainers in parallel programming. For further details, see here.

PRACE PATC and bwHPC

HLRS is part of the Gauss Centre for Supercomputing (GCS), which is one of the six PRACE Advanced Training Centres (PATCs) that started in Feb. 2012.

This course is a PATC course, see also the PRACE Training Portal and Events. For participants from public research institutions in PRACE countries, the course fee is sponsored through the PRACE PATC program.

HLRS is also member of the Baden-Württemberg initiative bwHPC.

This course is also provided within the framework of the bwHPC training program.