This Bootcamp will cover scaling applications to multiple GPUs across multiple nodes. Doing so requires one to be adept at programming models and optimization techniques, and proficient at performing root-cause analysis using in-depth profiling to identify and minimize bottlenecks. The N-Ways to Multi-GPU Programming Bootcamp covers step-by-step ways to improve application performance using cues from profilers and provides an understanding of the underlying technologies and communication topology needed to leverage powerful NVIDIA® libraries to extract more performance from the system.
The Bootcamp is co-organised by HLRS, JSC, LRZ, VSC Vienna, RISE, LiU, OpenACC.org and NVIDIA for EuroCC Austria, EuroCC@GCS and EuroCC Sweden, all National Competence Centres for High-Performance Computing.
Online course Organizer: HLRS, University of Stuttgart, Germany
May 06, 2024 09:00
May 07, 2024 14:30
Online
English
Advanced
Parallel Programming
Accelerators
Code Optimization
GPU Programming
OpenACC
OpenMP
Back to list
Experience with C/C++, NVIDIA CUDA C++, and MPI knowledge is required.
Learn more about course curricula and content levels.
Main lecturers: Paul Graham (NVIDIA)
Teaching Assistants:
- preliminary -
All times in CEST:
Day 0 (Fri, May 3) : Cluster Dry Run
Day 1 (Mon, May 6): Parallelizing a Single GPU Code
Day 2 (Tue, May 7): Introduction to NCCL and NVSHMEM
Attendees will be given access to a GPU cluster for the duration of the Bootcamp.
The code is publicly available on github.
Please register at OpenACC-Standard.org via the button at the top of this page with your institutional e-mail address to prove your affiliation.
The final participants will be selected and informed after the registration deadline has passed.
This course is offered in cooperation by HLRS, JSC, LRZ, VSC Vienna, RISE, LiU, OpenACC.org and NVIDIA. Registration is done via www.gpuhackathons.org hosted by OpenACC-Standard.org. Your registration data will be transferred to these partners. For legal notes see the Privacy Policy.
Registration closes on March 26, 2024 at 23:55.
Our course fee includes coffee breaks (in classroom courses only).
For lists of EU and EuroCC countries have a look at the Horizon Europe and EuroCC website.
Only participants from institutions belonging to these countries can take part in this course.
Maksym Deliyergiyev phone 0711 685 87261, maksym.deliyergiyev(at)hlrs.de
HLRS is part of the Gauss Centre for Supercomputing (GCS), together with JSC in Jülich and LRZ in Garching near Munich. EuroCC@GCS is the German National Competence Centre (NCC) for High-Performance Computing. HLRS is also a member of the Baden-Württemberg initiative bwHPC.
This course is provided within the framework of EuroCC2.
http://www.hlrs.de/training/2024/BC-MULTIGPU-NV and course website at Open Hackathons.
See the training overview and the Supercomputing Academy pages.
May 13 - 17, 2024
Hybrid Event - Stuttgart, Germany
May 27 - 28, 2024
June 03 - 07, 2024
July 02 - 05, 2024
Stuttgart, Germany
August 21 - 30, 2024
Online by ETH
September 16 - October 18, 2024
October 14 - 18, 2024
