CASTIEL2: Multi-GPU AI Train the Trainer Workshop

Join us for an exclusive event organized by CASTIEL2 and EuroCC2. The Train the Trainer Program dedicated to preparing future instructors to teach these topics effectively.

Too few people are currently able to offer advanced AI training using multiple GPUs at the level required by scientists, engineers, and PhD students who need to scale AI models efficiently or optimize distributed training workflows. Across Europe, only a limited number of HPC and AI centers provide such specialized courses. With this program, we aim to empower additional trainers and centers to deliver high-quality multi-GPU AI training - across Europe or within their own countries.

During this training event, participants will gain a deep understanding of modern multi-GPU and distributed AI technologies, along with practical techniques for teaching these concepts effectively. Expert instructors will guide attendees through state-of-the-art tools, frameworks, and best practices for scaling AI workloads, while also providing pedagogical strategies, teaching resources, and hands-on experience designed to prepare participants to deliver their own AI and multi-GPU training courses.

The training event is co-organised by HLRS, JSC, SURF, CSC, VSC, Cyfronet AGH, RISE, LiU, for EuroCC Poland, NCC Netherlands, NCC Hungary, NCC Belgium, NCC Italy, NCC Finland, SiDE and EuroCC Sweden, all National Competence Centres for High-Performance Computing, CASTIEL2 and EuroCC2, and is designed for everyone interested in the NCCs and the CoEs.

Location

Online course
Organizer: CASTIEL2

Registration

Start date

Jan 30, 2026
09:00

End date

Feb 05, 2026
16:30

Language

English

Entry level

Advanced

Course subject areas

Data in HPC / Deep Learning / Machine Learning

Topics

Artificial Intelligence

Big Data

Deep Learning

Machine Learning

Scientific Machine Learning

Back to list

Prerequisites and content levels

You are familiar with AI frameworks.
Your centre is affiliated to one National Competence Centre (NCC) of EuroCC or CoEs.

Instructors

Main lecturers:
Ashwin Mohanan (RISE)
Mats Sjoberg (CSC)
Caspar van Leeuwen (SURF)
Gyula Ujlaki (NCC Hungary)
Eleonora Bergamaschi (CINECA)
Michele Visciarelli (CINECA)
Prof. dr. Geert Jan Bex (UHASSELT)

Agenda

- PRELIMINARY -

1st day – Friday, January 30

Morning session: Intro to the HPC system. Setup and accessing Jupyter with GPU
Afternoon session: Introduction to deep-learning

2nd day – Monday, February 2

Morning session: Pytorch DDP
Afternoon session: Model parallelism with Pytorch

3rd day – Tuesday, February 3

Morning session: Pytorch Lightning
Afternoon session: LLM, Finetuning. HuggingFace Accelerate, Deepspeed

4th day – Wednesday, February 4

Morning session: CV
Afternoon session: MLOps

5th day – Thursday, February 5

Morning session: Ray + Retrieval Augmented Generation
Afternoon session: Hyperparameter tuning

Registration information

Apply for this course via the button at the top of this page (will be available soon).

Contact

training@hlrs.de

HLRS Training Collaborations in HPC and AI

HLRS is part of the Gauss Centre for Supercomputing (GCS), together with JSC in Jülich and LRZ in Garching near Munich. SIDE is the German National Competence Centre (NCC) for High-Performance Computing. HLRS is also a member of the Baden-Württemberg initiative bwHPC.
Since 2025, HLRS has been coordinating one of the AI Factories of the EuroHPC JU: HammerHAI.

Acknowledgements

Within the scope of the EuroCC2 project this training is offered free of charge. By participating in a training free of charge, companies receive state-aid corresponding to the regular market-prices listed in the service portfolio. Please note state-aid regulations in Germany.

EuroCC 2 and EuroCC4SEE have received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101101903 and No 101191697. The JU receives support from the European Union’s Digital Europe Programme and Germany, Bulgaria, Austria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Greece, Hungary, Ireland, Italy, Lithuania, Latvia, Poland, Portugal, Romania, Slovenia, Spain, Sweden, France, Netherlands, Belgium, Luxembourg, Slovakia, Norway, Türkiye, Republic of North Macedonia, Iceland, Montenegro, Serbia, Bosnia and Herzegovina.

Further courses and training team

See the training overview and the Supercomputing Academy pages.
See also information about the HLRS training department and staff.

Related training

All training

Mar 23 - Apr 17, 2026

Hybrid, Stuttgart

English

Hackathon: Porting and Optimization for Hunter

Jul 14 - 17, 2026

Stuttgart

English

Multi-GPU Deep Learning

Back to list