HLRS Online Parallel Programming Workshop
In the area of parallel programming, the HLRS provides most courses as as Online Courses. The lectures are recorded with Lecturnity and Real Media Format. The slides are also available as pdf.
Many lectures include exercises. Solutions to all practicals can be found here.
A list of all class room courses at several locations can be found here.