GPU Programming using CUDA

Research & Science
GPU Programming using CUDA


The course provides an introduction to the programming language CUDA which is used to write fast numeric algorithms for NVIDIA graphics processors (GPUs). Focus is on the basic usage of the language, the exploitation of the most important features of the device (massive parallel computation, shared memory, texture memory) and efficient usage of the hardware to maximize performance. An overview of the available development tools and the advanced features of the language is given.

General Information


1st day:
09:30   Registration
10:00   Welcome & Overview
10:25   Basics I
10:55   Exercise (vector addition I)
11:15   Coffee Break
11:30   Basics II
12:00   Exercise (vector addition II)
12:25   Lunch Break
13:35   Performance Optimization I
14:15   Exercise (coalesced accesses)
15:05   Coffee Break
15:20   Shared Memory
15:45   Exercise (Scalar Product)
16:45   CoffeeBreak
16:55   Texture Memory
17:25   Discussion
17:45   End

2nd day:
09:00   Exercise (Heat 2D)
09:45   Performance Optimization II
10:20   Coffee Break
10:30   Exercise (Dense Matrix Multiplication)
11:40   Coffee Break
11:50   Debugging and Profiling
12:20   Exercise (CUDA-GDB and Visual Profiler)
13:00   Lunch Break
13:45   Advanced Features
14:35   Exercise (Advanced Features)
15:50   Wrap-Up
16:00   End




Dr. Oliver Mangold from HLRS


Registration is closed (because the course is full).
The next available course is CUDA course, July 7-8, 2011.


for registration is Nov. 15, 2010


Members of German universities and public research institutes: none,
others: 300 EUR (includes food and drink at coffee breaks, will be collected on the first day of the course, cash only)


Programming experience in C, some knowledge about parallel programming


Additional information can be found, e.g., at
CUDA (wiki)

Travel-Info Stuttgart

See HLRS address and travel-info. The next public transport stations are: "Universität, Stuttgart" (S-Bahn station, 15 min on foot) and "Lauchhau, Stuttgart" (Bus station, 4 min on foot to HLRS, bus lines 84, 92, 746, 747, 748, but not 82! from S-Bahn station "Universität, Stuttgart" and bus line 81 from S-Bahn station "Stuttgart-Vaihingen").
Accomodation: see HLRS accomodation-info. Private Bed&Breakfast is also available (might be cheaper than the hotels), e.g., A DJH youth hostel is also available.
Further links: Online-Stadtplan des Stadtmessungsamtes Stuttgart or


Rolf Rabenseifner
phone 0711 685 65530