User Tools

Site Tools



Parallel Programming

Full course description

Parallel programming introduces the students to the paradigm of parallel computing on a computer. Nowadays almost all computer systems include so-called multi-core chips. Hence in order to exploit the full performance of such systems one needs to employ parallel programming. This course covers shared-memory parallelization with OpenMP and java-Threads as well as parallelization with message passing on distributed-memory architectures with MPI. The course starts with a recap of the programming language C followed by a brief theoretical introduction to parallel computing. Next the course treats theoretical aspects like MPI communication, race conditions, deadlocks, efficiency as well as the problem of serialization. This course is accompanied by practical labs in which the students have the opportunity to apply the newly acquired concepts. After completing this course students will be able to write parallel programs with MPI and OpenMP on a basic level, and deal with any difficulties they may encounter.


Programming experience. The examples and exercises will be given in C, however any C/C++ or Java programmer will be able to solve these.

Parallel programming with MPI; Peter Pacheco; Morgan Kaufmann (1996); (a very early revision is available online)


mock_exam.pdf1.0 MiB2021/10/17 18:10
introduction_pp.pdf321.2 KiB2021/10/15 18:10
openmp_1.pdf872.9 KiB2021/10/15 18:10
openmp_2_performance_until_slide_57_.pdf246.1 KiB2021/10/15 18:10
introduction.pdf321.0 KiB2021/09/21 18:10
mpi_2.pdf1008.4 KiB2021/09/21 18:10
mpi_1.pdf321.5 KiB2021/09/21 18:10
study/bachelor/year_3/block_2/parallel_programming.txt · Last modified: 2021/07/04 14:17 by nicolasperez