Tutorial High Performance Computing

Geneve, Sept. 5, 2014

Prof.Dr DI Gundolf Haase, University of Graz, Institute for Mathematics and Scientific Computing


Pool computers:
Graz: to server

Supplementing material


This tutorial introduces into the field of High Performance Computing (HPC) in mathematical areas and engineering sciences with special focus on MPI, OpenMP, OpenACC and CUDA. The students will acquire specialties of recent and future hardware concepts as well as on supporting software standards. The course work will be organized such that all course topics will be implemented on the appropriate hardware ranging from a single CPU via multiple CPUs to clusters of CPU s and GPUs. The students will be able to adapt research specific code such that they can take advantage of available computer resources. The three main goals of the course consist of

  1. I.Knowledge of the students on algorithms and data structures for HPC and active use of this knowledge.

  2. II.The students get in touch with HPC related concepts and architectures, and the students are able to adopt new developments in this area onto the problem under consideration.

  3. III.Standard compiler and software support for parallel computer architectures is known and used by the students for solving mathematical problems by means of HPC hardware.

  4. IV.The students are able to write/adapt parallel programs on various parallel platforms.

Prerequisites on the student side

  1. 1.Basic knowledge in numerical linear algebra

  2. 2.Programming skills in C and/or C++

  3. 3.English language skills.

Topics of the extended course with further links and further reading


Introduction into recent processor development


Practical work with sequential HPC-programming (ex1)


Seminar talk on "HPC and Mathematics in Applications"


Classification of parallel programming; Shared ressources


Introduction OpenMP  (with practical work)


Practical work  with  OpenMP (ex2)


Introduction into MPI


Practical work with MPI (ex3)


Practical work with MPI and/or OpenMP



Continuation of Practical work with MPI and/or OpenMP; Comparison of the results


Introduction into GPU programming: hardware and software


First steps with OpenACC


Practical work with OpenACC


Performance tools available in CUDA and PGI-OpenACC


Practical work with GPU code and performance tools


Multiple-GPU programming


Practical work in mixing MPI and GPU programming