High Performance Computing II

Contents: Performance, Tuning and Programming Tools are investigated by the student.

• performance analysis (sequential and parallel) of a given code
• tuning of the code
• implementation of the code on various platforms, especially GPUs
• multiple GPU implementation (one/multiple nodes)
• presentation of the students on the investigated codes
• Final presentation and Tech-report of the results

Lecturer: Prof. Gundolf Haase, Heinrichstr. 36, Zi 506, Tel. 5178

Lecture Time Friday :   8:15 - 9:45 in SR 11.32

Projects/Talks (SS21):

• xx xx: project
• xx.03.2021: Talk (material)
• xx.06.2021: final Talk
• pp

Compute-Server:

• Cluster in Graz/Vienna, see wiki (sauron [KFU], dcluster [TUG], vsc-3 [Wien]): MACH [Linz]

Compilers:

• GCC/ICC install with Windows/Linux
• Environment variables for compilers and git on mephisto, gpu11,
• check out the git repository

Hardware:

• Intel Core i9X [May 30, 2017]
• HIVE: web, pdf,

Methods:

• Deep Learning: welcome, 
• Parallel in time: XBraid,

---

Solvers and other packages (a selection from Arnold Neumaier's page, some literature)

• julia (math. script language)
• partitioners:  PT-Scotch, METIS
• direct solvers: PaStiX,  FLAME, PARADISO(O.Schenk, Intel), CHOLMOD [new]
• iterative solvers: Paralution (doc),  ADI, PETSc, (Aztec)
• load balancing, parallel data management: DEAL II, FreeFEM++, Dune, ug4, ( Zoltan)
• preconditioners: Hypre, AHMED, PetFMM,
• tools: Intel Tools (Advisor, Inspector)
• this list will be extended and specified

---

Automatic differentiation tools for optimization:

• Autodiff.org
• Books
• Andreas Griewank and Andrea Walther: "Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation", Second Edition", SIAM, 2008 (Graz-Lib: ebook and 1st edition: 66:G848)
• Uwe Naumann: "The Art of Differentiating Computer Programs", SIAM, 2011 (Graz-Lib: 66:N311 and ebook)
• J. Haslinger and R. A. E. Mäkinen: "Introduction to Shape Optimization", SIAM, 2003 (Graz-Lib: 45:H352 and ebook)
• Uwe Naumann and Olaf Schenk: "Combinatorial Scientific Computing", Chapman & Hall/CRC Computational Science, 2012 (Graz-Lib: on acquisition)
• Alfio Borzì and Volker Schulz: "Computational Optimization of Systems Governed by Partial Differential Equations ", SIAM, 2011 (Graz-Lib: 65:B739 and ebook)
• Papers
• Bischof et.al,: "Sensitivity Analysis Of Turbulence Models Using Automatic Differentiation", SIAM J. SCI. COMPUT. ,Vol. 26, No. 2, pp. 510-522, 2004
• Borggaard et.al: "On Efficient Solutions To The Continuous Sensitivity Equation Using Automatic Differentiation", SIAM J. SCI. COMPUT. ,Vol. 22, No. 1, pp. 39–62, 2000
• Pryce et.al: "Fast Automatic Differentiation Jacobians By Compact LU Factorization", SIAM J. SCI. COMPUT. , Vol. 30, No. 4, pp. 1659–1677, 2008
• Schanen et.al.: "Interpretative Adjoints for Numerical Simulation Codes using MPI", Procedia Computer Science 1 (2012) 1825–1833, Elsevier
• Dayde et.al.: "Element-By-Element Preconditioners For Large Partially Separable Optimization Problems", SIAM J. SCI. COMPUT. , Vol. 18, No. 6, pp. 1767-1787, 1997

last update: Feb 1, 2021