2018-c-NK

國家理論中心數學組「高效能計算」短期課程

2018 NCTS Summer Course: Introduction to Parallel Computing (II)

Advanced Course on Multi-Threaded Parallel Programming using OpenMP/OpenACC for Multicore/Manycore Systems

2018年7月16日星期一至7月19日星期四 (9:00-17:00)

國立臺灣大學天文數學館 440 室

最新訊息

[2018/07/19] If you want to get credits from this course, please complete this assignment and upload your assignment to this link in PDF format. (Due 2018/07/26 23:59)
[2018/07/14] 檔案下載網址：http://nkl.cc.u-tokyo.ac.jp/NTU2018S/
[2018/05/18] 線上註冊網址：https://goo.gl/forms/yS6IflPH07hFjMcD3
[2018/05/16] 臺灣大學地圖：PDF 檔，Google 版地圖

直播/紀錄 (有兩個畫面可切換)

2018/02/16 直播 Part 2 TBA
2018/07/16 直播 Part 1 TBA

常用連結

http://nkl.cc.u-tokyo.ac.jp/NTU2018S/ (Available soon)
http://nkl.cc.u-tokyo.ac.jp/NTU2017S/ (Last Year’s Material)
http://nkl.cc.u-tokyo.ac.jp/17s/ (Lectures at the University of Tokyo (OpenMP only))
http://nkl.cc.u-tokyo.ac.jp/NTU2015/
http://nkl.cc.u-tokyo.ac.jp/files/multicore-c.tar
http://nkl.cc.u-tokyo.ac.jp/files/multicore-f.tar

課程簡介

快速累積的大量數據，以及高速發展的超級電腦，是當今與未來的重要趨勢。具備高速計算能力，才能解決更大更複雜的問題，也能大幅提升進行尖端研究與開發產業應用的競爭力。在這個四天的密集課程，我們將簡介 MPI 與 OpenMP 的平行計算環境，說明如何在此平行環境求解稠密矩陣的特徵值問題，並將有限體積法以及大型線性系統疊代法平行化，求解三維 Poisson 方程。課程中將使用最先進的超級電腦實機操作。(註：帳號須經申請，並依相關規定審核通過後，方得使用。) 這個短期課程提供一個非常難得的機會，可以接觸到目前全世界最尖端的高速平行計算環境。歡迎教師、碩博士生、大學部同學報名參加。本課程以英語講授。

Overview

In order to make full use of modern supercomputer systems with multicore/manycore architectures, hybrid parallel programming with message-passing and multithreading is essential. While MPI is widely used for message-passing, OpenMP for CPU and OpenACC for GPU are the most popular ways for multithreading on multicore/manycore clusters. In this 4-day course, we focus on optimization of single node performance using OpenMP and OpenACC for CPU and GPU. We “parallelize” a finite-volume method (FVM) code with Krylov iterative solvers for Poisson’s equation on Reedbush supercomputer at the University of Tokyo with 1.93 PF peak performance (http://www.cc.u-tokyo.ac.jp/system/reedbush/index-e.html), which consists of the most recent CPU’s (Intel Xeon E5-2695 v4 (Broadwell-EP)) and GPU’s (NVIDIA Tesla P100 (Pascal)).

It is assumed that all the participants have already finished”邁向Petascale高速計算 (February 2016)” or”國家理論中心數學組「高效能計算」短期課程 (February 2017 or February 2018)”, or they have equivalent knowledge and experiences in numerical analysis and parallel programming by MPI and OpenMP.

In the winter schools in 2016, 2017 and 2018, the target application was a 3D FVM code for Poisson’s equation by Conjugate Gradient (CG) iterative method with very simple Point Jacobi preconditioner. This time our target is same FVM code, but linear equations are solved by ICCG (CG iterative method with Incomplete Cholesky preconditioning), which is more complicated, powerful and widely-used in practical applications. Because ICCG includes “data dependency”, where writing/reading data to/from memory could occur simultaneously, parallelization using OpenMP/OpenACC is not straightforward. We need certain kind of reordering in order to extract parallelism. In this 4-day course, lectures and exercise on the following issues will be provided:

Overview of Finite-Volume Method (FVM)
Kyrilov Iterative Method, Preconditioning
Implementation of the Program
Introduction to OpenMP/OpenACC
Reordering/Coloring Method
Parallel FVM by OpenMP/OpenACC

預備知識 (Prerequisites)

Completion of one of the following two short courses:
- 邁向Petascale高速計算 (February 2016) https://sites.google.com/site/school4scicomp/previous/2016-a-winter/
- 國家理論中心數學組「高效能計算」短期課程 (February 2017) https://sites.google.com/site/school4scicomp/2017-b-spring/
- 國家理論中心數學組「高效能計算」短期課程 (February 2018) https://sites.google.com/site/school4scicomp/2018-b-nk/
- (or equivalent knowledge and experiences in numerical analysis (FVM, preconditioned iterative solvers) and parallel programming using OpenMP and MPI )
Experiences in Unix/Linux (vi or emacs)
Fundamental numerical algorithms (Gaussian Elimination, LU Factorization, Jacobi/Gauss-Seidel/SOR Iterative Solvers, Conjugate Gradient Method (CG))
Experiences in SSH Public Key Authentication Method

課程講義 (Course Handouts)

http://www.abc-lib.org/MyHTML/Lectures/NU/class-matrNTU2018.htm (Available soon)
http://nkl.cc.u-tokyo.ac.jp/NTU2018/ (Available soon)
Materials in 2017
- http://nkl.cc.u-tokyo.ac.jp/NTU2017/
- http://www.abc-lib.org/MyHTML/Lectures/NU/class-matrNTU2017.htm

課前準備 (Preparation)

Windows
- Cygwin with gcc/gfortran and OpenSSH
  - Please make sure to install gcc (C) or gfortran (Fortran) in “Devel”, and OpenSSH in “Net”
- ParaView
MacOS, UNIX/Linux
- ParaView
Cygwin: https://www.cygwin.com/
ParaView: http://www.paraview.org

直播/紀錄 (有兩個畫面可切換)