2018-b-NK

國家理論中心數學組「高效能計算 」短期課程

Introduction to Parallel Programming for Multicore/Manycore Clusters

2018年2月22日星期四至2月25日星期日 (9:00-17:00)

國立臺灣大學 天文數學館 301 室

最新訊息

直播/紀錄 (有兩個畫面可切換)

常用連結

課程簡介

快速累積的大量數據，以及高速發展的超級電腦，是當今與未來的重要趨勢。具備高速計算能力，才能解決更大更複雜的問題，也能大幅提升進行尖端研究與開發產業應用的競爭力。在這個四天的密集課程，我們將簡介 MPI 與 OpenMP 的平行計算環境，說明如何在此平行環境求解稠密矩陣的特徵值問題，並將有限體積法以及大型線性系統疊代法平行化，求解三維 Poisson 方程。課程中將使用最先進的超級電腦實機操作。(註：帳號須經申請，並依相關規定審核通過後，方得使用。) 這個短期課程提供一個非常難得的機會，可以接觸到目前全世界最尖端的高速平行計算環境。歡迎教師、碩博士生、大學部同學報名參加。本課程以英語講授。

Overview

In order to make full use of modern supercomputer systems with multicore/manycore architectures, hybrid parallel programming with message-passing and multithreading is essential. MPI for message-passing and OpenMP for multithreading are the most popular ways for parallel programming on multicore/manycore clusters.

This 4-day tutorial provides essential knowledge and experiences for parallel programming using MPI and OpenMP. Hands-on exercise by the Readbush-U supercomputer at the University of Tokyo (Intel Broadwell-EP) is also given. (https://www.cc.u-tokyo.ac.jp/system/reedbush/index-e.html).

  • The 1st Part is focusing on training of fundamental MPI and OpenMP. The basic functions and usage of MPI and OpenMP are explained. Several training of parallelization by using sample programs based on fundamental numerical computations, such as matrix-matrix multiplication, are provided.
  • In the 2nd Part, MPI and OpenMP/MPI are applied to 3D Poisson equation solver by finite-volume method (FVM) with preconditioned conjugate gradient iterative method (PCG). Detailed lectures on data structure for parallel FVM are also provided.

預備知識 (Prerequisites)

  • Experiences in Unix/Linux
  • Experiences in emacs or vi
  • Experiences of programming (Fortran or C/C++)
  • Fundamental numerical algorithms (Gaussian Elimination, LU Factorization, Jacobi/Gauss-Seidel/SOR Iterative Solvers)
  • Experiences in SSH Public Key Authentication Method

課程講義 (Course Handouts)

相關軟體 (Software)

授課教授 (Instructors)

  • Professor Kengo Nakajima (中島 研吾 教授，東京大學 情報基盤中心 超級計算研究部門)

  • Professor Takahiro Katagiri (片桐 孝洋 教授，名古屋大學 情報基盤中心 大規模計算支援環境研究部門)

課程內容 (Schedule and Contents)

February 22, 2018(Th)

09:10-10:00 Introduction (KN)

10:10-11:00 Overview of OpenMP (TK)

11:10-12:00 Functions of OpenMP (TK)

13:10-14:00 Training of OpenMP (TK)

14:10-15:00 Overview of MPI (TK)

15:10-16:00 How to use the Reedbush-U (KN)

16:10-17:00 Trainings on the Reedbush-U (KN)

Exercise 1

February 23, 2018 (F) (Katagiri)

09:10-10:00 Functions of MPI Non-blocking and Persistent Communication

10:10-11:00 Parallelization of dense Matrix-Vector Multiplications (1/2)

11:10-12:00 Parallelization of dense Matrix-Vector Multiplications (2/2)

Exercise 2

13:10-14:00 Parallelization of dense Power Method for eigenvalue problem (1/2)

14:10-15:00 Parallelization of dense Power Method for eigenvalue problem (2/2)

Exercise 3

15:10-16:00 Parallelization of Fully Distributed dense Matrix-Matrix Multiplication (1/2)

Exercise 4

16:10-17:00 Parallelization of Fully Distributed dense Matrix-Matrix Multiplication (2/2)

Exercise 5

February 24, 2018 (Sa) (Nakajima)

09:10-10:00 FVM code (1/4)

10:10-11:00 FVM code (2/4)

11:10-12:00 FVM code (3/4)

13:10-14:00 FVM code (4/4) and sparse linear solver

14:10-15:00 Parallel Data Structure (1/2)

15:10-16:00 Parallel Data Structure (2/2)

16:10-17:00 Parallel FVM (1/4)

February 25, 2018 (Su) (Nakajima)

09:10-10:00 Parallel FVM (2/4)

10:10-11:00 Parallel FVM (3/4)

11:10-12:00 Parallel FVM (4/4)

13:10-14:00 OpenMP/MPI Hybrid (1/4)

14:10-15:00 OpenMP/MPI Hybrid (2/4)

15:10-16:00 OpenMP/MPI Hybrid (3/4)

16:10-17:00 OpenMP/MPI Hybrid (4/4)

Report (topics including strong scaling, weak scaling, preconditioning, performance comparison, etc.)

主辦單位與聯絡人

主辦單位：國家理論中心數學組

協辦單位：東京大學情報基盤中心，臺灣大學數學系與應用數學科學研究所，台灣工業與應用數學學會 GPU與高效能計算活動學群

主持人：王偉仲 (台灣大學應數所)，林文偉 (交通大學應數系)，舒宇宸 (成功大學數學系)，黃聰明 (台灣師範大學數學系)

聯絡人：游墨霏小姐 (02-3366-8814, murphyyu@ncts.ntu.edu.tw)