Parallel Programming 2019

This is the site of my course "Parallel Programming 2019" at the department of CSIE, National Taiwan University. This course is about programming multiple processing units for performance. We will discuss two kinds of parallel architecture -- multicore CPU and multi-CPU clusters. For multicore CPU we will discuss Pthread, Open Multi-Processing (OpenMP), and OpenCL. For multi-CPU clusters we will discuss Google's MapReduce. We will discuss the architecture, programming model, programming techniques, and application characteristic for these different architectures. Extensive in-class lab sessions will be conducted.

Announcement

  • 06/18/2019. 因為204被借去期末考使用，尚未Demo Hadoop 的同學請在下課前至Lab332 Demo.
  • 06/10/2019: Hadoop 練習伺服器帳號已開通，請到台大信箱領取帳號和密碼。如有疑問請詢問助教。
    • 確認登入後，請盡速更改密碼和權限，以免遭人盜用。
    • 禁止使用伺服器執行非課程相關程序，一經發現，將封鎖使用權限
  • 06/10/2019. We will finish the course tomorrow with Hadoop and MapReduce. The deadline of the workshop tomorrow will be 06/18.
  • 05/26/2019: CUDA教材可在 PP2013 Materials 中找到。
  • 05/06/2019: OpenCL 練習伺服器帳號已開通，請到台大信箱領取帳號和密碼。如有疑問請詢問助教。
    • 確認登入後，請盡速更改密碼和權限，以免遭人盜用。
    • 禁止使用伺服器執行非課程相關程序，一經發現，將封鎖使用權限
  • 04/20/2019. Next week we will talk about intermediate OpenMP programming.
  • 04/13/2019. Next week we will meet in 104 since all computer rooms will be used by other classes. Please bring a laptop to class. We will talk about basic OpenMP.
  • 04/09/2019. We will start Pthread programming. We will have a quiz first, then do a programming session. You need to finish all the video about Pthread before coming to the class.
  • 03/26/2019, We will finish parallel algorithm, and again have a quiz.
  • 03/26/2019: 伺服器帳號已開通，請到台大信箱領取帳號和密碼。如有疑問請詢問助教。
    • 確認登入後，請盡速更改密碼和權限，以免遭人盜用。
    • 禁止使用伺服器執行非課程相關程序，一經發現，將封鎖使用權限。
  • 03/05/2019: PP2019 Quiz & workshop record sheet has been published at "Assignment" page. Please always check the sheet after the class, and contact TA if there is any problem.
  • 02/21/2019 The grades of this course will be determined as follows. Each week we will have 6 points. These could be pop quizzes and lab sessions. There will be no midterm or final exams. No grade adjustment will be made at the end of the semester.
  • 02/18/2019 Due to the large number of lab sessions, the load on TA will be very heavy. As a result this course will not admit any more students.
  • 02/12/2019 Creation of this site

Course

  • Instructor
    • Pangfeng Liu, 劉邦鋒 教授
  • Lecture Videos on Youtube
  • Meeting time/place
    • 14:20 - 17:20, every Tuesday at CSIE 204
  • TA Information

Syllabus

  • Introduction
  • Parallel Architecture
  • Evaluation of parallel computing
  • Principles of parallel computing
  • Parallel Algorithms
  • Pthread Programming
  • OpenMP Programming
  • OpenCL Programming
  • CUDA Programming
  • Hadoop Programming

Materials