Lecture 1 - Tues Jan 27

• Course overview

• Computing trends (Moore's Law, Flynn's taxonomy)

Lecture 2 - Thur Jan 29

• Using the compute cluster

• Compiling C++ code with CMake

• Wrapping C++ code for Python

Lecture 3 - Tues Feb 3

• Cache memory and more

• Memory access patterns

Lecture 4 - Thur Feb 5

• More on the compute cluster

• SIMD vectorization

Lecture 5 - Tues Feb 10

• Why is shared memory programming hard?

• What is a race condition and why does it happen?

• OpenMP basics

Lecture 6 - Thur Feb 12

• OpenMP in action

Lecture 7 - Tues Feb 17

• Introduction to distributed computing

• What is the message passing interface (MPI)?

Lecture 8 - Thur Feb 19

• MPI: beyond the basics

• MPI examples

Lecture 9 - Tues Feb 24

Bryce Adelstein Lelbach

• Fundamentals

• Parallel algorithms + asynchrony + heterogeneous memory in CUDA C++

Lecture 10 - Thur Feb 26

Bryce Adelstein Lelbach

• Kernel authoring with CUDA Python

Lecture 11 - Tues Mar 3

• Hotspot identification with Intel VTune

• The many faces of CUDA

Lecture 12 - Thur Mar 5

• Strong and weak scaling

• NVIDIA Nsight Systems and NVIDIA Nsight Compute

Lecture 13 - Tues Mar 10

• In-class exercises

Lecture 14 - Thur Mar 12

• In-class exercises

Lecture 15 - Tues Mar 24

• Context and background

• First look at NanoGPT-2050

Lecture 16 - Thur Mar 26

• OpenMP Parallelization

• MPI Parallelization

• CUDA Parallelization

Lecture 17 - Tues Mar 31

• Fundamentals of distributed linear algebra

• ScaLAPACK and alternatives

Lecture 18 - Thur Apr 2

Alan Edelman and Evelyne Ringoot

• The Julia language for high performance computing

• Multi-GPU singular value decomposition using Julia

Lecture 19 - Tues Apr 7

• Gaussian processes and poetry (final example from Week 9)

• Introduction to molecular dynamics

Lecture 20 - Thur Apr 9

• Molecular dynamics with shared memory parallelization

• Domain decomposition for scalable molecular dynamics

Lecture 21 - Tues Apr 14

• Performance portability

• Introduction to Kokkos

Lecture 22 - Thur Apr 16

• More Kokkos

• Roofline plots in action

Lecture 23 - Tues Apr 28

• Final exam topics