Parallel Programming and High Performance Computing

Architectures

1. Shared Memory System

2. Distributed Memory System

Models

1. Single Program Multiple Data

2. Multiple Program Multiple Data

Methods

1. Automatic Parallelization

2. Open Multi-Processing

3. Message Passing Interface

4. Hybrid