Part IV. Parallel Programming

Table of Contents

32. Parallel Programming
32.. Serial vs. Parallel
32.. Scheduling Compilation
32.. Further Reading
33. Programming for HTC
33.. Introduction
33.. Common Uses for HTC
34. Programming for HPC
34.. Introduction
34.. Common Uses for HPC
34.. Real HPC Examples
34.. HPC Programming Languages and Libraries
34.. Shared Memory Parallel Programming with OpenMP
34.. Shared Memory Parallelism with POSIX Threads
34.. Message Passing Interface (MPI)
34.. MPI vs Other Parallel Paradigms
34.. Structure of an MPI Job
34.. A Simple MPI Program
34.. Best Practices with MPI
34.. Higher Level MPI Features
34.. Process Distribution
34.. Parallel Disk I/O