Part IV. Parallel Programming

Table of Contents

33. Parallel Programming
33.. Serial vs. Parallel
33.. Scheduling Compilation
33.. Further Reading
34. Programming for HTC
34.. Introduction
34.. Common Uses for HTC
35. Programming for HPC
35.. Introduction
35.. Common Uses for HPC
35.. Real HPC Examples
35.. HPC Programming Languages and Libraries
35.. Shared Memory Parallel Programming with OpenMP
35.. Shared Memory Parallelism with POSIX Threads
35.. Message Passing Interface (MPI)
35.. MPI vs Other Parallel Paradigms
35.. Structure of an MPI Job
35.. A Simple MPI Program
35.. Best Practices with MPI
35.. Higher Level MPI Features
35.. Process Distribution
35.. Parallel Disk I/O