CS267: Lecture 4

Introduction to Parallel Computers and Parallel Programming Methodologies

September 5, 2002

Lecturer: Horst D. Simon

Abstract

The main topic of today's lecture is parallelism models.  We discuss several models of parallel machines and the programming models that most naturally fit on those machines.  We give an overview of shared memory, distributed memory, and data parallelism.  We note that one machine may support several different models, however, and the models typically differ in how complicated they are to use and how well they perform.

2002 Lecture Notes

PowerPoint,

Readings

  • Sourcebook Chapter 2.2 and 2.3
  • start reading Sourcebook Chapters 9, 10, and 12.
  • "Parallel Computer Architecture: A Hardware/Software Approach" by Culler, Singh, and Gupta, Chapter 1.