Parallelism in Computation

Shared Memory Vs. Distributed Memory

  • Shared Memory
    • Communicate by saving and retrieving variables
    • Fast
    • Becomes prohibitively expensive as more processing units are added

  • Distributed Memory
    • Communicate by sending and receiving messages
    • Slow
    • Expense increases more slowly than shared
Previous Next