h1

Evaluating MapReduce for Multi-core and Multiprocessor Systems

January 2, 2008

This paper evaluates the suitability of the MapReduce model for multi-core and multi-processor systems. MapReduce was created by Google for application development on data-centers with thousands of servers. It allows programmers to write functional-style code that is automatically parallelized and scheduled in a distributed system.

We describe Phoenix, an implementation of MapReduce for shared-memory systems that includes a programming API and an efficient runtime system. The Phoenix runtime automatically manages thread creation, dynamic task scheduling, data partitioning, and fault tolerance across processor nodes. We study Phoenix with…

link to video

One comment

  1. [...] such model already exists – MapReduce. More recently a paper was presented for running MapReduce on multi-core systems. This paper evaluates the suitability of the MapReduce model for multi-core and multi-processor [...]



Leave a Comment