Hadoop: Apache's Open Source Implementation of Google's Map/Reduce Framework 1/4 - Defcon 17
Channel: HackedExistence
Date: 2012-07-13

Hacked Existence speech: Apache's Open Source Implementation of Google's Map/Reduce Framework part 1 of 4.

We begin with an overview of the hardware of the Saguaro Cluster at Arizona State University that was the home to our Hadoop Cloud.  We then look all the phases of a Hadoop job, starting with the mapper, then the copy/sort phase, and finally ending with the output from the reduce phase.

Part 1 really goes over the flow of data from input to output across a completed Map/Reduce project.

This speech was given at Defcon 17 in Las Vegas by the Hacked Existence Team.

Check out the project page for full source code here: http://hackedexistence.com/project-hadoop.html