Be more intelligent about slot allocation.

When we get a resource offer, we'll try to be clever about how we
allocate slots to the offers.  Ideally we want to use as much of the
resources available when we have a lot of pending tasks, and we also
don't want to use more resources than we actually need.

Review: https://reviews.apache.org/r/11118
Don't prematurely kill TaskTrackers.

We assign the JobID to the internal Mesos tracker (for the TaskTracker)
rather than the TaskID.

In the case where a TaskTracker has only map tasks assigned to it and
they have all completed, we mustn't terminate the tracker until the
entire job has finished, including the map tasks.

Review: https://reviews.apache.org/r/11119
Shuffle offers before sending to frameworks.

This helps ensure fair allocation of resources.

Review: https://reviews.apache.org/r/11121
Kill tasks that never properly launch.

After trying to launch a task tracker, we'll wait up to 5 minutes before
giving up and killing the task.

Review: https://reviews.apache.org/r/11124
Terminate executors that aren't needed.

If we launch an executor and then kill the task immediately after, make
sure we also terminate the executor when there are no other tasks.

Review: https://reviews.apache.org/r/11125
Make sure you clean up the cgroups test.

Sometimes the cgroup test fails because the directory is already there.
This should ensure that it gets cleanup up in that case before we exit.

We'll also check that it exists before we try creating it.  If it
already exists, we'll skip the creation.

Review: https://reviews.apache.org/r/11126
More cgroup killTask() logging.

Review: https://reviews.apache.org/r/11129
Allow JVM memory vars to be configured.

Review: https://reviews.apache.org/r/11130
Changed cgroups killTasks() sequence.

The sequence is as follows:
  stop -> kill -> empty -> freeze -> kill -> thaw -> empty

Review: https://reviews.apache.org/r/11131
Don't accept offers on the same host/port.

We'll try to find a port combination that hasn't already been used to
launch a TaskTracker.

Review: https://reviews.apache.org/r/11161/
Write Mesos JobTracker stats to state file.

Review: https://reviews.apache.org/r/11165/
Pretty-print resource type with parsing error.

Review: https://reviews.apache.org/r/11486
Use string comparison for TaskID.

Review: https://reviews.apache.org/r/11488
s/hadoopJobs/jobs/g in Hadoop scheduler.

Review: https://reviews.apache.org/r/11489
Refactor Hadoop job completion.

Review: https://reviews.apache.org/r/11603
Stop tracker timer when we terminate tasks.

Review: https://reviews.apache.org/r/11604
Add --enable-debug configure flag.

Review: https://reviews.apache.org/r/11605
Increase slave timeout.

Review: https://reviews.apache.org/r/11606
Use XZ (LZMA) for package on Linuxes.

Review: https://reviews.apache.org/r/11112
Turn down noise from ZooKeeper.

Review: https://reviews.apache.org/r/11127