Adds pyparsing to requirements.txt
add support for spark 1.x
fix for python 2.6
include priority and resource information in visualizer
Fix deprecation warning when importing luigi.hdfs.

You will still see a deprecation warning when creating an
HdfsTarget if you haven't specified a config.
Merge pull request #485 from jcrobak/fix-luigi-hdfs-deprecation-warning

Fix deprecation warning when importing luigi.hdfs.
Merge pull request #483 from RUNDSP/spark-1x-job-pr

add support for spark 1.x
Merge pull request #484 from Houzz/viz

include priority and resource information in visualizer
This refactoring is functionally equivalent, but separates the state of the scheduler into its own class. The interface between the scheduler and the state is defined in a way so that it can be easily replaced with a SQL database or some other storage engine.
Adds sudo user to worker info when available

Many of the jobs I use have to be run as hadoop, so it's impossible to tell from
the user who actually ran the job. This adds sudo_user to the worker info so
that it's easier to tell who's running what. This is very handy when I need to
figure out why a large backfill or test job is running if it's causing a lot of
errors or hogging all the resources.
Merge pull request #487 from Houzz/sudo_user

Adds sudo user to worker info when available
Adds number of workers to worker_info
Adds a worker list view to the visualizer
Merge pull request #488 from Houzz/workers_count

Adds number of workers to worker_info
Merge pull request #446 from spotify/erikbern/scheduler-refactoring

Erikbern/scheduler refactoring
Merge pull request #489 from Houzz/worker_viz

Adds a worker list view to the visualizer
Fixes workers list
Merge pull request #490 from Houzz/fix_worker_list

Fixes workers list
Merge pull request #481 from Houzz/pyparsing_requirement

Adds pyparsing to requirements.txt
Modify HDFS to ignore Hadoop Native Libraries warning

- By default 64bit Hadoop binaries come with 32bit Native Libraries, which means that hadoop cli tools will add a header to the output:

```
14/10/10 13:38:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
OpenJDK 64-Bit Server VM warning: You have loaded library /usr/local/hadoop-2.3.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
```

The first line will be directed to `stderr` by subprocess and the latter two will be stored in `stdout`.