SPARK-2231: dev/run-tests should include YARN and use a recent Hadoop version

...rsion