Hive improvements

* performance options for hive quries
* removed superfluous hive conf parameters.
* external hive tables.
* end to end hive testing
Because of the state Hadoop and everything else keeps. If you have tests running in parallel it will get confused about which directory each job uses, etc.