Hive improvements

* performance options for hive quries
* removed superfluous hive conf parameters.
* external hive tables.
* end to end hive testing
out of curiosity, is this lazy because the code would be incorrect otherwise? and if so, why?