some bits pulled together to talk to hive and hdfs to manage logs