final tweaks to shell scripts and hive queries