HIVE-8984: Enable job metrics/statistics gathering for remote spark context [Spark Branch] (Rui via Xuefu)

git-svn-id: https://svn.apache.org/repos/asf/hive/branches/spark@1642251 13f79535-47bb-0310-9956-ffa450edef68
HIVE-8836 - Enable automatic tests with remote spark client [Spark Branch]

git-svn-id: https://svn.apache.org/repos/asf/hive/branches/spark@1642263 13f79535-47bb-0310-9956-ffa450edef68