Added metric collection, split out error handling, test retries, and the
start of the new relic metric publication