Refactor out metric reporting in its own jar