Implement DisableMetricsCollection

Fixes TOOLS-226