Prevent re-running newrelic config every time