Support check clobbering in a backwards compatible way

This should help with compatibility of other existing Nagios
configurations, and deals with leaking checks by clobbering files in a
backwards compatible way.

Change-Id: I435edcc64ce04819854b9c2e327cc32993276ddc