Well I think once we finally drop support for non-checks.d config, we can just import checks that have an associated YAML file so we won't hit this issue at all.