Only delete what we know about, the rest belongs in cf-release