Slightly more robust: Only delete backup if main exists as well as backup.