Make sure we have a proper config before attempting to delete