Leave dir before deleting