Better user feedback for incorrect speaker add