Disable Whisper from the user list