Remove the buffer from the suggestions list