To do so, click longer on the respective entry, then you get the possibility to remove it or delete the chat.