Hover over the name and click the edit icon to the far right. Depending on your device, you may have to scroll down to see the DELETE CONTACT button.