You should swipe down the screen and tap on the voicemail icon. Then press the green number and delete it.