Only delete listeners if they are there...