Don't crash when removing listeners that were not listening.
Warning in the Readme