Remove handler messages prior to kill the player