Actually get rid of the player when banishing