Removal effect only occurs if attacker is a player

For consistency more than anything.