Despawn entities correctly from clients as they move