Remove from entity as well as removing all future additions