Fixed a bug that the entity wasn't refreshed when it had a component removed