Improve "Color" init/remove routine

- Allows the "Color" component to be properly removed from entities.
- Properly invalidates the entity when "Color" is added.