Physical objects do not change depending on your perspective. Therefore, the objects that you see are not identical to the physical objects. When you have a case of double vision, you see two of something. Therefore, what you see is something non-physical. The only thing one ever sees are colored things.
Physical objects have no color.
Therefore, one does not see physical objects. If an object consists entirely of parts that have no color, then that object has no color. All physical objects consist entirely of elementary particles. Elementary particles have no color. Therefore, physical objects have no color.