When you watch TV and then close your eyes, for a few seconds you still see some colors. Those colors are the after-images of the colors at which you were looking. Further, you can see shape and form in an after-image. The after-image colors behave in a predictable fashion in that they are the exact opposite of the original colors. Into this mix we also have to understand that there is also a natural affinity towards certain colors, which factors into how you perceive colors.
Lets start with an experiment.
Below is an image of the American flag on a white background. I would like you to stare at the flag. Continue to stare at the flag. Stare at the lower right corner of the orange shape. It is important to not take you eyes off the flag.