We are wired to recognize faces, but we must be taught how to read. The two functions actually seem to reflect two distinct types of brain mechanism. There may in fact be some good answers as to why not, but they ought to be our willful choices, not defaults based upon old paradigms. On your way to work this morning you passed, say, a million trees. This is probably an entirely adequate description of that experience unless you happen to be an arborist, in which case you could have a more detailed recollection of tree types, condition, method of planting, etc.
Arborists have a different contextual filter with which to parse the sensory stream of tree images.
Now imagine you saw on inverted pine tree on your journey. You would certainly remember this particular tree, perhaps for the rest of your life. All you witnessed was a 180 degree geometric rotation of one out of a million objects. This particular tree is so memorable because it violated your internal model of how trees grow and appear in our world. This attribute of human reasoning and perception is often called common sense.