That's because with his appearance what was once assumed as true would have to be questioned and dismantled and given up, so that it could yield to a higher truth, a deeper truth. His birth re-defines what it means to be born. This is no ordinary boy, no ordinary birth. Unless one sees this and feels this, unless one leaves the manger like the shepherd rejoicing or leaves the house of this child returning home by a different route, then you've missed the point. We don't know what these wise men said to Mary or Joseph or what they thought about Jesus, other than they offered three gifts.
Gold is a gift for the king.
Frankincense is a sweet perfume used in temple sacrifice. Myrrh is a gift for one who is about to die. On the morning the women went to the tomb to anoint the body of Jesus on Easter morning they more than likely had myrrh with them. This is all we know, so we are left to our imaginations. He imagines the wise men on their camels leaving the cold, snowy mountains of central Persia, eventually finding the place.