The familiar upright form of the question mark seems to show up first in early printing in the late 1400s.