Down is a direction, as in "the ball went down the field." 10 would be 10 yards away from where you are.