You DO need to pass all vision, health, and safety requirements, but no government or law enforcement agency in the United States can prohibit your from driving simply based on how tall or short you are. From a physical standpoint, nobody is too short to drive.