Today, systems are being put in place for airline pilots that put all the information they need on one computer screen. There is no longer the need for hundreds of analog instruments to be spread through out the cockpit. These Directors will then refer you to their Managers, who in turn, will look at you with bulging eyes. Typically, the manager is in the midst of putting out fires, or managing a large move or change to a system. Lets take a look at the typical IT organizational structure.
Development is responsible for developing applications that meet the requirements of the business.
Business Systems Analysts research the business issues and help translate these requirements into development criteria for the developers. Computer Operations is responsible for the completion and delivery of computer output such as payroll, invoices, computer back ups and all other scheduled tasks. Now, back to the initial question. A CIO should be judged on the timeliness of information delivery to the business units and partners. The end user receives and views their information through their work station.