Patent ID: 8681123

Claim:
An input/output device comprising: a display section in a form of a flat panel and including, in a mixed manner, image pickup regions for obtaining image pickup data of an object and display regions for displaying an image based on image data, each image pickup region having located therein two contiguous image pixel locations with each image pixel location containing an image pickup pixel, each image pickup region being isolated from the other image pickup regions and immediately surrounded by the display regions; a lens substrate facially opposed to the display section and having a flat section in which microlens sections are interspersed, the lens substrate arranged on a display surface of the display section so that each of the image pickup regions corresponds to one of the microlens sections and each of the display regions corresponds to the flat section such that each microlens section is immediately surrounded in all directions as viewed in planar view by portions of the flat section to which the display regions correspond; an image processing section performing image processing on image pickup data obtained from the image pickup regions to produce two parallax image data from respective ones of the image pickup pixels in the contiguous image pixel locations of the image pickup regions; and a position detection section detecting a three-dimensional x-y-z position of the object based on image pickup data obtained from the image pickup regions of the display section, wherein an x-y position of the three-dimensional x-y-z position is detected by performing an edge detection process on one of the two parallax image data and a z position of the three-dimensional x-y-z position is determined based upon a phase difference between the two parallax image data by calculating a correlation therebetween, wherein, when the image is displayed on the display section from the display regions, image light is emitted therefrom and, when the object approaches the display section as the image light is being emitted therefrom, the image light is applied to the object and reflects therefrom as reflected light and wherein the reflected light from the object is received and condensed by the microlens sections for processing by the image processing section.