Image display apparatus, image display method, program, and record medium

An image display apparatus is disclosed. The image display apparatus includes a detection section, an image forming section, and a display process section. The detection section detects a user's watching state. The image forming section that forms a display image which is displayed on a screen based on a plurality of images and changes the display image based on a detected result of the detection section. The display process section which performs a process of displaying the display image formed by the image forming section.

CROSS REFERENCES TO RELATED APPLICATIONS

The present invention contains subject matter related to Japanese Patent Application JP 2008-032176 filed in the Japanese Patent Office on Feb. 13, 2008, the entire contents of which being incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image display apparatus, an image display method, a program, and a record medium, and in particular, relates to techniques suitable to display a plurality of images on a large wall-size screen.

2. Description of the Related Art

As digital still cameras, video cameras, and mobile telephone terminals having a camera function have become common in recent years, everybody can capture still images and moving images with ease. In addition, since the storage capacity of record media of image data captured is increasing, the amounts of captured images recorded on these record mediums tend to become huge. Thus, watching captured images that have been quantitatively recorded takes time and effort.

To solve such a problem, the above-mentioned image capturing apparatus is connected to a display such as a television receiver, and a list of thumbnails of a plurality of captured images is displayed on the screen of the display. In this case, a display method and a key operation method are devised so that the user can quickly retrieve his or her desired image.

Japanese Unexamined Patent Application Publication No. 2004-260412, referred to as Patent Document 1, describes a technique of allowing the user to access a desired image from a list of thumbnail images on the display with small number of key operations.

SUMMARY OF THE INVENTION

The screen sizes of television receivers are becoming large year after year. Television receivers having a screen exceeding 100 inches have been placed on the market. In addition, highly precise displays have been developed and television receivers having a screen with a resolution of 1920 (W) pixels×1080 (H) pixels, called full high definition (HD) or full high-vision, have been commercialized. In near future, it is said that television receivers having a screen with a resolution of 4000 (W) pixels×2000 (H) pixels, called 2K4K, will appear. In addition, since the use of home projectors is increasing, it can be said that large screens for still images and moving images are fitting into people's lifestyle.

When a large number of images captured by the foregoing apparatus are displayed on such a large size display, the user can look over each image displayed on the screen. It is believed that information obtained by looking over an image is different from information obtained at a position close to the screen in their quality. Thus, it is thought that if the display method on a large screen is devised, information that is difficult to be displayed on a regular size screen can be displayed. However, so far, a display method based on such a view point has not been proposed.

In view of the foregoing, it would be desirable to allow the user to effectively watch a plurality of images as a list displayed on a screen.

According to an embodiment of the present invention, there is provided an image display apparatus. The image display apparatus includes a detection section, an image forming section, and a display process section. The detection section detects a user's watching state. The image forming section forms a display image which is displayed on a screen based on a plurality of images and changes the display image based on a detected result of the detection section. The display process section performs a process of displaying the display image formed by the image forming section.

Thus, a display image on a screen is changed depending on whether the watching position of the user is close to or far from the screen.

According to an embodiment of the present invention, since a display image on the screen is changed depending on his or her watching state, he or she can effectively watch the display content of the image on the screen.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Next, with reference toFIG. 1toFIG. 20, a first embodiment of the present invention will be described. In this example, the user displays a large number of images captured by a digital still camera as a list on a large display such that he or she can effectively watch them. In this embodiment, “large size” represents a size that exceeds the field of view of the user who is watching the screen. For example, “large size” represents a size that occupies a full wall having, for example, a diagonal size of 100 inches.

In this case, since each image displayed as a list on the screen is not formed as a thumbnail and has a captured image size, the resolution of each image can be maintained. Thus, the user can check for detail information of each image from the list. The user may be able to designate a display size of each image.

The display of this embodiment may be of any shape as long as it is large. The display may be a rear-projection type display, a plasma display, a liquid crystal display, or the like. Instead, the display may be a screen formed by a front projector. In this embodiment, images captured by a digital still camera are displayed as a list. Instead, images captured by other devices such as a video camera and/or a portable telephone terminal may be used. Instead, each television broadcast program may be displayed instead of captured images.

FIG. 1is a schematic diagram showing an example of a structure of an image display apparatus1according to this embodiment. The image display apparatus1shown inFIG. 1includes an image input section11, an image storage section12, an image information obtaining section13, an image forming section14, a memory15, a display process section16, a display section17, a control section18, and an operation input section19.

The image input section11accepts an input of image data captured by a digital still camera or the like and outputs the input image data to the image storage section12. The image storage section12is composed, for example, of a hard disk drive (HDD), a digital versatile disc (DVD), or the like and stores images that are input from the image input section11.

The image information obtaining section13reads meta data (attribute information) from each of images that compose image data stored in the image storage section12and extracts capture date/time, photographer information (owner information), and so forth therefrom. As meta data, an image file described, for example, in the exchangeable image file format (exif) is referred. If positioning information of the global positioning system (GPS) has been added to meta data, this information may be obtained as capture position information.

The image forming section14reads image data from the image storage section12or those that have been input to the image input section11and forms a display image to be displayed on the display section17. The arrangement of images that compose a display image may be set up at random, in the order of capture dates and times, and so forth. The arrangement of images may have been decided as initial setting or be designated by the user.

The memory15is used to temporarily store image data that are being processed when the image forming section14forms a display image. The memory15is composed of a semiconductor memory or the like. The display process section16performs a process of displaying a display image on the display section17. The display section17is a display that displays a display image generated by the image forming section14. As described above, the display section17is composed of a rear projection type display, a plasma display, a liquid crystal display, or the like.

The control section18includes a micro processing unit (MPU) and so forth. The control section18controls each section of the image display apparatus1. The operation input section19includes buttons, levers, a keyboard, and/or a mouse. The control section18generates an operation signal according to a user's operation input and outputs the generated operation signal to the control section18.

Next, with reference to a flowchart shown inFIG. 2, an example of a process of displaying a plurality of images at random on the display section17, performed by the image display apparatus1, will be described. InFIG. 2, the image forming section14reads images from the image input section11in the input order if they are input to the image input section11or reads images from the image storage section12at random if they have been stored in the image storage section12(at step S1). The image forming section14forms a display image to be displayed with the obtained images (at step S2). The image forming section14outputs the formed display image to the display section17(in a display area) (at step S3).

FIG. 3shows an example of a display image generated in the process shown inFIG. 2and displayed on the display section17. Many images are arranged and displayed on the display section17. InFIG. 3, a total of 336 images of 14 images (W)×24 images (H) are arranged. In addition, the images are arranged at random, for example, image Im1of a child is arranged at the upper left end of the screen and image Im2of a scene is arranged on the right of image Im1. In the following description, images are simply denoted by image Im unless they are necessary to be distinguished.

The display size of each image Im shown inFIG. 3is the size of a captured image. In other words, each image Im has not been formed as a thumbnail. Thus, each image is clearly displayed with a high resolution. As a result, the user can carefully watch each of images Im displayed as a list on a large screen.

Since many images Im are displayed as a list on a large screen, a watching method of a display image composed of many images Im like new content that the user can enjoy may be provided to him or her.

FIG. 4is a flowchart showing an example of a process of arranging images Im in the order of capture dates and times and displaying them on the display section17. InFIG. 4, the image information obtaining section13obtains a plurality of images Im from the image input section11or the image storage section12(at step S11). The image information obtaining section13obtains information of capture date/time recorded along with an image when it was captured for each obtained image Im (at step S12).

Thereafter, the image forming section14arranges each image in time series based on the obtained capture date/time information and forms a display image (at step S13) and outputs the formed display image to the display section17(at step S14).

FIG. 5shows an example of the case that a display image generated in the process shown inFIG. 4is displayed on the display section17. Image Im1of a dog is displayed at the upper left end of the screen shown inFIG. 5and images Im2and Im3of dogs are displayed below image Im1. Images Im4to Im7of scenes are displayed below image Im3.

These images Im are arranged in such a manner that older images are arranged at more left and upper positions (denoted by arrow Ar1inFIG. 5), namely the oldest image is displayed at the upper left end and the newest image is displayed at the lower right end of the screen.

In this display, the user can enjoy each image Im displayed on a large screen along a time base of capture times.

The arrangement order of images based on capture dates and times is not limited to the example shown inFIG. 5. For example, images may be arranged in another manner that time passes from the lower left end to the upper right end of the screen.

In the foregoing examples, one photographer captured a plurality of images Im displayed on the display section17. Instead, a plurality of images Im captured by a plurality of photographers may be displayed on one screen. In this case, individual images Im are displayed with colors assigned to individual photographers.FIG. 6is a flowchart showing an example of this process. InFIG. 6, the image information obtaining section13obtains a plurality of images Im to be displayed on the display section17(at step S21) and obtains information about photographers recorded along with images that were captured for each obtained image Im (at step S22). If meta data recorded along with images are, for example, in the exif format, owner information is obtained as information about photographers.

Thereafter, the image forming section14forms a display image based on the obtained information about photographers such that individual images Im are displayed with colors assigned to photographers (at step S23) and outputs the formed display image to the display section17(at step S24).

FIG. 7shows an example of the case that a display image generated in the process shown inFIG. 6is displayed on the display section17.FIG. 7shows an example in which images are displayed with frame colors assigned to individual photographers. InFIG. 7, colors are represented by line types. In other words, images Im captured by photographer A are represented with a solid line frame. Images Im captured by photographer B are represented with a broken line frame. In this example, since a plurality of images Im captured by six photographers, photographer A to photographer F, are displayed, there are six line types of frames that are assigned to individual photographers.

Images Im with frame colors assigned to individual photographers may be arranged in the order of capture dates and times on the display section17.FIG. 8is a flowchart showing an example of this process. InFIG. 8, the image information obtaining section13obtains a plurality of images Im displayed on the display section17(at step S31) and then obtains information about photographers and information about capturing dates and times recorded along with the individually captured images for each obtained image Im (at step S32).

Thereafter, the image forming section14forms a display image such that individual images are displayed with colors assigned to individual photographers based on the information about photographers (at step S33), arranges the individual images Im with colors assigned to the individual photographers in the order of capture dates and times, and forms a display image (at step S34). Thereafter, the image forming section14outputs the formed display image to the display section17(at step S35). In this example, after images are distinguished with colors assigned to individual photographers, the images are rearranged in the order of capture dates and times. Instead, these processes may be reversely performed.

FIG. 9shows an example of the case that a display image generated in the process shown inFIG. 8is displayed on the display section17. LikeFIG. 7,FIG. 9shows the case that a plurality of images Im captured by six photographers, photographer A to photographer F, that are distinguished with line types that are the same as those shown inFIG. 7are displayed on the screen and the images Im are arranged in such a manner that older images are arranged at more left and upper positions, namely the oldest image is displayed at the upper left end and the newest image is displayed at the lower right end of the screen.

For example, image Im1at the upper left end of the screen to image Im2nearly at the center of the right of image Im1are those captured by photographer B and they have a broken line frame. Image Im23arranged below image Im22to image Im32are those captured by photographer C and they have a dotted line frame. Image Im33below image Im32to image Im45are those captured by photographer B and they have a dashed line frame. In other words, a plurality of images Im captured by a plurality of photographers are successively arranged on one time base of capture dates and times.

Since individual images Im are displayed in such a manner that their photographers are distinguished, they can gather, watch the images together, share their experiences therewith, and exchange their information therebetween. When an image display is performed in this manner, a new communication field can be provided to the users.

In addition, as shown inFIG. 9, when a plurality of images are successively arranged based on each capture date/time, the users can obtain information about objects that the other photographers captured and information about their capture dates and times.

In the foregoing examples, coordinates of a display image displayed on the display section17are one-dimensionally set up. Instead, parameters of coordinates may be two-dimensionally set up in such a manner that “time” and “date (month, day, year)” of capture dates and times are set up on the vertical axis and the horizontal axis, respectively. In this case, if images are arranged at accurate positions of the coordinate axes, although a plurality of images may overlap, they are permitted to be displayed on the display section17.

FIG. 10is a flowchart showing an example of a process of displaying a plurality of images in a display area in which “times” and “dates (month, day, year)” of capture dates and times have been set up in the vertical and horizontal directions of the coordinates, respectively. InFIG. 10, the user is accepted to set up coordinates that compose the display area through the operation input section19or the like (at step S41). Thereafter, the image information obtaining section13obtains individual images Im to be displayed on the display section17(at step S42) and then obtains information about capture dates and times recorded along with the images when they were captured for each obtained image Im (at step S43).

Thereafter, the image forming section14arranges individual images Im in the display area having predetermined coordinate axes based on the obtained information about capture dates and times and forms a display image (at step S44). Since capture dates (month, day, year) and capture times have been set up in the vertical direction and the horizontal direction of the coordinates, respectively, the image forming section14arranges the individual images Im in the two-dimensional space composed of these coordinates. The formed display image is output to the display section17(at step S45).

FIG. 11shows an example of a display image generated in the process shown inFIG. 10and displayed on the display section17. InFIG. 11, for simplicity, images are omitted; only their frames are displayed. LikeFIG. 7,FIG. 11shows a plurality of images Im captured by six photographers, photographer A to photographer F, are displayed and the same line types that distinguish the photographers as those shown inFIG. 7are used.

Thus, since individual images Im are arranged in a space composed of two-dimensional coordinate axes, a display image displayed on the display section17can be read as a graph. In other words, when the user watches a display image displayed on the display section17, he or she can obtain information about “when”, “who”, and “is doing what”. For example, the user can obtain information about other photographers who were capturing objects while he or she was capturing a particular scene at a particular place.

In other words, since arrangement positions of a plurality of images Im are given meanings, the user who looks over the screen is provided with information about relationship of individual images Im or photographers. In addition, the user who watches individual images Im at a close position, he or she can be provided with detail information of individual images Im.

In the example shown inFIG. 11, capture times and dates (month, day, year) are arranged in the vertical direction and horizontal direction of the coordinates, respectively. However, parameters that are set up for coordinates are not limited to such an example. If images are associated with obtained position information, for example, by GPS or the like, longitude and latitude may be set up in the vertical and horizontal directions, respectively. When individual images Im are arranged in such coordinate axes, the user can read information about positions of photographers who captured them from the screen. In addition, the origin of the coordinate axes is not limited to the left end of the display area. Instead, the origin may be set up, for example, at the center of the screen.

InFIG. 11, images Im captured by all photographers, photographer A to photographer F, are arranged in the display area. Instead, only images Im captured by a particular photographer may be displayed in the display area.FIG. 12AtoFIG. 12Fshow display examples in which images Im displayed on the display section17are gradually increased corresponding to the number of photographers.

FIG. 12Ashows an example of a display in which only images Im captured by photographer A are displayed.FIG. 12Bshows an example of a display in which images Im captured by photographer B are displayed along with those captured by photographer A. Likewise,FIG. 12Cshows an example of a display in which images Im captured by photographer C are displayed along with those shown inFIG. 12B.FIG. 12Dshows an example of a display in which images Im captured by photographer D are displayed along with those shown inFIG. 12C.FIG. 12Eshows an example of a display in which images Im captured by photographer E are displayed along with those shown inFIG. 12D.FIG. 12Fshows an example of a display in which images Im captured by photographer F are displayed along with those shown inFIG. 12E.

With these displays, the user who watches the screen can easily know capturing features of individual photographers and compare them.FIG. 12AtoFIG. 12Fexemplify displays in which images captured by individual photographers are gradually increased. Instead, the user may be permitted to freely designate photographers and only images Im captured by the designated photographers may be displayed.

In the foregoing examples, images are arranged on the display section17based on information described in the exif format and positioning information of GPS recorded along with images when they were captured and displayed on the display section17. Instead, images Im may be arranged in the order of higher degrees of correlation with a particular image selected by the user (hereinafter, this image is referred to as a selected image).

Degrees of correlation between images are calculated in such a manner that pixel values as a feature amount of each image Im are detected and the detected pixel values and those of the selected image are compared.

Next, with reference to a flowchart shown inFIG. 13, an example of this process of the image display apparatus1will be described. The user is accepted to select any image through the operation input section19(seeFIG. 1) (at step S51). Thereafter, the image forming section14calculates degrees of correlation of all images to be displayed on the display section17(display area) with the image selected at step S51(at step S52).

In addition, the image forming section14arranges the individual images Im in the order of higher degrees of correlation with the selected image and forms a display image (at step S53) and outputs the formed display image to the display section17(at step S54).

FIG. 14AandFIG. 14Bexemplify displays in which such a process is performed.FIG. 14Bshows an example of image SIm1selected by the user. InFIG. 14AandFIG. 14B, degrees of correlation of images are measured based on pixel values. Image Im whose pixel value is closet to that of the selected pixel SIm1is arranged at the upper left end of the screen. Images Im are arranged in such a manner that images less associated with the selected image SIm1are arranged at more left and upper positions of the screen, namely image Im336arranged at the lower right end of the screen has the largest pixel value difference from the selected image SIm in all the images.

When images Im are displayed in such a manner, the user can watch them on the display section17from a view point of degrees of correlation of images.

If images Im captured by a plurality of users are displayed in the display area, degrees of correlation of images Im captured by the other users are calculated along with those captured by a particular user. Thus, the particular user can watch images Im that have been captured by the other users and that have high degrees of correlation with image SIm selected by the particular user.

In the examples shown inFIG. 13,FIG. 14A, andFIG. 14B, the user is allowed to select any image through the operation input section19. Instead, with a line-of-sight detection apparatus or the like, the position of the user's line-of-sight may be detected and an image displayed at the position of the user's line-of-sight may be treated as a user's selected image and unlike the case shown inFIG. 14AandFIG. 14B, images may not be arranged in the order of higher degrees of correlation with selected image SIm. Instead, only images Im having higher degrees of correlation with selected image SIm may be extracted and highlighted on the display screen.

FIG. 15shows an example of an internal structure of an image display apparatus1A that displays images in such a manner. In the image display apparatus1A shown inFIG. 15, sections corresponding to those ofFIG. 1are denoted by similar reference numerals. The image display apparatus1A also has a line-of-sight detection section20and a gazing position calculation section21in addition to the structure of the image display apparatus1shown inFIG. 1. The line-of-sight detection section20and the gazing position calculation section21serve as a detection section of claims of the present invention.

The line-of-sight detection section20detects the position of user's line-of-sight and outputs the detected information of the line-of-sight position to the gazing position calculation section21. The gazing position calculation section21correlates the user's line-of-sight position of the line-of-sight position information that is output from the line-of-sight detection section20with the display position of image Im and designates image Im arranged at the user's line-of-sight position as image SIm selected by the user.

FIG. 16is a flowchart showing an example of the process of the image display apparatus1A shown inFIG. 15. InFIG. 16, when the line-of-sight detection section20detects the user's line-of-sight position (at step S61), the gazing position calculation section21performs a process of designating image Im arranged at the detected line-of-sight position as selected image SIm (at step S62).

Thereafter, the image forming section14calculates degrees of correlation of all images to be displayed on the display section17with selected image SIm (at step S63) and extracts only images Im with higher degrees of correlation with selected image SIm (at step S64). Thereafter, the image forming section14highlights the extracted images Im, forms a display image (at step S65), and outputs the formed display image to the display section17(at step S66).

FIG. 17AandFIG. 17Bexemplify displays in which the process shown inFIG. 16is performed. InFIG. 17AandFIG. 17B, for easy understanding, only an area near the user's line-of-sight position is illustrated. InFIG. 17A, since user's line-of-sight E1is at a center portion of the display area, image Im arranged at this position is designated as selected image SIm.FIG. 17Bshows an example in which only images having higher degrees of correlation with selected image SIm are highlighted.

InFIG. 17B, since images having higher degrees of correlation with selected image SIm are image Im4, image Im5, image Im6, image Im10, image Im19, and image Im22, these outer frames are highlighted with a solid line.

If images displayed in such a manner, those having higher degrees of correlation with the user's selected image can be presented to him or her without necessity of rearranging individual images Im in the order of higher degrees of correlation.

As shown inFIG. 11, if images are permitted to overlap and images having higher degrees of correlation with selected image SIm are arranged behind other images, in addition to the process of highlighting outer frames of images, a process of displaying images on the foreground plane is performed.

FIG. 18AandFIG. 18Bexemplify displays in which such a process is performed.FIG. 18Ashows the state in which images Im1to image Im5having higher degrees of correlation with selected image SIm are displayed behind other images.FIG. 18Bshows an example of the state in which images Im displayed behind other images are moved to the foreground plane.

When images Im having higher degrees of correlation with selected image SIm have been arranged behind other images that do not have higher degrees of correlation with selected image SIm, if images Im having higher degrees of correlation with selected image SIm are moved to the foreground plane, even if images Im are permitted to overlap on the screen, the user can watch both selected image SIm and images Im having higher degrees of correlation therewith. Images Im displayed on the foreground plane are not limited to those having higher degrees of correlation with selected image SIm, but, for example, images Im captured by a photographer designated by the user.

Instead, images Im having higher degrees of correlation with selected image SIm that have been moved to the foreground plane may be moved toward the position of selected image SIm.

FIG. 19AandFIG. 19Bexemplify displays in which such a process is performed.FIG. 19Ashows the state in which image Im1to image Im11having higher degrees of correlation with selected image SIm are highlighted and moved to the foreground plane.FIG. 19Bshows an example of the case in which image Im1to image Im11are moved toward the position of selected image SIm.FIG. 19Bshows the state in which image Im1to image Im11having higher degrees of correlation with selected image SIm have been moved toward the position of selected image SIm.FIG. 19Bshows the state in which image Im1to image Im11having higher degrees of correlation with selected image SIm are moved in the direction of arrow Ar2and thereby they have been gathered in the vicinity of selected image SIm.

When images are displayed as shown inFIG. 19Aand FIG.19B, even if many images are displayed on a large screen as shown inFIG. 3or the like, the user can simultaneously and easily compare and watch selected image SIm and images Im1to Im11having higher degrees of correlation therewith.

If a plurality of users simultaneously watch one display image, selected image SIm may be decided based on the line-of-sight position of each user. Images Im having higher degrees of correlation with each decided and selected image SIm are highlighted and moved toward the position thereof.

In the structures and processes shown inFIG. 13toFIG. 19AandFIG. 19B, pixel values extracted as feature amounts of parameters of calculating degrees of correlation from selected image SIm and individual images Im are used. Instead, degrees of correlation may be calculated with parameters, for example, of color distribution information and frequencies of a histogram. If objects in images are persons, features of faces, such as eyes, nose, and mouth, are detected as feature amounts and those of detected objects may be compared to calculate degrees of correlation.

Instead, while the user is capturing an object or after he or she has captured it, he or she may be prompted to input information, for example, about the object or a scene. Degrees of correlation of images may be calculated based on these information. As information about objects, categories such as “persons, animals, substances, and scenes” may be provided. When the user captures an image, he or she may be prompted to designate one of these categories to which the captured object belongs.

Instead of prompting the user to select any image Im, he or she may be prompted to designate an object. Only images Im containing the designated object may be extracted. The extracted images Im may be processed such that they are highlighted or moved to the line-of-sight position. In this case, images of particular objects may have been stored in a database and an image recognition is performed with the image information to identify the object. If there are a plurality of users, a plurality of databases that store information about objects may be prepared corresponding to the number of users.

FIG. 20shows an example of a structure of an image display apparatus1B that identifies an object. InFIG. 20, sections corresponding to those inFIG. 1andFIG. 15are denoted by similar reference numerals and their detail description will be omitted. The image display apparatus1B shown inFIG. 20has an image recognition process section22and an object database23(hereinafter also referred to as the DB23) instead of the image information obtaining section13of the image display apparatus1A shown inFIG. 15.

The image recognition process section22compares a standard pattern of information of a particular object stored in the object DB23with a feature amount extracted from each image Im and identifies a feature amount that matches or nearly matches the standard pattern to perform an image recognition. The image recognition process section22determines that image Im that has a feature amount matches or nearly matches the standard pattern be image Im containing an object stored in the object DB23and outputs the determined information to the image forming section14. Image information of objects stored in the object DB23may be provided corresponding to a plurality of objects. In this case, the user is prompted to select one of several objects and image information of the selected object is used as the standard pattern.

In each of the foregoing examples, image Im that the user designates through the operation input section19or the like and image Im arranged at the line-of-sight position detected by the line-of-sight detection section20are decided as image SIm selected by the user, respectively Selected image SIm may be decided by other than the methods of the foregoing examples.

As a method of detecting a user's designation position, the display section17may be composed, for example, of a touch panel. The position that the user has touched may be treated as a user's designation position. Instead, a user's designation position may be detected, for example, with a camera. If the display section17is composed of a rear-projection type projector screen, a sensor such as a camera may be disposed behind the screen and a position detected by the camera may be decided as a user's designation position.

Next, with reference toFIG. 21toFIG. 24AandFIG. 24B, a second embodiment of the present invention will be described. In this embodiment, a process of adjusting the size and arrangement position of each image Im displayed on the display section17is performed based on a user's watching state.FIG. 21is a block diagram showing an example of an image display apparatus1cof this embodiment. InFIG. 21, sections corresponding to those inFIG. 1,FIG. 15, andFIG. 20are denoted by similar reference numerals and their detail description will be omitted.

An image display apparatus1C shown inFIG. 21has a camera24and a watching position calculation section25along with the structure shown inFIG. 1. The camera24captures the vicinity of a user's watching position, detects him or her, and outputs the detected result to the watching position calculation section25. The watching position calculation section25calculates the user's watching position based on the detected result information that is output from the camera24. In addition, the watching position calculation section25calculates the distance between the watching position and the display surface of the display section17. Thereafter, the watching position calculation section25outputs the calculated distance information to an image forming section14. The camera24and the watching position calculation section25serve as a detection section of claims of the present invention.

The image forming section14performs a process of decreasing the display size of each image Im if the user's watching position is far from the screen and performs a process of increasing the display size of each image Im if the user's watching position is close to the screen. In other words, the image forming section14sets up the size of each image Im such that the size of image Im displayed on the display section17is reversely proportion to the distance between the user's watching position and the screen.

FIG. 22is a flowchart showing an example of a process of the image display apparatus1C. InFIG. 22, the watching position calculation section25calculates the distance between the display surface of the image and the user's watching position (at step S71). Thereafter, the watching position calculation section25determines whether or not the currently calculated distance has changed from the last calculated distance (at step S72). If the currently calculated distance between the image display surface and the user's watching position has not changed from the last calculated distance, the process is complete.

If the currently calculated distance between the image display surface and the user's watching position has changed from the last calculated distance, the image forming section14sets up the image display magnification for a value corresponding to the distance (at step S73), sets up the display size of each image Im for the display magnification that has been set up, forms a display image (at step S74), and outputs the formed display image to the display section17(at step S75).

FIG. 23AtoFIG. 23Cshows examples of displays on the display section17when such a process is performed. The left side of each ofFIG. 23AtoFIG. 23Cshows respective side views of the display section17and the user U as an example of the distance between the display surface of the display section17and the watching position of the user U. When the distance between the display surface of the display section17and the watching position of the user U shown inFIG. 23Ais denoted by D1, that shown inFIG. 23Bis denoted by D2, and that shown inFIG. 23Cis denoted by D3, they have the relationship of D1>D2>D3.

The right side of each ofFIG. 23AtoFIG. 23Cshows an example of a display on the display section17at the corresponding distance. When the size of image Im shown in FIG.23A is denoted by Sz1, that shown inFIG. 23Bis denoted by Sz2, and that shown inFIG. 23Cis denoted by Sz3, they have the relationship of Sz1<Sz2<Sz3.

In other words, as shown inFIG. 23A, if distance D1between the watching position of user U and the screen is large, size Sz1of each image Im displayed on the screen becomes small. As shown inFIG. 23C, when distance D3between the watching position of user U and the screen is small, size Sz3of each image Im displayed on the screen becomes large.

If the user wants to look over the display screen, since he or she watches each image from a position far from the screen, many images Im having a small display size are displayed on the screen. As a result, user U can simultaneously look over many images Im. If user U wants to check for details of each image Im displayed on the display screen, since he or she tries to watch each image Im at a position close to the display screen, the size of each image Im displayed on the screen becomes large. Thus, user U can more precisely check for details of each image Im.

In this embodiment, the arrangement order of each image Im and parameters that designate the arrangement order are the same as those of the first embodiment. Thus, when user U looks over a display image on the display section17at a position far therefrom, he or she can obtain information represented by the arrangement position of each image Im such as degrees of correlation of individual images Im and information about their capture times and locations.

The size of image Im is enlarged or reduced based on the watching position of user U.FIG. 23AtoFIG. 23Cexemplify that images Im displayed are not permitted to overlap. However, this embodiment can be applied to the case that images displayed are permitted to overlap. In this case, the size of each image Im is not simply enlarged or reduced. The arrangement position of each image Im is moved as it is enlarged or reduced.

FIG. 24AtoFIG. 24Cexemplify displays in which each image Im displayed on the display section17is gradually enlarged. In each ofFIG. 24AtoFIG. 24C, user U gazes image Im at the center of the screen.

FIG. 24Ashows the state in which in the vicinity of image Im1that user U is gazing other images Im2to Im6that overlap are displayed.FIG. 24Bshows the state in which around image Im1that user U is gazing image Im2to image Im6are gradually moving outward.FIG. 24Cshows the state in which since image Im2to image Im6have moved outward from image Im1that user U is gazing, the individual images nearly do not overlap.

When such a process is performed, even if images Im displayed are permitted to overlap, information that user U wants to obtain is provided corresponding to the watching position of user U such that he or she can obtain the information.

The foregoing series of processes can be executed by hardware or software. If the series of processes are executed by software, a computer that has dedicated hardware in which programs that compose the software have been built is used or the programs are installed from a record medium, for example, to a general-purpose computer that can execute various types of functions by installing various types of software.

FIG. 25shows an example of a structure of a personal computer100(hereinafter also referred to as the PC100) that can perform the series of processes by executing the programs. The PC100shown inFIG. 25has a control section101, a memory102, a communication section103, an operation section104, a display section105, a storage section106, an external storage medium I/F section107, and an external storage medium108.

The control section101is composed of a central processing unit (CPU) and so forth. The control section101executes the above-described series of processes and other various types of processes according to programs stored in the memory102or the storage section106. The memory102is composed of a random access memory (RAM) and a read only memory (ROM). The memory102stores programs, which the control section101executes, data, and so forth.

The communication section103communicates with an external device through a network such as the Internet or a local area network. The external storage medium I/F section107drives the external storage medium108such as a magnetic disc, an optical disc, a magneto-optical disc, or a semiconductor memory, and obtains programs, data, and so forth therefrom. When necessary, the obtained programs and data are transferred to the external storage medium108and recorded thereon.

The operation section104is composed of a keyboard, a mouse, and so forth. The operation section104generates an operation signal corresponding to a user's operation input and outputs the operation signal to the control section101. The display section105is a display device composed of a cathode ray tube (CRT) or an liquid crystal display (LCD). The storage section106is composed, for example, of a hard disk or a digital versatile disc (DVD), and records programs, which the control section101executes, and various types of data.

As shown inFIG. 25, the program record medium that stores programs that are installed to a computer and executed thereby is composed of the external storage medium108. The external storage medium108includes the memory102that stores programs provided to the user and that has been mounted in the apparatus and the storage section106as well as a removable medium such as the foregoing magnetic disk.

When necessary, programs are stored in the program record medium using a wired or wireless communication medium such as a local area network, the Internet, or a digital satellite broadcast through the communication section103that is an interface such as a router or a modem.

In this specification, process steps that describe programs stored in the program record medium include those executed chronologically in the description order and those that are not executed chronologically, but executed in parallel or individually (for example, parallel processes or object processes).

In addition, the programs may be processed by a single computer or distributed by a plurality of computers. In addition, the programs may be transferred to a remote computer and executed thereby.