Abstract:
Methods and systems for classifying images, such as photographs, allow a user to incorporate subjective judgments regarding photograph qualities when making classification decisions. A slide-show interface allows a user to classify and advance photographs with a one-key action or a single interaction event. The interface presents related information relevant to a displayed photograph that is to be classified, such as contiguous photographs, similar photographs, and other versions of the same photograph. The methods and systems provide an overview interface which allows a user to review and refine classification decisions in the context of the original sequence of photographs.

Description:
BACKGROUND OF THE INVENTION 
   1. Field of Invention 
   This invention relates to image classifying methods and systems. 
   2. Description of Related Art 
   People routinely separate photographs into classes before sharing them with others. Before sharing, people typically classify photographs into those they wish to put in the family album to share with others versus those they intend to leave in an unsorted storage box. 
   Digital photographing opens up new worlds of opportunity for sharing and reminiscing about people&#39;s experience with others. With digital images, such as digital photographs, this kind of classification is conducted even more. This occurs because there are more ways to share, such as, for example, digital albums, cards, calendars, slide-shows, CD-ROMs, DVDs, Web pages, and email; more photographs, because, for example, people take more photographs with digital cameras than their analog counterparts; and more classifications, such as, for example, original images, touched-up images and the like. 
   Slide-show and light table user interfaces have been used for classifying digital photographs. For example, slide-show user interfaces are well suited for examining photographs in a close-up way to make judgments regarding the photographs&#39; qualities. However, because such user interfaces display a single photograph at a time, slide-show interfaces are not well suited for making decisions with reference to other related photographs, such as similar photographs, or touched-up versions of the same photograph. Also, the slide-show user interfaces require complex procedures to classify photos, or sort them into separate folders. 
   Light table user interfaces have been used for comparing digital photographs because light table user interfaces display more than one photograph at a time. However, the more photographs that are displayed at one time on such light table user interfaces, the less resolution that is available for each photograph, making close-up examination and comparison challenging. Light table user interfaces have also been used for reviewing classification choices. Although light table user interfaces can provide an overview of photograph classification, light table user interfaces do not display a user&#39;s choices within the context of the original sequence of photographs, making it difficult for a user to see at a glance whether the user excluded photographs the user should have included, and vice versa. 
   SUMMARY OF THE INVENTION 
   This invention provides systems and methods that allow a user to classify an image with a one-key action. 
   This invention additionally provides systems and methods that allow a user to classify a digital photograph with the one-key action. 
   This invention separately provides systems and methods that allow a user to classify an image with reference to related information relevant to the image. 
   This invention additionally provides systems and methods that allow a user to classify a digital photograph in the context of a sequence of digital photographs in which a given digital photograph was taken. 
   This invention separately provides systems and methods that allow a user to classify an image with reference to other images related to that image. 
   This invention separately provides systems and methods that allow a user to classify an image with reference to images that are determined to be similar to that image. 
   This invention separately provides systems and methods that allow a user to classify an image with reference to at least one alternative version of that image. 
   This invention additionally provides systems and methods that allow a user to classify an image with reference to cropped and/or touched-up versions of the image. 
   This invention additionally provides systems and methods that allow a user to classify an image with reference to revisions of the image created by automatically applying enhancements to the image. 
   This invention separately provides systems and methods that allow a user to classify an image with reference to a side-by-side comparison with another image selected from the same sequence in which that image is generated. 
   This invention separately provides systems and methods that allow a user to review and refine image classification decisions while displaying a sequence of images in which an image is generated. 
   This invention additionally provides systems and methods that allow a user to review and refine image classification decisions with reference to related images relevant to a selected image. 
   In various exemplary embodiments of systems and methods according to this invention, a user classifies an image with a one-key action. In such exemplary embodiments, a user uses a single key or mouse click to both classify a current photograph and to advance to the next photograph. 
   In various exemplary embodiments of the systems and methods according to this invention, a user classifies an image with reference to a sequence of images in which the image to be classified was originally generated. In various exemplary embodiments, the user may further refer to related images relevant to the image to be classified. In various exemplary embodiments, the related images can include similar images and alternative versions of the image. In various exemplary embodiments, the user may classify the image with reference to the comparison with another image selected from the same sequence of images in which the image to be classified was originally generated. 
   In various exemplary embodiments of systems and methods according to this invention, a user may review and refine image classification decisions. In various exemplary embodiments, the user may review and refine the image classification decisions in reference to a sequence of images in which an image to be refined is originally generated. In various exemplary embodiments, the user may also review and refine the image classification decisions in reference to related images relevant to an image whose classification is to be refined. 
   This and other features and advantages of this invention are described in, or are apparent from, the following detailed description of various exemplary embodiments of the systems and methods according to this invention. 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
     Various exemplary embodiments of the systems and methods of this invention will be described in detail, with reference to the following figures, wherein: 
       FIG. 1  illustrates a first exemplary embodiment of a user interface according to this invention; 
       FIG. 2  is a flowchart outlining one exemplary embodiment of a first method for classifying photographs according to this invention; 
       FIG. 3  illustrates a second exemplary embodiment of a user interface according to this invention; 
       FIG. 4  illustrates a third exemplary embodiment of a user interface according to this invention; 
       FIG. 5  illustrates a fourth exemplary embodiment of a user interface according to this invention; 
       FIG. 6  is a flowchart outlining one exemplary embodiment of a second method for displaying and classifying images according to this invention; 
       FIG. 7  shows a fifth exemplary embodiment of a user interface according to this invention; 
       FIG. 8  shows a sixth exemplary embodiment of a user interface according to this invention; 
       FIG. 9  is a flowchart outlining one exemplary embodiment of a method for reviewing and refining images classification decisions according to this invention; and 
       FIG. 10  is a functional block diagram of one exemplary embodiment of an image classification system according to this invention. 
   

   DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 
   In various exemplary embodiments of the system and methods according to this invention, image classifications are recorded. In various exemplary embodiments, a file system folder is created for each classification, and each image is linked or copied to an appropriate folder based on the classification of this image. In various other exemplary embodiments, each image is labeled with its classification, using a database. 
     FIG. 1  illustrates a first exemplary embodiment of a user interface usable to classify images according to this invention. As shown in  FIG. 1 , the user interface  100  comprises a graphical user interface  110  and an input device  140 . The graphical user interface  110  comprises a classification portion  120  and an image portion  130 . The image portion  130  displays images, such as digital photographs. The classification portion  120  comprises classification buttons such as a return button  122 , an accept button  124 , a neutral button  126  and a reject button  128 . In various exemplary embodiments, the accept button  124  indicates that the user believes that the photograph shown in the image portion  130  is an acceptable photograph, the reject button  128  indicates that the photograph shown in the image portion  130  is not an acceptable photograph, and the neutral button  126  indicates that the user feels neutrally about the photograph shown in the image portion  130 . 
   In various exemplary embodiments, the accept button  124 , the neutral button  126  and/or the reject button  128 , when selected, causes the image currently displayed in the image portion  130  to be classified into a corresponding classification, and automatically causes a subsequent image to be displayed in the image portion  130  in place of the current image. Thus, a one-key action, or a single graphical user interface event, is sufficient to classify each image and to advance to the next image, without requiring another action or graphical user interface event from the user. 
   In various exemplary embodiments, the subsequent image is the image that is next to the current image in a sequence of images in which the images were originally taken. In various other exemplary embodiments, the subsequent image is the image that is next to the current image in a sequence of images in which the user intends to classify the images. 
   In various exemplary embodiments, the accept button  124 , the neutral button  126  and/or the reject button  128 , when selected, causes the image currently displayed in the image portion  130  to be linked or copied to a file system folder corresponding to the classification of the image. In various other exemplary embodiments, the accept button  124 , the neutral button  126  and/or the reject button  128 , when selected, causes the image currently displayed in the image portion  130  to be labeled, using a database, with the classification of the image. 
   The return button  122 , when selected, causes the graphical user interface to display a previous image in the image portion in place of the currently displayed image. This way, a user can return to the previous image and modify the classification assigned to the previous image. 
   In various exemplary embodiments, the previous image is the image that is immediately before the current image in a sequence of images in which the images were originally taken. In various other exemplary embodiments, the previous image is the image that is immediately before the current image in a sequence of images in which the user intends to classify the images. 
   It should be appreciated that more buttons can be added in the classification portion  120 . For example, a deletion button and a modification widget may be added. Also, a “next” button may be added, such that the user can advance to the next image without classifying the current image. It should also be appreciated that one or more of the buttons  122 - 128  included in the classification portion  120  shown in  FIG. 1  may be omitted. 
   It should be appreciated that the events mapped to the accept button  124 , the neutral button  126  and the reject button  128 , respectively, can also be mapped to, and therefore activated by the selection of, other widgets. In various exemplary embodiments, the events mapped to the accept button  124 , the neutral button  126  and the reject button  128 , respectively, are mapped to and activated by the selection of a set of keys of a keyboard. In various exemplary embodiments, the events mapped to the accept button  124 , the neutral button  126  and the reject button  128 , respectively, are mapped to and activated by the selection of a set of direction keys of a keyboard, as shown in  FIG. 1 . It should be appreciated that the events mapped to the accept button  124 , the neutral button  126  and the reject button  128 , respectively, may also be mapped to and activated by other input devices, such as mouse buttons, track ball buttons, dummy switches, joystick buttons or the like having sufficient distinct buttons, or voice commands or gestures. 
     FIG. 2  is a flowchart outlining one exemplary embodiment of a first method for classifying photographs according to this invention. Beginning in step S 100 , operation of the method continues to step S 110 , where an image is displayed. Then, in step S 120 , a user performs a one-key action to classify the displayed image. Next, in step S 130 , a determination is made whether the one-key action is a return button action. If so, operation jumps to step S 140 . Otherwise, operation jumps to step S 150 . 
   In step S 140 , the previous image is displayed in place of the current image. Operation then returns to step S 120 , where the previous image may be classified. In contrast, in step S 150 , the displayed image is classified according to the user&#39;s one-key action. Next, in step S 160 , a determination is made whether there is a next image to classify. If so, the displayed image is not the last image in an image sequence, and operation continues to step S 170 . Otherwise, operation jumps to step S 180 . 
   In step S 170 , a next image is displayed. Operation then returns to step S 120 , where the next image may be classified. In contrast, in step S 180 , operation of the method ends. 
     FIG. 3  illustrates a second exemplary embodiment of a user interface  200  usable to classify images according to this invention. As shown in  FIG. 3 , the user interface  200  includes a graphical user interface  210 . The graphical user interface  210  comprises a classification portion  220 , an image portion  230 , and a film strip portion  240 . The classification portion  220  and the image portion  230  are similar to the classification portion  120  and the image portion  130 , respectively, of  FIG. 1 . The classification portion  220  comprises classification buttons such as a return button  222 , an accept button  224 , a neutral button  226  and/or a reject button  228 . The film strip portion  240  displays a sequence  242  of images. 
   In various exemplary embodiments, the sequence  242  of the images displayed in the film strip portion  240  is a series of digital photographs arranged in the sequence in which the digital photographs were taken. In various exemplary embodiments, the sequence  242  is arranged horizontally from the left hand side of the film strip portion  240  to the right hand side of the film strip portion  240 , with the digital photographs that were taken earlier in the sequence  242  displayed on the left and those taken later on the right. 
   It should be appreciated that the sequence  242  can start from the right-hand side and end at the left-hand side. It should also be appreciated that the sequence  242  can be arranged in other orientations, such as vertical and diagonal directions. In addition, it should be appreciated that the film strip portion  240  can be placed at different locations within the graphical user interface  200 , such as at a location above or to one side of the image portion  230 . 
   Each of the images in the sequence  242  displayed in the film strip portion  240  may be highlighted by an input or selection device, such as a mouse, a track ball, a keyboard or the like. In various exemplary embodiments, the highlighting is activated by simply placing a pointer of the input or selection device over a selected image  244  in the sequence  242 . In various other exemplary embodiments, the highlighting is activated by an affirmative selection, such as a click of the mouse, over the selected image  244 . 
   In various exemplary embodiments, when the selected image  244  is highlighted, an enlarged image  234  of the selected image  244  is displayed in the image portion  230 . The enlarged image  234  enables a user to have a close-up look at the selected image  244 . The user may classify the selected image by performing a one-key action using the buttons  222 - 228  provided in the classification portion  220 . After an image is classified, the highlight automatically advances to the next image in the sequence  242  as displayed in the film strip portion  240 . Accordingly, the newly highlighted image becomes the newly selected image and an enlarged image  234  of the newly selected image is displayed in the image portion  230 . 
   In various exemplary embodiments, the classification state and/or status of the images that have been classified are indicated in the film strip portion  240 . For example, as shown in  FIG. 3 , an image  246  on the left-hand side of the selected image  244  that has been classified is displayed with a symbol that indicates the classification assigned to that image. 
   In various exemplary embodiments, different classification indications in the film strip portion  240  are associated with different visual-effect representations, such as colors, image qualities, and symbols, to provide easy and quick visual identification of the classification indications. In various exemplary embodiments, the accepted, reject and neutral images are associated with green, red and yellow frames, respectively. It should be appreciated that in various other exemplary embodiments, different classification indications and/or different classifications may be used. 
   In various exemplary embodiments, a reject image is indicated as a faded or filtered image. In such a faded image, the image quality is degraded by, for example, reduced contrast or brightness. Thus, the features in the faded image are still visible, but not as clear as the features in an accepted, normal image. 
   In various exemplary embodiments, the location of each image in the sequence  242  shown in the film strip portion  240  remains unchanged during a classification session, with the highlighting of the selected image shifting from the left to the right as each image in sequence  242  is selected and classified in turn. In various other exemplary embodiments, the sequence  242  of the images shown in the film strip portion  240  is automatically updated during the classification session. In various exemplary embodiments, when the classification of a selected image is made and a new image is selected, the images in the sequence  242  displayed in the film strip portion  240  are shifted to the left, with the left most image being pushed off the film strip portion  240 , and a new image is added to the sequence  242  on the right-hand side of the film strip portion  240 . This way, the position of the automatically-selected image is steady at a certain position, such as the center of the film strip portion  240 . 
   As shown in  FIG. 3 , the user can refer to a sequence of images in which a photograph is taken, so that the user can make a more informed decision regarding the classification of a selected photograph. This is particularly useful when the user takes multiple photographs of the same subject matter in order to choose the user&#39;s favorites at a later time. 
     FIG. 4  illustrates a third exemplary embodiment of a user interface  300  usable to classify images according to this invention. As shown in  FIG. 4 , the user interface  300  includes a graphical user interface  310 . The graphical user interface  310  comprises a classification portion  320 , an image portion  330 , and a film strip portion  340 . The classification portion  320  and the image portion  330  are similar to the classification portion  120  and the image portion  130 , respectively, of  FIG. 1 . The classification portion  320  comprises classification buttons, such as a return button  322 , an accept button  324 , a neutral button  326  and/or a reject button  328 . The film strip portion  340  displays a sequence  342  of images. In various exemplary embodiments, the sequence  342  displayed in the film strip portion  340  is a series of digital photographs arranged in the sequence  342  in which the digital photographs were taken. 
   In various exemplary embodiments, the display portion  330  is used to display two or more enlarged images. As shown in  FIG. 4 , a first enlarged image  334  is displayed at a first display position  332  within the image portion  330 . A second enlarged image  338  is displayed at a second display position  336  within the image portion  330 . In various exemplary embodiments, the first enlarged image  334  corresponds to an image  344  displayed within the film strip  340  that is automatically selected upon classifying the previous image. The second enlarged image  338  corresponds to an image  348  displayed in the film strip portion  340  that is selected by the user. In various exemplary embodiments, the image  348  is selected by the user by highlighting the image  348 . 
   In various exemplary embodiments, the first display position  332  and the second display position  336  are arranged side-by-side, so that the user can review the first enlarged image  334  and the second enlarged image  338  simultaneously to decide a classification for at least the first enlarged image  334 . In various other exemplary embodiments, the first display position  332  is arranged vertically above the second display position  336  so the user can simultaneously view the first and the second enlarged images  334  and  338 . In various other exemplary embodiments, the first and the second display positions  332  and  336  are arranged in other positional relations, such as in a diagonal relation. In various other exemplary embodiments, the positions of the first and the second display positions  332  and  336  can be adjusted by the user. 
     FIG. 5  illustrates a fourth exemplary embodiment of a user interface  400  usable to classify images according to this invention. As shown in  FIG. 5 , the user interface  400  includes a graphical user interface  410 . The graphical user interface  410  includes a classification portion  420 , an image portion  430 , and a film strip portion  440 . The classification portion  420  and the image portion  430  are similar to the classification portion  120  and the image portion  130 , respectively, of  FIG. 1 . The classification portion  420  comprises classification buttons, such as a return button  422 , an accept button  424 , a neutral button  426  and/or a reject button  428 . The film strip portion  440  displays a sequence  442  of images. In various exemplary embodiments, the sequence  442  displayed in the film strip portion  440  is a series of digital photographs arranged in the sequence  442  in which the digital photographs were taken. 
   In various exemplary embodiments, the display portion  430  is used to display an enlarged image  434 , which corresponds to an image  444  displayed in the film strip portion  440 . In various exemplary embodiments, the image  444  is automatically selected in response to the classification of the previous image. In various exemplary embodiments, the image  444  is selected by the user. In various exemplary embodiments, the image  444  is selected by the user by highlighting the image  444 , in a way similar to highlighting the image  244  of  FIG. 3 , as discussed above. 
   As shown in  FIG. 5 , the graphical user interface  410  further comprises a similar image portion  450  and a version portion  460 . The similar image portion  450  displays zero, one or more similar images  452  that are determined to be related to or similar to the selected image  444 . In various exemplary embodiments, the zero, one or more similar images  452  are determined to be related to or similar to the selected image  444  based on computed similarities. The zero, one or more similar images  452  are retrieved and displayed in the similar image portion  450  when the selected image  444  is selected. 
   The version portion  460  displays zero, one or more alternative version images  462  of the selected image  444 . The zero, one or more alternative version images  462  include modified images, such as cropped or touched-up versions, of the selected image  444 . In various exemplary embodiments, the zero, one or more alternative version images  462  are created manually. In various other exemplary embodiments, the zero, one or more alternative version images  462  are created automatically by applying one or more image enhancements, such as, for example, color, contrast, and/or saturation enhancements. The zero, one or more alternative version images  462  are retrieved and/or automatically created when the selected image  444  is selected from the sequence  442  displayed in the film strip portion  440 . It should be appreciated that, in some exemplary embodiments, one or both of the similar image portion  450  and the version portion  460  can be omitted. Likewise, other portions can be added to display related information, such as an overview of the images the user has already classified. In various exemplary embodiments, the film strip portion  440  is omitted. In such exemplary embodiments, the display portion  430  displays an enlarged image  434  that corresponds to an image in a sequence which is not shown. The similar portion  450  and the version portion  460  show similar images  452  and alternative images  462 , respectively, of the enlarged image  434 . 
     FIG. 6  is a flowchart outlining one exemplary embodiment of a second method for displaying and classifying images according to this invention. Beginning in step S 200 , operation of the method continues to step S 210 , where a sequence of images is displayed for classification. Then, in step S 220 , an image of the displayed sequence is selected from the displayed sequence. In various exemplary embodiments, the selected image is automatically selected in response to a prior image being classified. In such exemplary embodiments, when there is no prior image that has been classified, the first image in the displayed sequence of images, such as the first image in the sequence of digital photographs, is selected as default. In various other exemplary embodiments, the image is selected manually by the user by highlighting a selected image. Next, in step S 230 , an enlarged image corresponding to the selected image is displayed. Operation then continues to step S 240 . 
   In step S 240 , the selected image is classified by the user performing a one-key action. Next, in step S 250 , a determination is made whether there are anymore images to be classified. If so, operation jumps to step S 220 , where another image is automatically selected. Otherwise, operation proceeds to step S 260 , where operation of the method ends. 
   In various exemplary embodiments, additional steps can be performed between steps S 230  and S 240  to display two or more enlarged images simultaneously, as discussed above in connection with  FIG. 4 . In various other exemplary embodiments, additional steps can be performed between steps S 230  and S 240  to display related information, such as images that are similar to the selected image and alternative versions of the selected image, as discussed above in connection with  FIG. 5 . 
     FIG. 7  shows a fifth exemplary embodiment of a user interface  500  usable to review and refine image classification decisions according to this invention. As shown in  FIG. 7 , the user interface  500  includes a graphical user interface  510 . The graphical user interface  510  includes an image display portion  530 . A sequence  532  of images is displayed in the image display portion  530 . Each image in the sequence  532  has been classified, and the classification for each image in the sequence  532  is indicated in the image display portion  530 . Each image in the sequence  532  displayed in the image display portion  530  can be selected to change that image&#39;s classification. 
   In various exemplary embodiments, the sequence  532  is a series of digital photographs arranged in a sequence in which the photographs were taken. In various exemplary embodiments, the sequence starts at the upper-left-hand corner of the image display portion  530 , continues horizontally to the right-hand side until the upper right corner of the image display portion  530 , then repeats a next row. In various other exemplary embodiments, the sequence starts at the upper-left-hand corner of the image display portion  530 , continues vertically down to the lower-left-hand corner of the image display portion  530 , then repeats a next column. It should be appreciated that the sequence  532  of images can be arranged in other ways. 
   In various exemplary embodiments, each image in the sequence  532  displayed in the image display portion  530  has been classified as accepted, neutral or rejected. As shown in  FIG. 7 , an image  534  contains an indication that that image is an accepted image, an image  536  contains an indication that that image is a neutral image, and an image  538  contains an indication that that image is a reject image. 
   In various exemplary embodiments, different classification indications are associated with different visual-effect representations, such as colors, image qualities, and symbols, to provide easy and quick visual identification of the classification indications. In various exemplary embodiments, the accepted, reject and neutral images are associated with green, red and yellow frames, respectively. It should be appreciated that in various other exemplary embodiments, different classification indications and/or different classifications may be used. 
   In various exemplary embodiments, a reject image is indicated as a faded or filtered image. In such a faded image, the image quality is degraded by, for example, reduced contrast or brightness. Thus, the features in the faded image are still visible, but not as clear as the features in an accepted, normal image. 
   As discussed above, in various exemplary embodiments, each image in the sequence  532  displayed in the image display  530  can be selected to change its classification. In various exemplary embodiments, an image is selected by highlighting the image. In various exemplary embodiments, when an image is selected, a classification portion (not shown) is activated or displayed. The classification portion is similar to the classification portion  120  shown in  FIG. 1 . Upon activating a classification button of the classification portion, the selected image can be reclassified. In various other exemplary embodiments, each image in the sequence  532  may be reclassified using a context menu or drag-and-drop technique, so that the user can see the results of the reclassification immediately. 
     FIG. 8  shows a sixth exemplary embodiment of a user interface  600  according to this invention. In this exemplary embodiment, classified images are reviewed for possible refinement or reclassification. As shown in  FIG. 8 , the user interface  600  includes a graphical user interface  610 . The graphical user interface  610  includes an image display portion  630 . A sequence  632  of images is displayed in the image display portion  630 . Each image in the sequence  632  has been classified. The classification of each image in the sequence  632  is indicated in the image display portion  630 . Each image in the sequence  632  displayed in the image display portion  630  can be selected to change its classification. In various exemplary embodiments, an image is selected by highlighting that image. In various exemplary embodiments, the sequence  632  is a serious of digital photographs arranged in a sequence in which the photographs were taken. 
   As shown in  FIG. 8 , the graphical user interface  600  further includes a similar image portion  650  and a version portion  660 . Similar to the similar image portion  450  and the version portion  460 , respectively, of  FIG. 5 , the similar image portion  650  and the version portion  660  display zero, one or more similar images  652  and zero, one or more alternative version images  662  for a selected image  639  displayed in the image display portion  630 . The similar images  652  and the alternative version images  662  are related to the selected image  639  in a way similar to that in which the similar images  452  and the alternative version images  462  of  FIG. 5  are related to the selected image  444 . 
     FIG. 9  is a flowchart outlining one exemplary embodiment of a method for reviewing and refining image classification decisions according to this invention. Beginning in step S 300 , operation of the method continues to step S 310 , where an image sequence is displayed. Then, in step S 320 , one image in the image sequence is selected. Next, in step S 330 , the classification of the selected image is changed or refined. Operation then continues to step S 340 . 
   In step S 340 , a determination is made whether there are any more images to be reviewed and/or reclassified. If so, operation returns to step S 320 , where the selection of another image is performed. Otherwise, if not, operation continues to step S 350 , where operation of the method ends. 
   In  FIG. 9 , between steps S 320  and S 330 , one or more additional steps may be included to retrieve and/or to display related information relevant to a selected image. The related information includes similar images  652  and/or alternative version images  662 , as discussed above in connection with  FIG. 8 . 
     FIG. 10  is a block diagram outlining one exemplary embodiment of an image classification system  700  according to this invention. As shown in  FIG. 10 , the image classification system  700  includes an input/output (I/O) interface  710 , a controller  720 , a memory  730 , a classifying circuit, routine or application  740 , a retrieving circuit, routine or application  750 , an interface generating circuit, routine or application  760 , and a user interface event interpreting circuit, routine or application  770 , each interconnected by one or more controlled and/or data busses and/or application programming interfaces  780 . 
   As shown in  FIG. 10 , the image classification system  700  is, in various exemplary embodiments, implemented on a programmed general-purpose computer. However, the image classification system  700  can also be implemented on a special-purpose computer, a programmed micro processor or micro controller and peripheral integrated circuit elements, an ASIC or other integrated circuits, a digital signal processor (DSP), a hard wired electronic or logic circuit such as a discrete element circuit, a programmable logic device such as a PLD, PLA, FPGA or PAL, or the like. In general, any device capable of implementing a finite state machine that is in turn capable of implementing the flowcharts shown in  FIGS. 2 ,  6  and/or  9 , can be used to implement the image classification system  700 . 
   The I/O interface  710  interacts with the outside of the system. For example, the I/O interface  710  receives images from an image source  800  over a link  810 . The  110  interface  710  also outputs classified images to an image sink  900  over a link  910 . The I/O interface  710  also interacts with users through one or more user input devices (not shown) and one or more display devices (not shown). The one or more display devices may be a display screen, an interactive screen, or the like. The one or more user input devices may be a mouse, a track ball, a keyboard, a joystick, or the like. The one or more user input devices may also be dummy switches displayed on the one or more display devices. 
   As shown in  FIG. 10 , the memory  730  includes an image portion  732 , a classification portion  734 , a related information portion  736 , and a user interface portion  738 . The memory  730  can be implemented using any appropriate combination of alterable, volatile or nonvolatile memory or nonalterable or fixed memory. The alterable memory, whether volatile or nonvolatile, can be implemented using any one or more of static or dynamic RAM, a floppy disk and disk drive, a writeable or rewriteable optical disk and disk drive, a hard drive, flash memory, or the like. Similarly, the nonalterable or fixed memory can be implemented using any one or more of ROM, PROM, EPROM, EEPROM, an optical ROM disc, such as a CD-ROM or a DVD-ROM disc, and disc drive or the like. The image portion  732  stores images received at the I/O interface  710 . The classification portion  734  stores image classifications and/or classified images. The related information portion  736  stores information related to images, such as alternative version images. The user interface portion  738  stores information for interfacing with users during classification processes. 
   In the image classification system  700  shown in  FIG. 10 , the interface generating circuit, routine or application  760  receives images from the I/O interface  710 , and transfers classified images to the I/O interface  710 . The interface generating circuit, routine or application  760  also transfers images to the one or more display devices for display. The user interface event interpreting circuit, routine or application  770  receives a user&#39;s input through the one or more user input devices and the input/output interface  710  and interprets the user&#39;s classification decisions represented by the received user inputs. The classifying circuit, routine or application  740  classifies images according to the interpreted classification decisions. 
   The retrieving circuit, routine or application  750  retrieves related information for selected images and transfers the related information to the one or more display devices for display. The retrieving circuit, routine or application  750  retrieves related information for a selected image by determining images that are similar to the selected image. The retrieving circuit, routine or application  750  also retrieves related information for a selected image by retrieving alternative image versions of the selected image stored in the related information portion  736 . 
   The image source  800  can be any one or more of a number of different image sources such as a digital camera, a digital copier, a facsimile device, a scanner, or a locally or remotely located computer, or any other known or later developed device that is capable of generating electronic images. Similarly, the image source  800  can be any suitable device that stores and/or transmits electronic images, such as a client or a server of a network, or the Internet, and especially the Word Wide Web. In various exemplary embodiments, the image source  800  can be integrated with the I/O interface  710 , as in a digital camera having an integrated image classifier. In various other exemplary embodiments, the image source  800  can be connected to the I/O interface  710  over a connection device, such as a modem, a local area network, a wide area network, an intranet, the Internet, any other distributed processing network, or any other known or later-developed connection device. 
   It should be appreciated that, while the images can be generated at the time of taking digital photograph photographs, the images could have been generated at any time in the past. The image source  800  can thus include any known or later developed device which is capable of supplying electronic images to the I/O interface  710 . For example, the image source  800  may be a data carrier such as a magnetic storage disc, CD-ROM, or the like, or a host computer that contains images. Thus, the image source  800  can be any known or later-developed source that is capable of providing images to the image classification system  700  according to this invention. Similarly, the image sink  900  can be any known or later-developed device that is capable of receiving classified images output by the image classification system  700  and either storing, transmitting, or displaying the classified images. 
   In an exemplary operation in which a user classifies images by performing one-key actions according to this invention, the interface generating circuit, routine or application  760 , under control of the controller  720 , displays, at the one or more display devices, an image in an image sequence from the image portion  732 . The interface generating circuit, routine or application  760 , under control of the controller  720 , also displays a plurality of one-key action classification buttons, such as the classification buttons  122 - 128  shown in  FIG. 1 , from the user interface portion  738 . 
   When the user selects, using a one-key action, one of the classification buttons at the one or more user input devices, the user interface event interpreting circuit, routine or application  770  receives the one-key action from the user and, under control of the controller  720 , interprets the event associated with the user&#39;s one-key action. When the user&#39;s one-key action indicates a “return,” the interface generating circuit, routine or application  760 , under control of the controller  720 , displays a previous image in the image sequence at the one or more display devices. 
   On the other hand, when the user&#39;s one-key action indicates a classification decision, the user interface event interpreting circuit, routine or application  770 , under control of the controller  720 , interprets the user&#39;s classification decision, such as “accept,” “neutral” and “reject,” of the currently displayed image. The classifying circuit, routine or application  740 , under control of the controller  720 , classifies the currently-displayed image according to the interpreted classification decision, and stores the classification in the classification portion  734 . The interface generating circuit, routine or application  760 , under control of the controller  720 , automatically and without any further input from the user, displays a next image, if any, in the image sequence for classification. 
   In an exemplary operation in which a user classifies an image with reference to related information, the interface generating circuit, routine or application  760 , under control of the controller  720 , displays an image sequence, such as the image sequence  242  shown in  FIG. 3 , at the one or more display devices. The interface generating circuit, routine or application  760 , under control of the controller  720 , also displays an enlarged image, such as the enlarged image  234  shown in  FIG. 3 , corresponding to a current image in the image sequence. The current image is typically indicated, such as highlighted, in the image sequence. At the beginning of a classification process, the current image is typically the first image in the image sequence. On the other hand, during the classification process, the current image is typically the image which is in a position to be classified. 
   The interface generating circuit, routine or application  760 , under control of the controller  720 , also displays a plurality of one-key action classification buttons, such as the classification buttons  122 - 128  shown in  FIG. 1 . When a user selects one of the classification buttons at the one or more user input devices using a one-key action, the user interface event interpreting circuit, routine or application  770  receives the one-key action from the user and, under control of the controller  720 , interprets the event associated with the user&#39;s one-key action. When the user&#39;s one-key action indicates a “return,” the interface generating circuit, routine or application  760 , under control of the controller  720 , displays a previous image in the image sequence at the one or more display devices. 
   On the other hand, when the user&#39;s one-key action indicates a classification decision, the user interface event interpreting circuit, routine or application  770 , under control of the controller  720 , interprets the user&#39;s classification decision, such as “accept,” “neutral” and “reject,” of the currently displayed image. The classifying circuit, routine or application  740 , under control of the controller  720 , classifies the currently displayed image according to the interpreted classification decision, and stores the classification in the classification portion  734 . The interface generating circuit, routine or application  760 , under control of the controller  720 , displays a classification mark for the classified image in the image sequence, and automatically and without any further input from the user, shifts the highlighting to a next image, if any, in the displayed image sequence for classification. Accordingly, the interface generating circuit, routine or application  760 , under control of the controller  720 , displays an enlarged image corresponding to the newly highlighted image in the image sequence. 
   However, when the user&#39;s input is a selection of another image in the image sequence, instead of a one-key classification action using one of the classification buttons, the interface generating circuit, routine or application  760 , under control of the controller  720 , may also display another enlarged image which corresponds to the selected another image in the image sequence. This other image in the image sequence is typically selected by the user because the user desires to compare this other image with the image to be classified. Accordingly, this other enlarged image is typically displayed together with the enlarged image that corresponds to the image to be classified. An example of a display of two enlarged images is shown in  FIG. 4 . 
   Furthermore, the interface generating circuit, routine or application  760 , under control of the controller  720 , may also display related information related to the image to be classified, such as the similar images  452  and the alternative version images  462  shown in  FIG. 5 , for the user to refer to during the classification process. That is, for an image to be classified, the retrieving circuit, routine or application  750 , under control of the controller  720 , retrieves related information that is related to the image to be classified. The interface generating circuit, routine or application  760 , under control of the controller  720 , displays the related information within, for example, a similar image portion and/or a version portion. 
   In an exemplary operation in which a user reviews and refines image classifications, the interface generating circuit, routine or application  760 , under control of the controller  720 , displays an image sequence, such as the image sequence  532  shown in  FIG. 7 , on the one or more display devices. The retrieving circuit, routine or application  750 , under control of the controller  720 , retrieves image classifications for each image from the classification portion  734 . The interface generating circuit, routine or application  760 , under control of the controller  720 , displays the retrieved classifications together with the images. 
   When the user selects an image, the interface generating circuit, routine or application  760 , under control of the controller  720 , displays a classification portion, such as the classification portion  120  shown in  FIG. 1 , so that the user can reclassify the selected image by selecting a classification key, such as one of the classification keys  122 ,  124 ,  126  and  128  shown in  FIG. 1 . 
   The user interface event interpreting circuit, routine or application  770 , under control of the controller  720 , interprets the user&#39;s classification selection at the classification portion. The classifying circuit, routine or application  740 , under control of the controller  720 , re-classifies the image according to the interpreted classification selection, and updates the classification of the image in the classification portion  734 . 
   The interface generating circuit, routine or application  760 , under control of the controller  720 , may also display related information related to the selected image to be re-classified, such as similar images and alternative version images, for the user to refer to during the re-classification process. That is, for a selected image to be re-classified, the retrieving circuit, routine or application  750 , under control of the controller  720 , retrieves related information that is related to the selected image to be re-classified. The interface generating circuit, routine or application  760 , under control of the controller  720 , displays the related information within, for example, a similar image portion and/or a version portion. 
   While this invention has been described in conjunction with the exemplary embodiments outlined above, it is evident that many alternative modifications and variations will be apparent to those skilled in the art. Accordingly, the exemplary embodiments of the invention set forth above, are intended to be illustrative, not limiting. Various changes may be made without departing from the spirit and scope of the invention.