Patent Publication Number: US-2015077512-A1

Title: Substantially Real-Time Feedback in Mobile Imaging Operations

Description:
BACKGROUND 
     1. Field 
     Embodiments generally relate to real-time communication with a mobile imaging system. 
     2. Background 
     Current mobile imaging systems, such as those used to capture panoramic images, require the operator of an imaging system to capture an image, or set of images, and then store them on some type of storage device for processing at a later time, typically after the operator has left the location where the images were captured. As a result, it is difficult to correct any errors in the images that would require the operator to return to the original location. In addition, errors can occur when associating images with the proper location as such associating, cataloging, and processing are performed after the operator has left the imaging location. Furthermore, in such systems, any captured images cannot be immediately shared or processed and thus create inefficiencies. 
     BRIEF SUMMARY 
     For applications such as virtual travel and building walkthroughs, panoramic images may be captured in real-time with a system that can communicate with a central system to allow for faster processing of images with the ability to correct image deficiencies prior to an operator leaving the imaging location. 
     A method and system to communicate with a mobile imaging system in real-time is provided. The method and system illustrate the ability to transfer information related to captured images, system status, and other information pertaining to a remote location, where such information can be analyzed in real-time to provide feedback analysis. 
     In an embodiment, there is provided an imaging system that includes a panoramic imaging device and a mobile communication device. The panoramic imaging device is arranged to capture one or more images, including interior images, and is arranged to be portable. The mobile communication device is communicatively coupled to the panoramic imaging device and provides an interface to the panoramic imaging device for facilitating real-time feedback of the panoramic imaging device operation. Further, the mobile communication device is arranged to receive feedback analysis from a central service system of information relating to the portable panoramic imaging device. The mobile communication device is further arranged to receive information from the central service system based on the feedback analysis. 
     In a further embodiment, there is provided an imaging feedback analysis system that includes a central service system and an image collection database. The central service system is arranged to communicate with a mobile communication device to provide feedback analysis of information relating to a portable panoramic imaging device. The image collection database is arranged to store information relating to one or more captured images from the portable panoramic imaging device. 
     In a further embodiment, there is provided a method that includes capturing panoramic images using a portable panoramic imaging device and providing an interface to the portable panoramic imaging device for facilitating real-time feedback management of panoramic imaging device operation, where the mobile communication device is coupled to the portable panoramic imaging device. The method includes sending, utilizing the mobile communication device, information based on the captured images to a central service system for feedback analysis. The method further includes receiving, utilizing the mobile communication device, information from the central service system based on the analysis. 
     Further embodiments and features, as well as the structure and operation of various embodiments, are described in detail below with reference to the accompanying drawings. It is noted that the invention is not limited to the specific embodiments described herein. Such embodiments are presented herein for illustrative purposes only. Additional embodiments will be apparent to persons skilled in the relevant art(s) based on the information contained herein. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES 
       Embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings in which corresponding reference symbols indicate corresponding parts. Further, the accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments, and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the relevant art(s) to make and use the invention. 
         FIG. 1  illustrates a portable imaging system, according to an embodiment. 
         FIG. 2  illustrates a detailed functional design of a mobile communication device, according to an embodiment. 
         FIG. 3  illustrates a method of communicating information to a central service system for feedback analysis, according to an embodiment. 
         FIG. 4  illustrates an example computer system in which embodiments can be implemented. 
     
    
    
     The features of various embodiments will become more apparent from the detailed description set forth below when taken in conjunction with the drawings, in which like reference characters identify corresponding elements throughout. In the drawings, like reference numbers generally indicate identical, functionally similar, and/or structurally similar elements. The drawing in which an element first appears is indicated by the leftmost digit(s) in the corresponding reference number. 
     DETAILED DESCRIPTION 
     While embodiments described herein are illustrative embodiments for particular applications, it should be understood that the invention is not limited thereto. Those skilled in the art with access to the teachings provided herein will recognize additional modifications, applications, and embodiments within the scope thereof and additional fields in which the invention would be of significant utility. 
     The embodiments described herein are referred in the specification as “one embodiment,” “an embodiment,” “an example embodiment,” etc. These references indicate that the embodiment(s) described can include a particular feature, structure, or characteristic, but every embodiment does not necessarily include every described feature, structure, or characteristic. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is understood that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described. 
       FIG. 1  illustrates a system  100  having a portable imaging system, according to an embodiment. In the example shown in  FIG. 1 , system  100  includes a mobile communication device  110 , an imaging device  120 , a communication network  130 , and a central service system  140 . Mobile communication device  110  communicates with imaging device  120  by sending and receiving information over communication path  117 . Mobile communication device  110  further includes the ability to communicate with central service system  140  over communication network  130  utilizing communication path  115 . Mobile communication device  110  can also include a user interface, such as a keypad  111 , a cursor control  112 , and/or a presentation screen  113 . Imaging device  120  further includes a computer  122 . 
     In an embodiment, imaging device  120  is a portable system, and in another embodiment is capable of self propulsion. Such a portable imaging system can be used to capture panoramic images inside a building, or enclosed space. Given the physical constraints of buildings it is therefore highly desirable for a portable imaging system, such as imaging device  120 , to be as lightweight and power efficient as possible. Efficiencies of space and power consumption can be accomplished by including in imaging device  120 , for example, a miniature personal computer where there is no display screen or input and output device that consumes power and occupies space. 
     In an embodiment, input and output control and presentation of information to a user is accomplished through the use of mobile communication device  110 . The use of mobile communication device  110  provides a user interface between a user and imaging device  120  that allows imaging device  120  to be configured without an onboard display screen and input and output devices as previously mentioned. In addition, such a configuration allows a user to control imaging device  120  through the use of mobile communication device  110  without having to be physically located next to imaging device  120 . In an embodiment, mobile communication device  110  can control multiple imaging devices in a given area and does not have to be physically present next to any particular imaging device. In such an approach mobile communication device  110  can not only control multiple imaging devices, but can also gather data, such as captured images and status information, from each imaging device. 
     In an embodiment, when imaging device  120  is inside a building or structure, network connectivity may not be possible. In fact, it is possible that imaging device  120  does not have the ability to communicate with mobile communication device  110 , for instance due to walls in a building that preclude wireless communication. In such a situation imaging device  120  can locally store information, for example captured images, until communication can be restored. In an embodiment, when communication between imaging device  120  and mobile communication device  110  is restored, then information that is stored on imaging device  120  can be transferred to mobile communication device  110 . If mobile communication device  110  has access to communication network  130  and central service system  140 , information can be transferred to and from central service system  140 . However, in the situation that either communication network  130  and/or central service system  140  are not accessible, then mobile communication device  110  can hold such information until communications are available. A similar situation may occur when mobile communication device  110  has communication connectivity to central service system  140  but may not have communication connectivity to imaging device  120 , in which case mobile communication device will hold such information until a communication path with imaging device  120  becomes available. 
     In an embodiment, imaging device  120  is configured to capture a plurality of images corresponding to a panoramic image. In an embodiment, each of the plurality of images of one or more portions of the panoramic image can be taken with a different setting in imaging device  120 . For instance, a different exposure setting for imaging device  120  can correspond to each of the plurality of images (e.g., exposure bracketing). The plurality of images, each with a different setting in imaging device  120  (e.g., exposure setting), can then be merged into a resulting panoramic image. The operator of imaging device  120  can manually or electronically control the imaging device  120  to capture one or more portions of the panoramic image, according to an embodiment 
     In another embodiment, imaging device  120  can be used as a point-of-interest (POI) imaging device. For instance, imaging device  120  can be used to capture an image of a particular POI in the scene (e.g., artwork hanging on a wall, sign on a door, etc.) In an embodiment, imaging device  120  can include a stereoscopic imaging device, 
     Captured images can include interior or exterior images. In an embodiment, interior captured images include the inside of commercial buildings and structures, such as stores, restaurants, shopping malls, hotels, convention centers, meeting halls, and the like, as well as any type of office building. Interior images can also include private structures such as residential dwellings including apartments, condominiums, town homes, single and double family homes. 
     In reference to  FIG. 1 , imaging device  120  can also be electronically controlled by a user utilizing computer  122 , in an embodiment. Such control can include, for example, adjustment of photographic settings such as focus, aperture, shutter speed, zoom, rotational positioning, height positioning, shutter control, and other similar type settings. In addition, control can also include positioning of imaging device  120 , e.g., placement within a building or room. Further description of embodiments of imaging device  120  can be found in co-pending application Ser. No. 12/971,887, which is incorporated herein by reference in its entirety. 
     In an embodiment, computer  122  includes a miniature personal computer without a keyboard or screen, e.g., a FIT-PC2 at from CompuLab Ltd. of Haifa, Israel. Computer  122  is connected to associated controllers, not shown, within imaging device  120  to electronically control the various functions of imaging device  120 . In an embodiment, such a computer is used due to its small size and power consumption, e.g., approximately 8 watts of power consumption and weighing approximately 13 ounces, to allow imaging device  120  to operate from battery power, not shown, for extended periods of time. In addition such small power consumption allows for operation of imaging device  120  utilizing a relatively smaller battery thereby contributing to a reduction of the overall weight and size of imaging device  120 . 
     In an embodiment, computer  122  includes a storage device, not shown, with the ability to store information. Such information can include images captured by imaging device  120 , status information regarding imaging device  120 , or any other related information. The storage device may contain information that is to be uploaded to mobile communication device  110  as previously described, or it may contain information downloaded from mobile communication device  110  as previously described. 
     In an embodiment, mobile communication device  110  communicates with imaging device  120  over communication path  117 . Communication path  117  carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link or other communication channels. Furthermore, a wireless link utilizing communication path  117  can utilize a short-range or long-range wireless protocol. In an embodiment, computer  122  of imaging device  120  includes a wired and/or wireless communication port that controls communication between mobile communication device  110  and imaging device  120 . 
     Mobile communication device  110  can also include multiple user interfaces including, but not limited to, a keyboard, a touch screen, a pointing device, a scanner, a speaker, and/or a microphone 
     Mobile communication device  110 , in an embodiment, includes keypad  111  and cursor control  112  to allow a user to input commands to mobile communication device  110  that are processed and routed to imaging device  120  as will be explained in more detail in  FIG. 2 . Mobile communication device  110  also may include a presentation device  113  to present information to the user. A combination of keypad  111 , cursor control  112 , and presentation device  113  on mobile communication device  110  allow the user to issue commands to imaging device  120  and to view information, e.g., responses, status, data, to and from imaging device  120 , according to an embodiment. 
     Mobile communication device  110  communicates with communication network  130  utilizing communication path  115 . In an embodiment, mobile communication device  110 , through communication path  115  and communication network  130 , can access central service system  140 . Such access provides a linking mechanism between imaging device  120  and central service system  140 . 
     Such a linking mechanism allows information relating to imaging device  120 , e.g., images and/or device status information, to be transferred to central service system  140 . Central service system  140  can then conduct an analysis of the information and provide feedback to mobile communication device  110  and/or imaging device  120 . Such analysis can include, for example, an analysis of the captured images, including image quality, image content, location (e.g., whether the captured image is of the correct object of interest), quantity of images, etc., or the analysis can include device information and status. Such analysis can be done in real-time, thereby providing feedback to the image system or an image system user that further actions may be necessary, e.g., re-capturing an image, adjusting image capture settings, and the like. Such feedback can be provided before the operator and/or image system leaves a specific location, thereby increasing the efficiency of the image capture process. 
     Further, such a linking mechanism also allows for storage of information on central service system  140  that has been collected by imaging device  120 . In addition, central service system  140  can issue commands and control signals, through communication network  130  and mobile communication device  110 , to imaging device  120 . Such commands and signals can be used to remotely control, in a full or partial manner, the actions of imaging device  120 . In an embodiment, central service system  140  can access image collection database  145  in order to store or retrieve image-based information. Such image-based information in image collection database  145  can therefore be communicated through communication network  132  to mobile communication device  110  and imaging device  120 . 
     In an embodiment, mobile communication device  110  includes keypad  111  and cursor control  112  to allow a user to input commands to mobile communication device  110  that are processed and routed to a central server system  140 . One or more of keypad  111 , cursor control  112 , and presentation device  113  on mobile communication device  110  allow the user to issue commands to central service system  140  and to view information, e.g., responses, status, data, to and from central service system  140 , according to an embodiment. 
     Communication with central service system  140  may occur in real-time, when communication network  130  is available. If communication network  130  is not available, information to be uploaded to central service system  140  can be stored by mobile communication device  110  until communication network  130  becomes available. In an embodiment, any stored information will be automatically uploaded to central service system  140  when communication network  130  becomes available. In a similar manner, information from central service system  140  can be transferred to mobile communication device  110  through communication network  130  when communication network  130  is available to mobile communication device  110 . If communication network  130  is unavailable to mobile communication device  110 , then central service system  140  can store such information until communication network  130  is available to mobile communication device  110  and will then proceed to download such information, according to an embodiment. 
       FIG. 2  illustrates a detailed view of system  200  having a portable imaging system with a mobile communication device as an input and output mechanism to an imaging device, coupled to a central service system, according to an embodiment. In the example shown in  FIG. 2 , system  200  includes a mobile communication device  210 , an imaging device  220 , a communication network  230 , and a central service system  240 . Mobile communication device  210  includes an input device  212  and a presentation device  213 , directed to accept information from and present information to a user  219 . Mobile communication device  210  also includes two communication interfaces, a communication network interface  211 , and a local communication network interface  216 . Mobile communication device  210  also includes a web server interface  214 . Mobile communication device  210  communicates with imaging device  220  over communication path  217  and can also communicate with multiple other systems and devices connected to communication network  230  over communication path  215 , including central service system  240  and an image collection database  245 . 
     In an embodiment, imaging device  220  includes a power system  222 , a controller  223 , a computer  225 , and a web server  227 . 
     Power system  223  is configured to provide a regulated voltage to imaging device  220  in an embodiment. In an embodiment in which imaging device  220  can be attached to an external power source, e.g., a building power outlet, generator, or battery source, power system  222  is configured to convert the voltage level of the external power supply to a desirable operating voltage(s) for imaging device  220 . Devices and methods used to regulate voltages, such as AC-DC and DC-DC converters, are known to a person skilled in the relevant art. 
     In an embodiment in which imaging device  220  does not have access to an external power supply, power system  222  can be a rechargeable power supply that provides power at the desirable operating voltage(s) for imaging device  220 . In an embodiment, the rechargeable power supply of power system  222  can be replenished by another power supply source such as, for example and without limitation, an AC power supply (e.g., a building power outlet). Based on the description herein, a person skilled in the relevant art will recognize that other power systems can be used for power system  222 . These other power systems are within the scope and spirit of the embodiments described herein. 
     In an embodiment, controller  223  has the ability to control the functionality of imaging device  220 , including, for example, image capture settings as previously described in system  100  of  FIG. 1 . In addition, controller  223  may have the ability to control movement and positioning of imaging device  220 . In an embodiment, imaging device  220  can include locomotion capabilities, e.g., wheels or tracks, that allow image device  220  to be positioned under image device  220 &#39;s own power. 
     In an embodiment, imaging device  220  includes a computer  225 . Computer  225  communicates with controller  223  and can issue control commands to controller  223  in order to control the functionality of imaging device  220 . In a like manner, computer  225  can also receive information from controller  223 . Such information can include real-time health monitoring information of imaging device  220 , as well as information such as captured images, storage status, battery status, motor status, global positioning status, heading direction, e.g., compass, and any other information available from imaging device  220 . 
     According to a further embodiment, computer  223  may include a web server  227  or may be coupled to communicate with a web server at the same or a different location. In an embodiment, a web server is a software component that responds to an HTTP request with an HTTP response. As illustrative examples, web server  227  may be, without limitation, an Apache HTTP Server, Apache Tomcat, MICROSOFT Internet Information Server, JBOSS Application Server, WEBLOGIC Application Server, or SUN JAVA System Web Server. The web server may contain web applications which generate content in response to an HTTP request. The web server may package the generated content and serve the content to a client in the form of an HTTP response. Such content may include HTML, extensible markup language (XML), documents, videos, images, audio, multimedia features, or any combination thereof. This example is strictly illustrative and does not limit the present invention. 
     In an embodiment, web server  227  includes a web application to forward control information to controller  223  and also receives information from controller  223  as previously discussed. 
     Web server  227  is configured to communicate over communication path  217  to mobile communication device  210 , according to an embodiment. Communication path  217  carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link or other communication channels. Furthermore, a wireless link utilizing communication path  217  can utilize a short-range or long-range wireless protocol. 
     In an embodiment, mobile communication device  210  provides a mechanism for receiving instructions from a user that are communicated to imaging device  220 . In a similar manner, mobile communication device  210  provides a mechanism for presenting information to a user that has originated either in imaging device  220  or from a remote system over a global communication network, in an embodiment. In a similar manner, mobile communication device  210  provides a mechanism for presenting information to a user that has originated either from imaging device  220  or from central service system  240  over communication network  230 . By utilizing mobile communication device  210  as an input and output device with imaging device  220 , imaging device  220  does not need to be configured with a dedicated laptop computer having a network connection that requires substantially more energy than the miniature personal computer previously discussed. In addition, the use of mobile communication device  210  as the input and output device for imaging device  220  also allows for remote control of imaging device  220 . 
     In a similar manner, mobile communication device  210  provides a mechanism for providing network access to central service system  240 , according to an embodiment. In this situation, central service system  240  can perform real-time analysis of information from mobile communication device  210 , including a status of imaging device  220 , any captured images, and/or information based on a captured image. Based on the analysis performed by central service system  240 , feedback can be sent to mobile communication device  210  and/or imaging device  220  regarding any necessary actions that central service system  240  deems appropriate, e.g., re-capturing an image, warning of a possible equipment failure (e.g., low battery). Based on this feedback, a determination whether corrective action is necessary can be made. In addition, such access allows information, such as images captured by imaging device  220  and status information, to be communicated to and stored on remote server  240 . 
     Local communication interface  216 , in mobile communication device  210 , provides a wired or wireless connection over communication path  217  to imaging device  220 . Communication path  217  may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link or other communication channels and can utilize a short-range or long-range wireless protocol. 
     In an embodiment, mobile communication device includes web server interface  214  that is configured to communicate with web server  227  in imaging device  220 . Input device  212  and presentation device  213 , in conjunction with web server interface  214 , provide user  219  with an interface for viewing image content, requesting information, and inputting commands to imaging device  220 , according to an embodiment. Web server interface  214  may provide navigation tools familiar to users of applications and familiar to those of ordinary skill in the art. In one exemplary embodiment, web server interface  214  may be configured to provide a user interface and navigation tools in a browser. For example, a browser may be a web browser or other type of browser for browsing content. The browser can send a request over local communication interface  216  to web server  227  and receive a response from web server  227 . As an example, not to limit the present invention, the request may be a hypertext transfer protocol (HTTP) request. The HTTP request may contain parameters entered by a user using a user interface. The response may be an HTTP response. An HTTP response may contain web content, such as a hypertext markup language (HTML), images, video, or multimedia content. In some embodiments, web server interface  214  may use a combination of markup and scripting elements, such as, for example, HTML and/or JavaScript. A user interface can also be executed as a script within a browser, as a plug-in within a browser, or as a program which executes within a browser plug-in, such as the ADOBE (MACROMEDIA) Flash plug-in. Web server interface  214  may also operate a user interface as a standalone application in other embodiments. 
     In an embodiment, mobile communication device  220  includes web server interface  214  that is configured to communicate with central service system  240 . As described above, web server interface  214  may be configured to provide a user interface and navigation tools in a browser. The browser can send a request over communication network interface  211  to communication path  215 , through communication network  230 , to access and receive a response from central service system  240 . 
     In an embodiment, mobile communication device  210  provides a link between central service system  240  and imaging device  220 . In this embodiment central service system  240  can provide analysis of information, including images, from imaging device  220 . Central service system  220  can also issue commands and/or information to mobile communication device  210  and imaging device  220 . Such commands include the ability to control the functionality of imaging device  220 . In a similar manner, central service system  240  can also receive information from imaging device  220  through mobile communication device  210 . Such an arrangement allows central service system  240  to provide real-time maintenance, control, and feedback analysis of imaging device  220  that can include real-time analysis of capture images, status checks of imaging device  220 , virtual access for real-time debugging, and the ability to upgrade, alter, and replace software components on either or both of mobile communication device  210  and imaging device  220 . Central service system  240  is not limited to communication with a single device and has the ability to communicate and/or control multiple devices. 
     Either of central service system  240  or mobile communication device  210  can initiate communication with the other. In the same manner, imaging device  220  can also initiate communications with either mobile communication device  210  or central service system  240 . Such communications provide for real-time feedback between central service system  240 , mobile communication device  210 , and imaging device  220 . Real-time feedback can include, for example, uploading thumbnail images, the ability to check relative quality of captured images, the time an image was captured, the address associated with the captured image, the total number of images captured, the total size of captured images, the status of imaging device  220 , the status of mobile communication device  210 , business information associated with the image, and any other similar events or information. 
     Method 
       FIG. 3  illustrates a method  300  of using a mobile communication and an imaging device to communicate information with a central service system for feedback analysis, according to an embodiment. In the example shown in  FIG. 3 , the method starts with step  302 . In step  304 , one or more images are captured in real-time using a portable panoramic imaging device. For example,  FIG. 2  illustrates imaging device  220  that includes on-board computer  223 , where on-board computer  223  may instruct imaging device  220  to capture an image including an interior panoramic image. Further,  FIG. 2  illustrates mobile communication device  210  configured with input device  212  and presentation device  213  to receive user input and present information to the user. Thus, a user through mobile communication device  210  can instruct imaging device  220  to capture an interior panoramic image. 
     In step  306 , an interface is provided to the portable panoramic imaging for facilitating real-time feedback of the portable panoramic device operation, where the mobile communication device is coupled to the portable panoramic imaging device. For example,  FIG. 2  illustrates communication between imaging device  220  and mobile communication device  210  over communication path  217 . In addition, mobile communication device  210  communicates with central service system  240  through communication path  215  and communication network  230 . Through such couplings, captured images, along with any other information related to the image, e.g., time, location, intrinsic image capture setting, thumbnail, or information related to mobile communication device  210  or imaging device  220 , can be sent to central service system  240  for real-time analysis and feedback. 
     In step  308 , utilizing the mobile communication device, information based on the one or more captured images is sent to a central service system for feedback analysis. For example,  FIG. 2  illustrates mobile communication device  210  that includes a communication network interface  211  that communicates through communication network  230  to other resources, including central service system  240 . Once information based on a captured image, or on a device associated with capturing an image, is obtained, that information can be sent to central service system  240  for analysis and feedback. Transfer of such information can be initiated by mobile communication device  210 , imaging device  220 , or central service system  240 . 
     In step  310 , utilizing the mobile communication device, information from the central service system based on the analysis is received. Once central service system receives the information as described in step  308 , central service system  240 , based on an analysis, may issue instructions, or recommendations, through communication network  230  to mobile communication device  210  and/or to imaging device  220 . Further, central service system  240  may issue commands to mobile communication device  210  and/or imaging device  220  in order to gather additional information to conduct further analysis, e.g., capture images. In addition, mobile communication device  210  and central service system  240  may, through the communicative coupling with imaging device  220 , collect information relating to imaging device  220  or mobile communication device  210 . Upon completion of the analysis, mobile communication device  210  receives the results of the analysis. Such results may include corrective instructions or requests for additional information that may be needed to complete the analysis. 
     In step  312 , the method is concluded. 
     Example Computer System Implementation 
     Aspects of the present invention shown in  FIGS. 1-3 , or any part(s) or function(s) thereof, may be implemented using hardware, software modules, firmware, tangible computer readable media having instructions stored thereon, or a combination thereof and may be implemented in one or more computer systems or other processing systems. 
       FIG. 4  illustrates an example computer system  400  in which embodiments, or portions thereof, may by implemented as computer-readable code. For example, portions of system  200 , e.g., central service system  240 , mobile communication device  210 , computer  225 , and controller  223 , may be implemented in portions of computer system  400  using hardware, software, firmware, tangible computer readable media having instructions stored thereon, or a combination thereof and may be implemented in one or more computer systems or other processing systems. Hardware, software, or any combination of such may embody any of the modules and components in  FIGS. 1-3 . 
     If programmable logic is used, such logic may execute on a commercially available processing platform or a special purpose device. One of ordinary skill in the art may appreciate that embodiments of the disclosed subject matter can be practiced with various computer system configurations, including multi-core multiprocessor systems, minicomputers, and mainframe computers, computer linked or clustered with distributed functions, as well as pervasive or miniature computers that may be embedded into virtually any device. 
     For instance, at least one processor device and a memory may be used to implement the above described embodiments. A processor device may be a single processor, a plurality of processors, or combinations thereof. Processor devices may have one or more processor “cores.” 
     Various embodiments of the invention are described in terms of this example computer system  400 . After reading this description, it will become apparent to a person skilled in the relevant art how to implement the invention using other computer systems and/or computer architectures. Although operations may be described as a sequential process, some of the operations may in fact be performed in parallel, concurrently, and/or in a distributed environment, and with program code stored locally or remotely for access by single or multi-processor machines. In addition, in some embodiments the order of operations may be rearranged without departing from the spirit of the disclosed subject matter. 
     Processor device  404  may be a special purpose or a general purpose processor device. As will be appreciated by persons skilled in the relevant art, processor device  404  may also be a single processor in a multi-core/multiprocessor system, such system operating alone, or in a cluster of computing devices operating in a cluster or server farm. Processor device  404  is connected to a communication infrastructure  406 , for example, a bus, message queue, network, or multi-core message-passing scheme. 
     Computer system  400  also includes a main memory  408 , for example, random access memory (RAM), and may also include a secondary memory  410 . Secondary memory  410  may include, for example, a hard disk drive  412 , removable storage drive  414 . Removable storage drive  414  may include a floppy disk drive, a magnetic tape drive, an optical disk drive, a flash memory, or the like. The removable storage drive  414  reads from and/or writes to a removable storage unit  418  in a well known manner. Removable storage unit  418  may include a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive  414 . As will be appreciated by persons skilled in the relevant art, removable storage unit  418  includes a computer readable storage medium having stored therein computer software and/or data. 
     Computer system  400  (optionally) includes a display interface  402  (which can include input and output devices such as keyboards, mice, etc.) that forwards graphics, text, and other data from communication infrastructure  406  (or from a frame buffer not shown) for display on display unit  430 . 
     In alternative implementations, secondary memory  410  may include other similar means for allowing computer programs or other instructions to be loaded into computer system  400 . Such means may include, for example, a removable storage unit  422  and an interface  420 . Examples of such means may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM, or PROM) and associated socket, and other removable storage units  422  and interfaces  420  which allow software and data to be transferred from the removable storage unit  422  to computer system  400 . 
     Computer system  400  may also include a communication interface  424 . Communication interface  424  allows software and data to be transferred between computer system  400  and external devices. Communication interface  424  may include a modem, a network interface (such as an Ethernet card), a communication port, a PCMCIA slot and card, or the like. Software and data transferred via communication interface  424  may be in the form of signals, which may be electronic, electromagnetic, optical, or other signals capable of being received by communication interface  424 . These signals may be provided to communication interface  424  via a communication path  426 . Communication path  426  carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link or other communication channels. 
     In this document, the terms “computer program medium” and “computer readable medium” are used to generally refer to media such as removable storage unit  418 , removable storage unit  422 , and a hard disk installed in hard disk drive  412 . Computer program medium and computer readable medium may also refer to memories, such as main memory  408  and secondary memory  410 , which may be memory semiconductors (e.g. DRAMs, etc.). 
     Computer programs (also called computer control logic) are stored in main memory  408  and/or secondary memory  410 . Computer programs may also be received via communication interface  424 . Such computer programs, when executed, enable computer system  400  to implement the present invention as discussed herein. In particular, the computer programs, when executed, enable processor device  404  to implement the processes of the present invention, such as the stages in the method illustrated by flowchart  300  of  FIG. 3 , as previously discussed. Accordingly, such computer programs represent controllers of the computer system  400 . Where the invention is implemented using software, the software may be stored in a computer program product and loaded into computer system  400  using removable storage drive  414 , interface  420 , and hard disk drive  412 , or communication interface  424 . 
     Embodiments of the invention also may be directed to computer program products comprising software stored on any computer useable medium. Such software, when executed in one or more data processing device, causes a data processing device(s) to operate as described herein. Embodiments of the invention employ any computer useable or readable medium. Examples of computer useable mediums include, but are not limited to, primary storage devices (e.g., any type of random access memory), secondary storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, and optical storage devices, MEMS, nanotechnological storage device, etc.). 
     CONCLUSION 
     Embodiments described herein provide methods and apparatus for the automatic cropping of images. The summary and abstract sections may set forth one or more but not all exemplary embodiments as contemplated by the inventors, and thus, are not intended to limit the present invention and the claims in any way. 
     The embodiments herein have been described above with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries may be defined so long as the specified functions and relationships thereof are appropriately performed. 
     The foregoing description of the specific embodiments will so fully reveal the general nature of the invention that others may, by applying knowledge within the skill of the art, readily modify and/or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present invention. Therefore, such adaptations and modifications are intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein. It is to be understood that the phraseology or terminology herein is for the purpose of description and not of limitation, such that the terminology or phraseology of the present specification is to be interpreted by the skilled artisan in light of the teachings and guidance. 
     The breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the claims and their equivalents.