Patent Description:
Generally speaking, graphic media are very useful for presenting information to their viewers. For example, graphic data representations on printed and other media are in common use. Information represented graphically may be accessed by scanning their media to retrieve data stored therewith.

Scanners typically illuminate graphic data media while exposing a photosensor to capture light reflected therefrom. The captured light corresponds to an image taken of the graphic data representation. The taken image is processed to read the graphic data representation.

Data are represented in some graphic media using two dimensional (2D) geometric pattern arrays, such as bar code patterns ("barcodes"). Barcodes are used for presenting graphic data over a wide variety of commercial, consumer, logistic and industrial applications and in other fields.

Barcodes may be printed on a variety of media. For example, barcodes may be printed on labels for paper documents, products, parcels, tickets, coupons, stamps, scrip, etc. While useful in many applications, such printed media may sometimes at least border on legacy in others.

In other fields related to, e.g., identity, financial and security uses, barcodes may be encoded, transmitted, and rendered electronically with display screens associated with computers. Increasingly, such computers comprise portable or mobile computing and communicating devices ("mobile devices").

Scanner devices must thus be operable for accessing graphic data presented in the printed media, as well as for retrieving data presented on mobile device display components. The tasks involved in these respective operations differ. Moreover, these operating differences are by no means trivial.

Scanning printed media typically proceeds with illumination of the media by a light source of the scanner. However, display screens of mobile devices are typically self-lit and have reflective viewing surfaces. Light from scanner sources thus "washes out"(obscures) data presented therewith.

Some scanners suppress their illumination supply to prevent such wash outs and improve data retrieval from mobile device display screens. However, such scanners may lose access to data on printed media. Duplicating scanners to read different media would be clearly impracticable and costly.

Issues related to this dichotomy are typically approached with trade-offs in performance characteristics, such as achievable suitable image quality from each of various media. For example, printed media scan quality improvements may reduce image quality from scans of electronic displays.

Typically, scanners light sources illuminate scan targets for the same length of time that their shutters are open for capturing light reflected therefrom. As illumination and exposure durations are equal, light reflected from mobile device displays increases along with exposure.

To ameliorate such reflection, some scanners reduce their light source brightness to scan display screens by decreasing power fed thereto. While the power reduction boosts significance of self-lighting from the scan target displays, motion tolerance qualities of the scan are reduced.

Other conventional scanners are operable to expose a first image with the scanner illumination source activated. The exposed first image is processed to try to determine if a self-lit display is present. If so, the scanner discards the first image and disables its light source temporarily.

Upon disabling its light source, the scanner then exposes a second image, in which the illumination is provided solely with the self-lighting of the image target display. Such scans clearly consume time and processing devoted to the first image for identifying the scan target as a display.

More time and processing resources are then consumed in disabling the scanner light source, and reimaging the display scan target. Unfortunately, identifying the scan targets as displays is sometimes inaccurate, thus compounding inefficiencies that may already be apparent for some scanners.

Therefore, a need exists for capturing graphic information presented on self-lit displays as well as in printed media. A need also exists for capturing graphic information, whether presented on self-lit displays or in printed media, without requiring multiple image captures.

Further, sufficient motion tolerance is needed in scanning graphic information presented either on self-lit displays or in printed media. Moreover, graphic information presented either on self-lit displays or in printed media needs to be captured efficiently, quickly and economically.

Issues or approaches within this background section may, but not necessarily have, been conceived or pursued previously. Unless otherwise indicated to the contrary, it is not to be assumed that anything in this section corresponds to any alleged prior art merely by inclusion in this section.

Embodiments are defined in the claims, to which reference should now be made.

<CIT> discloses an image reader and a corresponding method for capturing an image of a target, such as a one or two-dimensional bar code. In one embodiment, the image reader comprises a two-dimensional CMOS based image sensor array, a timing module, an illumination module, and a control module. The time during which the target is illuminated is referred to as the illumination period. The capture of the image by the image sensor array is driven by the timing module that, in one embodiment, is able to simultaneously expose substantially all of the pixels in the array. The time during which the pixels are collectively activated to photo-convert incident light into charge defines the exposure period for the sensor array. In one embodiment, at least a portion of the exposure period occurs during the illumination period.

<CIT> discloses (<NUM>) energizing a first illuminator to illuminate a first subfield of view with a first illumination pulse and subsequently energizing the first illuminator to illuminate the first subfield of view with a second illumination pulse; (<NUM>) exposing the array of photosensitive elements in the imaging sensor for a first sensor-exposure time and subsequently exposing the array of photosensitive elements in the imaging sensor for a second sensor-exposure time; and (<NUM>) processing an image captured by the imaging sensor to decode a barcode in the image. The first illumination pulse overlaps with the first sensor-exposure time for a first overlapped-pulse-duration, and the second illumination pulse overlaps with the second sensor-exposure time for a second overlapped-pulse-duration. The first overlapped-pulse-duration is different from the second overlapped-pulse-duration.

<CIT> discloses an image reading device including an illumination system and a processor that causes the illumination system to produce illumination according to an illumination period having a continuous or substantially continuous, illumination sub-period and at least one pulsed, illumination sub-period.

<CIT> discloses controlling image exposure and illumination pulse timing while implementing methods for reading optical codes presented on electronic display screens or other highly reflective surfaces.

The foregoing illustrative summary, as well as other example objectives and/or advantages of the invention, and the manner in which the same are accomplished, are further explained within the following detailed description and its accompanying drawings.

The present invention embraces capturing a graphic information presentation. Example embodiments are described in relation to scanning graphic information presented on self-lit displays as well as in printed media. Graphic information presented on either the self-lit displays or in the printed media is thus captured with a single image and good motion tolerance.

An example embodiment relates to a process for scanning a scan target related to electronic displays and/or print based graphic media. An example process is described for scanning a graphic medium scan target. An image of the scan target is captured over an exposure duration. An illumination of the scan target is actuated over an illumination duration brief relative to the exposure duration. The illumination of the scan target is deactivated upon an expiration of the illumination duration. The capturing the image step continues over a significant portion of the exposure duration, which persists after the expiration of the illumination duration.

Scanners capture images of scan targets to access graphic information presented therewith. Typically, the scanners capture the images by opening a shutter component and thus, exposing photosensitive components to light reflected from the scan targets. The scanners typically illuminate the scan targets using on-board light sources.

Typical scanners may activate their light sources to illuminate the scan targets while their shutters are open. The photo sensitive components are thus exposed to the light reflected from the scan targets for the same time the shutter is open. The exposure time and the illumination time are the same in conventional scanners.

The equal exposure and illumination times typically suffice for accessing graphic information presented on printed media and a variety of other common or related graphic media. Much graphic information is also presented currently using electronic displays, such as those associated with computers. A growing trend in fact involves presenting graphic information on electronic displays associated with mobile computer devices.

Many electronic displays are self-lit. Self-lit displays are illuminated by their own on-board lighting sources. Electronic displays, moreover, may have surfaces somewhat more reflective than those of printed media.

Withself-lit displays however, the typical exposure and illumination time equality may fail to access graphic information presentations in at least one significant aspect. For example, the on-board light sources of scanners may wash out graphic information presented on self-lit displays. This washing out effect may, in fact, be exacerbated by reflections of the scanner light from the reflective surfaces of some scan target displays.

<FIG> depicts a typical effect of scanner lighting on an image <NUM> of a computer screen(e.g., captured by conventional means). While a bright reflection <NUM> of the scanner lighting is captured, surrounded by a somewhat more diffuse halo area <NUM>, the typical equal exposure and illumination times provide no meaningful access to any useful graphic information. Instead, the bright scanner lighting has completely washed out any useful graphic information and beside the artifacts reflection <NUM> and halo <NUM> thereof, the captured display image <NUM> shows only a uniformly blackening.

A typical response of scanners faced with this situation may include temporary disabling their on-board light source and re-opening its shutter to expose its photosensitive components a second time. Subsequent captures of second (or more) images of scan targets may not be atypical.

The second image is captured using only self-lighting from a scanned display and/or ambient lighting that may be available, but without any illumination from the scanner's on-board light source. Typically, scanners may then essentially discard the first image <NUM>, captured originally. While an adequate image may eventually thus be captured, this is typically achieved by consuming at least twice as much scan time, as well as more power and processing resources.

In contrast to situations such as the scenarios discussed with reference to <FIG> , example embodiments relate to scanning graphic information presented on self-lit displays as well as in printed media with a single image and good motion tolerance. <FIG> depicts a flow chart for an example process <NUM> for scanning information presented on a graphic display, according to an example embodiment of the present invention.

In process <NUM>, scan targets related to electronic displays and/or print based graphic media are scanned. The graphic medium may comprise electronic displays, self-lit media, and/or print based media.

Self-lit electronic displays may be associated with computers, including portable, cellular, and mobile computing and communicating devices ("mobile devices"). The mobile devices may comprise "smart phones," tablet computers, Portable Data Terminals (PDTs), Personal Digital Assistants (PDAs) and other mobile or portable computer and communication devices.

In step <NUM>, an image of the scan target is captured over an exposure duration. An example embodiment is implemented in which the step <NUM> comprises a component step <NUM> and a component step <NUM>.

The component step <NUM> comprises actuating a sensor operable for detecting the image. The component step <NUM> comprises actuating a shutter operable for exposing the actuated sensor to the scan target over the exposure duration.

In step <NUM>, an illumination of the scan target is actuated over an illumination period, which is brief relative to the exposure duration. The exposure duration thus comprises a length of time that is significantly greater than a length of time corresponding to the illumination period.

In step <NUM>, the illumination of the scan target is deactivated upon an expiration of the illumination duration. Importantly however, the capturing the image step '<NUM>' continues over at least a significant portion of the exposure duration, which persists after the expiration of the illumination duration.

The exposure duration is significantly longer than the illumination duration. For example, set illumination duration corresponds to a mere fraction of the exposure duration. The exposure duration corresponds to a significant multiple of the illumination duration.

An example embodiment may be implemented in which the illumination duration comprises a brief time period of around <NUM>-<NUM> microseconds (ms). During this brief time period, an example scanner actuates an on-board light source component with an electric current of about <NUM>-<NUM> Milliamps (mA).

The method <NUM> may also comprise one or more optional steps. For example, in a step <NUM>, a quality related characteristic of the captured image may be evaluated relative to a target quality metric.

The quality related characteristic of the captured image and/or the target quality metric may comprise an image quality measurement. The image quality measurement may relate to a grey level, a saturation level, and/or a blackness level.

The image quality measurement of the captured image may be determined substantially globally over the captured image. Alternatively or additionally, the image quality measurement of the captured image may be determined locally in relation to at least a portion of the image.

A determination may be made based on the based on the evaluating step that the quality related characteristic of the captured image does not at least meet the target quality value.

In this case, the captured image may comprise a first captured image and the exposure duration is increased to one or more increased exposure duration values. An example embodiment is implemented in which adjustments to the exposure duration are computed according to an automatic exposure control (AEC) process and/or using values stored in firmware or other non-transitory computer readable storage media.

For example, the AEC process may manage the exposure duration according to the quality related evaluation of the received image. An example embodiment (not covered by the claims) may be implemented in which, if a quality characteristic of an evaluated image is assessed as being excessively saturated relative to a saturation related quality metric (e.g., "target"), then the AEC may reduce the exposure duration. For example, the AEC may adjust the present exposure duration to a first adjusted exposure duration, which is lower than the present (unadjusted) duration.

On the other hand, if a quality characteristic of an evaluated image is assessed as being "black," or otherwise excessively dark relative to the saturation related quality metric or a black level related quality metric target, then the AEC increases the exposure duration. For example, the AEC adjusts the present exposure duration to a second adjusted exposure duration, which is greater than the present (unadjusted) duration.

Continuing with this example, if the evaluated image is assessed as not saturated and not black (or otherwise too dark), a situation may arise in which its quality characteristic is assessed to not at least meet a target quality metric related to a grey scale or another quality metric. In this case, the AEC may adjust the exposure duration accordingly to a third adjusted exposure duration, which is directed to improving the image quality characteristic relative to the target quality metric. Table <NUM> below presents an example.

The capturing, actuating and deactivation steps '<NUM>' through '<NUM>' are repeated iteratively over the one or more increased exposure duration values and one or more subsequent corresponding images are thus captured.

The evaluating the quality related characteristic step <NUM> may then also be repeated iteratively over the one or more subsequent captured images. The reiterated steps may continue to be performed until the quality related characteristic of at least one of the subsequent corresponding evaluated captured images at least meets the target quality value.

Although not according to the claims, if none of the captured images meets the target quality value however upon reaching a maximum increased exposure duration, then an evaluated image having the quality value that most closely approximates the target quality value may be selected, used, stored, exported and/or processed, etc..

The set illumination duration comprises a first set time duration. Upon reaching the maximum increased exposure duration value, the illumination duration is reset from the first set time duration to one or more increased illumination durations.

The capturing, actuating and deactivation steps <NUM> through <NUM> may then be repeated iteratively over the one or more increased illumination durations and one or more subsequent corresponding second images thus captured.

The evaluating the quality related characteristic step <NUM> may then also be repeated iteratively over the one or more subsequent captured second images until the quality related characteristic of at least one of the subsequent corresponding evaluated captured second images at least meets the target quality value.

If none of the captured images meets the target quality value however upon reaching a maximum increased illumination duration, then an evaluated image having the quality value that most closely approximates the target quality value may be selected, used, stored, exported and/or processed, etc..

The process <NUM> may be implemented using a scanner system and/or a computer and communication system platform (e.g., system <NUM>, platform <NUM>, described below with reference to <FIG> and <FIG> , respectively).

Process <NUM> allows for capturing significant amounts of scanning information presented on a graphic display according to an example embodiment, as shown in <FIG>.

<FIG> and <FIG> each depict example images captured from a display screen, according to an example embodiment. The scanned display image field <NUM>, as depicted in each of <FIG> and <FIG>, shows a significant amount of graphic information. The information shown in the image field <NUM> was captured from the scanned display screen with scanner illumination provided by a light pulse activated for a very short illumination duration. In <FIG>, the scanned display image field <NUM> comprises a representation of an example HanXin Code pattern <NUM>, which is also intended to represent QR code patterns, dot code patterns and other formats used for presenting 2D graphic data in a matrix-like array, and any other bar codes or other 2D graphic data representations. In <FIG>, the scanned display image field <NUM> shows an interactive screen.

More particularly, the light pulse is deactivated at an early point in time during the exposure duration, which keeps the light pulse to an illumination duration significantly shorter than the exposure duration, which relates to the shutter speed or the time during which the shutter remains open.

In fact, the example image <NUM> depicts the same screen, which when scanned by conventional means produces the blackened scanned display image field <NUM> washed out of useful graphic data (shown in <FIG>). Illuminated by the ultra-short light pulse however, specifically a light pulse that is significantly shorter than (e.g., comprising a mere fraction of) the exposure duration during which the shutter is open to expose the image sensor, the image field <NUM> shows useful graphic information.

Indeed, an artifact <NUM> of the reflection (<NUM>; <FIG>) may remain noticeable in the scanned display image field <NUM>. However, the reflective artifact <NUM> is neither disruptive nor degrading to an image quality characteristic of the image field <NUM> sufficient to impair or deter an ability of decoding barcodes or other image features captured therewith. The reflective artifact <NUM> is in fact so diminished, relative to reflections caused conventionally, as to lack any appreciable associated halo artifact (e.g., halo '<NUM>'; <FIG>).

<FIG> depicts an example scanning system <NUM>, according to an example embodiment. The system <NUM> is operable for scanning a graphic medium scan target <NUM>, such as a print related graphic medium or a self-lit display screen. The scan target <NUM> may present graphic information, such as a barcode <NUM>.

<FIG> includes a key to symbols used therein. As shown in the key to symbols, pathways associated with direct and reflected lighting and corresponding optical data are represented with un-darkened single direction arrows. Darkened two-ended arrows represent bidirectional flow pathways, which correspond to data signals exchanged between components of the scanner system <NUM>.

The scanner system <NUM> comprises an image detector component <NUM>. The image detector <NUM> is operable, upon actuating an exposure, for capturing an image of the scan target <NUM> over a duration of the exposure actuation.

The detector component <NUM> may comprise an image sensor device <NUM> and a shutter device <NUM>. The image sensor <NUM> is operable, upon the actuating the exposure, for the capturing the image of the scan target. The shutter <NUM> is operable for exposing the sensor device <NUM>, upon the actuating the exposure.

An example embodiment may be implemented in which the sensor <NUM> comprises an optical array of photosensitive devices, such as an array of charged-coupled devices (CCD) or photodiodes. An example embodiment may also be implemented in which the shutter <NUM> is actuated electromechanically or electro-optically.

Electromechanical actuation may be achieved by opening the shutter <NUM>. Electro-optical actuation may be achieved by rendering the shutter optically transparent. Electromechanical shutters may be deactivated by closing. Electro-optical shutters may be deactivated by rendering the shutter optically opaque, or at least reducing the optical transparence thereof significantly.

An example embodiment may also be implemented in which the detector <NUM> comprises optical components, devices or apparatus ("optics") for coupling the sensor <NUM> optically to light gathered by the scanner system <NUM> and admitted thereto through the open shutter <NUM>. Such optics may be transmissive and/or reflective. Such optics may comprise various structures and/or combinations of lenses, prisms, mirrors, windows, filters, light guides and other optically transmissive media (e.g., optical fiber) and other optical components.

The scanner system <NUM> also comprises a light source component <NUM>. The light source is operable, upon actuating an illumination, for illuminating the scan target <NUM> over an illumination duration. Importantly, the illumination duration is brief relative to the exposure duration.

Example embodiments may be implemented in which the light source provides illumination at a fixed light level. The light level may be fixed to a value stored in firmware.

Upon an expiration of the illumination duration, the light source <NUM> is also operable for deactivating, such as by "turning off" (or at least dimming substantially) and thus extinguishing its illumination operation. Importantly however, the sensor/detector <NUM> continues to operate for capturing the image of the scan target <NUM> during a remainder of the exposure duration, which persists for at least a significant (even substantial) time period after the expiration of the illumination duration.

Further, the scanner system <NUM> comprises an exposure regulator component <NUM> and a lighting (illumination) regulator component <NUM>.

The exposure regulator <NUM> is operable for setting the exposure duration and for the actuating the exposure. The lighting regulator <NUM> is operable for setting the illumination duration and for the actuating, and the deactivating, the illumination operation of the light source <NUM>.

The scanner system <NUM> comprises a controller/director component <NUM>. The controller/director component <NUM> may comprise a microprocessor, a microcontroller, or a field programmable gate array (FPGA) or other programmable logic device (PLD).

The controller/director <NUM> is operable for exchanging data signals with the sensor/detector <NUM>, the exposure regulator <NUM> and the lighting regulator <NUM>. The controller/director <NUM> functions to control operations of the other components of the scanner system <NUM> with which it exchanges the data signals and thus, for directing the scanning of the graphic medium scan target <NUM>.

The data signal exchange allows the controller/director <NUM> to effectively control the exposure regulating component <NUM> and the illumination regulating component <NUM> and thus, to set the illumination duration to a time period significantly shorter than the exposure duration.

The controller/director <NUM> may also be operable for evaluating a quality related characteristic of the captured image in relation to a target quality metric. The quality related characteristic of the captured image and/or the target quality metric may comprise a quality measurement related to a grey scale, a saturation level, and/or a blackness level.

The scanner system <NUM> may also comprise a non-transitory computer readable storage medium <NUM>. The non-transitory computer readable storage medium <NUM> may be disposed, at least in part, separately in relation to the director/controller component <NUM> (e.g., as memory and/or drive components). The non-transitory computer readable storage medium <NUM> may also be integrated partially with at least a portion of the controller/director <NUM> (e.g., as registers and/or caches thereof).

The non-transitory computer readable storage medium <NUM> comprises instructions, which cause the controller/director component <NUM> to perform a scanning process over the scan target. The scan process comprises at least the capturing the image of the scan target over the exposure duration, the actuating the illumination of the scan target over the illumination duration, and the deactivating the illumination of the scan target upon the expiration of the illumination duration, in which the capturing the image step continues over the significant portion of the exposure duration, which persists after the expiration of the illumination duration.

The scan process may also comprise evaluating a quality related characteristic of the captured image may be evaluated relative to a target quality metric. The instructions may also cause the controller/director <NUM> to perform the process <NUM> (<FIG>) and/or a process <NUM>, which is described below (with reference to <FIG>). One or more aspects or features of the system <NUM> may be implemented on a computer and communication system platform (e.g., computer and communication system platform <NUM>), which is described below with reference to <FIG>.

Setting the exposure duration and the illumination duration, adjusting the set exposure duration and/or illumination duration and/or evaluating quality related characteristics of captured images relative to quality targets may be computed according to an AEC algorithm and optionally also values stored in firmware. The computations may be performed or controlled based on instructions stored tangibly in non-transitory computer readable storage media.

With the scan target <NUM> presenting the barcode <NUM> within about <NUM>-<NUM> centimeters (cm) proximity to the scanner system <NUM>, an example embodiment may be implemented in which the AEC sets the illumination duration for a brief time period (e.g., of around <NUM>-<NUM>). During this brief time period, the controller/director <NUM> and the lighting regulator <NUM> operate together for actuating the illumination by energizing the light source <NUM> with an electric current fixed at a value set in firmware (e.g., at approximately <NUM>-<NUM> mA).

As a position of the scan target <NUM> is displaced to another location further from the scanner system <NUM>, the illumination provided by the light source <NUM> decreases by the square of the distance increase. At a distance of about <NUM>-<NUM> separation between the scanner system <NUM> and the scan target <NUM>, ambient lighting in some settings may become more significant than the illumination remaining from the light source <NUM>.

An example embodiment is implemented in which AEC computations of the controller/director <NUM> thus cause its data signal exchange interaction with the exposure regulator for adjusting the exposure duration automatically to a longer time period. Even with scans performed over the increased exposure duration, example embodiments keep the illumination level of the light source fixed and its actuation current thus remains fixed at the original value.

Example embodiments may be implemented for scanning targets more than around <NUM>-<NUM> or more from the scanner in situations without sufficient ambient lighting. Such a situation is described below with reference to <FIG>. In such situations, the exposure duration may reach an upper limit specified in firmware. In such situations, the AEC computations of the controller/director <NUM> thus cause its data signal exchange interaction with the illumination regulator for adjusting the illumination duration automatically to a longer time period. Notwithstanding any such increase to the illumination duration however, the exposure duration remains significantly longer.

Thus, even upon the adjustment of the illumination duration to an increased time period, the exposure duration continues for a significant portion of time remaining after its expiration. Moreover, even for scans performed over the increased exposure and illumination durations, example embodiments are implemented to keep the illumination level of the light source and its corresponding actuation current fixed at the value specified in firmware.

The scanner system <NUM> is effective operationally for scanning optically scan targets comprising various graphic media. <FIG> depicts the scanner system <NUM> with a variety <NUM> of example scan targets, according to an example embodiment. The variety <NUM> of example scan targets comprises a printed medium <NUM>, as well as several mobile devices, each with self-lit display screens.

The example mobile devices represented within the scan target variety <NUM> comprise a cellular "smart phone" type telephone and a tablet computer <NUM>. The example mobile devices also comprise a barcode scanner PDT <NUM> and a PDA <NUM>. The graphic media of the variety <NUM> are shown by way of example and should be considered representative, but not construed as limiting in any way.

The images presented by the scan target variety <NUM> may comprise two-dimensional (2D) geometric arrays of graphic data such as barcode patterns ("barcodes"). The barcodes may comprise Universal Product Code (UPC) patterns, HanXin Code Patterns, Quick-Read (QR) patterns, PDF417 (Portable Document File) patterns of four (<NUM>) vertical bar like symbols disposed over <NUM> horizontal spaces, and/or dot code patterns. Other kinds of graphic information, images and visual data may also be scanned by the system <NUM>.

<FIG> depicts a flow chart for an example process <NUM> for scanning information presented by graphic media, according to an example embodiment. The process <NUM> begins with an example step <NUM>.

In the step <NUM>, a duration and an intensity are fixed in relation to an illumination. In step <NUM>, an image of the scan target is taken with the fixed illumination related duration and intensity over a first exposure duration. The first exposure duration comprises a significant positive multiple of the fixed illumination related duration.

In step <NUM>, the taken image is evaluated in relation to a quality related characteristic thereof. The evaluation may relate to a comparison of the quality related characteristic of the image to a specified "target" quality metric. The quality related image characteristic, the target quality metric and/or the corresponding evaluation and/or comparison may comprise quality measurements related to grey scales, saturation levels, and/or black levels.

In step <NUM>, the exposure duration is adjusted relative to the first exposure duration and in step <NUM>, the steps of taking the image and evaluating the image are repeated with the adjusted exposure duration until the evaluated quality related image characteristic at least equals a value of a quality related target.

The process <NUM> comprises further steps. Upon the adjusting the exposure duration step '<NUM>' and the exposure duration reaching a maximum adjustment value, the process <NUM> comprises a step <NUM>. In the step <NUM>, a fixedness of the fixed illumination related duration is reset.

The illumination related duration is thus adjusted to an adjusted illumination duration, which exceeds (is greater than) the fixed illumination related duration. The steps <NUM> and <NUM> of taking the image and evaluating the image, respectively, are then repeated with (e.g., "at," "over," "using," "based on") the adjusted illumination duration until the evaluated quality related image characteristic at least meets (e.g., "equals," "reaches") the value of the quality related target.

Upon the repeating the steps of taking the image and evaluating the image with the adjusted illumination duration, in which the illumination duration reaches a maximum adjustment value but the evaluated quality related image characteristic fails to at least meet the value of the quality related target, an image having an evaluated quality related characteristic value closest to the quality related target may be processed, used, selected, accepted, etc..

The process <NUM> may be implemented using the scanner system <NUM>, described above with reference to <FIG>, and/or the computer and communication system platform <NUM>, described below with reference to <FIG>.

Example embodiments are operable for scanning some images in environmental areas illuminated by ambient lighting of relatively low levels. The illumination levels are low in relation to ambient light levels sufficient for illuminating print related graphic media and/or electronic displays (e.g., beyond an effective illumination range of self-lighting associated therewith).

With scan targets within about <NUM> proximity to the scanners, example embodiments are implemented in which an AEC sets the illumination duration for a brief time period. During this brief time period, illumination may be actuated by energizing a scanner on-board light source with an electric current fixed at a value set, e.g., in firmware.

As a position of the scan target is displaced to another location further from the scanner, the illumination provided by the on-board light source decreases by the square of the distance increase. At a distance of <NUM> separation between the scanner and the scan target, ambient lighting in some settings may become more significant than the illumination remaining from the scanner's on-board light source.

AEC computes an automatic adjustment over the exposure duration to a longer time period. Even with scans performed over the increased exposure duration, example embodiments keep the illumination level of the light source fixed and its actuation current thus remains fixed.

Example embodiments may be implemented for scanning targets <NUM> or more from the scanner in situations without sufficient ambient lighting. Such a situation is described below with reference to <FIG>. In such situations, the exposure duration may reach an upper limit, e.g., specified in firmware. In such situations, the AEC thus causes an adjustment of the illumination duration automatically to a longer time period. Notwithstanding any such increase to the illumination duration however, the exposure duration remains significantly longer in relation thereto.

<FIG> depicts an example image <NUM> showing a barcode (e.g., UPC) pattern <NUM>, captured from a printed medium <NUM>, according to an example embodiment. The barcode <NUM> shown in the image <NUM> presents useful visual data, which allows effective access to graphic information encoded in the medium on which the barcode is printed. At scan time, the graphic medium scan target <NUM> on which the captured barcode <NUM> was presented is disposed in an area with the low ambient lighting level, as described above (e.g., "defined," "explained," etc. in the paragraph immediately preceding the present paragraph).

Moreover, the scan target <NUM> presenting the captured barcode <NUM> is imaged in the dark area (of low ambient lighting) according to an example embodiment as illuminated by a short light pulse. The short light pulse is activated over an illumination duration shorter than an exposure duration, over which the image <NUM> is captured. The short light pulse is also deactivated (e.g., "shut-off," "dimmed significantly," "extinguished," "deenergized," etc.) at an expiration (e.g., "termination") of the illumination duration.

The brief light pulse provided according to example embodiments may provide less light, overall, than the total amount of illumination provided by the relatively long light pulses provided typically by scanners (e.g., using "conventional" means). The difference may, in fact, be significant. However, the brief light pulse of example embodiments is sufficient for decoding the graphic data presented by the barcode <NUM>, as captured in the scanned image <NUM>. In this sense, the term "brief" is used herein relative to the corresponding significantly longer exposure duration and/or, to the longer light pulses typical of other (e.g., "conventional") scanners.

While the brief light pulse may suffice for decoding the barcode, and thus access graphic data presented by the image <NUM>, augmentations may be helpful in some other situations. For example, if a symbol presented by a scan target was disposed at a locale farther away from the scanner (e.g., scanner <NUM>; <FIG> ) than the proximity thereto of scan target <NUM>, or the ambient light level of that locale is significantly darker in relation thereto (e.g., pitch-black) an example embodiment may be implemented to allow or enable full lighting on one or more subsequent scan attempt.

Setting the exposure duration and the illumination duration, adjusting the set exposure duration and/or illumination duration and/or evaluating quality related characteristics of captured images relative to quality targets are computed according to an AEC algorithm and optionally also values stored in firmware. The computations may be performed or controlled based on instructions stored tangibly in non-transitory computer readable storage media.

With the scan target <NUM> presenting the barcode <NUM> within about <NUM>-<NUM> centimeters (cm) proximity to the scanner, an example embodiment may be implemented in which the AEC sets the illumination duration for a brief time period of around <NUM>. During this brief time period, the scanner's light source is energized by electric current fixed at a value set, e.g., in firmware.

As a position of the scan target <NUM> is displaced to another location further from the scanner, the illumination provided by its light source decreases by the square of the distance increase. At a distance of about <NUM>-<NUM> separation between the scan target <NUM> and the scanner, ambient lighting in some settings may become more significant than the illumination remaining from the light source.

AEC computations cause adjustment of the exposure duration automatically to a longer time period. Even with scans performed over the increased exposure duration, example embodiments keep the illumination level of the light source fixed and its actuation current thus remains fixed.

Situations may arise however in which the ambient lighting is too low for sufficient illumination of the scan target <NUM>. An example embodiment is implemented for scanning targets more than about <NUM>-<NUM> or more from the scanner in situations without sufficient ambient lighting. The image of the scan target <NUM> shown in <FIG> is captured in such a low ambient lighting milieu, wherein the exposure duration has reached an upper limit specified, e.g., in firmware.

In the situation shown in <FIG>, AEC computations cause an adjustment to the illumination duration automatically to a longer time period. Notwithstanding any such increase to the illumination duration however, the exposure duration remains significantly longer.

Example embodiments are thus described in relation to processes, and a system, for scanning a graphic medium scan target. An image of the scan target is captured over an exposure duration. An illumination of the scan target is actuated over an illumination duration brief relative to the exposure duration. The illumination of the scan target is deactivated upon an expiration of the illumination duration. The capturing the image step continues over a significant portion of the exposure duration persisting after the expiration of the illumination duration. The processes and systems described in relation to example embodiments may be implemented on a computer and communication network platform, such as that described below.

<FIG> depicts an example computer and network platform <NUM>, with which an example embodiment may be implemented. <FIG> depicts example computer and network platforms <NUM>, with which an embodiment of the invention may be implemented. For example, the computer may comprise a scanner computer operable for exchanging data via communication networks, which may be represented at least in relation to some aspects thereof with reference to <FIG>. The scanner computer <NUM> comprises scanner related components <NUM>, which represents one or more features or components of a scanner system such as system <NUM> ( <FIG> ).

Along with the scanner related components <NUM>, the computer system <NUM> is operable for capturing graphic information from scan targets, which may comprise electronic displays and/or print based graphic media. Scanning the graphic medium captures an image or other aspects of such graphic information over an exposure duration. An illumination of the scan target is actuated over an illumination duration, which is brief relative to the exposure duration. The illumination of the scan target is deactivated upon an expiration of the illumination duration. The capture of the image continues over a significant portion of the exposure duration, which persists after the expiration of the significantly briefer illumination duration.

The scanner computer <NUM> comprises a data bus <NUM> or other communication mechanism for communicating information, and a processor <NUM> coupled with bus <NUM> for processing information. Computer <NUM> also includes a main memory <NUM>, such as a random access memory (RAM) or other dynamic storage device, coupled to bus <NUM> for storing information and instructions to be executed by processor <NUM>.

Computer <NUM> further includes a read only memory (ROM) <NUM> or other static storage device coupled to bus <NUM> for storing static information and instructions for processor <NUM>. A storage device <NUM>, such as a magnetic disk, flash drive, or optical disk, is provided and coupled to bus <NUM> for storing information and instructions. Processor <NUM> may perform one or more digital signal processing (DSP) functions. Additionally or alternatively, DSP functions may be performed by another processor or entity (represented herein with processor <NUM>).

Computer <NUM> may be coupled via bus <NUM> to a display <NUM>, such as a modern liquid crystal display (LCD). Older cathode ray tube (CRT) display types, plasma displays, "thin" (or "cold cathode") CRTs, and other displays and monitors may also be used for displaying information to a computer user. In some telephone, tablet, PDT and/or PDA applications, LCDs or thin CRTs may be used with some preference or regularity.

An input device <NUM>, including alphanumeric (and/or ideographic, syllabary-related and/or other) symbols and other keys, is coupled to bus <NUM> for communicating information and command selections to processor <NUM>. Another type of user input device comprises a cursor control <NUM>. The cursor controller <NUM> may comprise a haptic-enabled "touch-screen" or "mouse pad" like GUI display, or a mouse, trackball, or cursor direction keys for communicating direction information and command selections to processor <NUM> and for controlling cursor movement on display <NUM>.

Such input devices may typically allow or feature two degrees of freedom over at least two axes. The two axes comprise a first axis (e.g., 'x' or horizontal) and a second axis (e.g., 'y' or vertical), which allows the device to specify positions over a representation of a geometric plane. Some phones with simpler keyboards may implement this or a similar feature haptically using a touch-screen GUI display and/or with a set of directionally active "arrow" (or other direction-indicative) keys.

Embodiments of the present disclosure relate to the use of computer <NUM> for scanning visual data such as barcodes and/or other images presented on printed graphic media and/or self-lit electronic displays, and other embodiments described herein. This feature is provided, controlled, enabled or allowed with computer <NUM> functioning in response to processor <NUM> executing one or more sequences of one or more instructions contained in main memory <NUM> and/or other non-transitory computer readable storage media.

Such instructions may be read into main memory <NUM> from another computer-readable medium, such as storage device <NUM>. One or more processors in a multiprocessing arrangement may also be employed to execute the sequences of instructions contained in main memory <NUM>. In alternative embodiments, hardwired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware, circuitry, firmware and/or software.

The term "computer readable storage medium," as used herein, may refer to any non-transitory storage medium that participates in providing instructions to processor <NUM> for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Transmission media includes coaxial cables, copper wire and other electrical conductors and fiber optics, including the wires (and/or other conductors or optics) that comprise the data bus <NUM>. Transmission media can also take the form of electromagnetic (e.g., light) waves, such as those generated during radio wave and infrared and other optical data communications (and acoustic, e.g., sound related, or other mechanical, vibrational, or phonon related transmissive media.

Common or familiar forms of non-transitory computer-readable storage media include, for example, flash drives such as may be accessible via USB (universal serial bus), "Firewire," or other connections, as well as legacy "floppy disks," flexible disks, hard drives and disks, legacy magnetic tape, and/or any other magnetic medium, CD-ROM, DVD and BD and other optically accessible or readable media, or even punch cards, paper tape, and other legacy or physically or mechanically media bearing patterns of holes or the like, RAM, PROM, EPROM, FLASH-EPROM, and/or any other memory chip or cartridge, carrier waves (as described hereinafter), or any other medium from which a computer can read data.

Various forms of non-transitory computer readable storage media may be involved in carrying one or more sequences of one or more instructions to processor <NUM> for execution. For example, the instructions may initially be carried on a magnetic or other disk of a remote computer (e.g., server <NUM>). The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line and/or network, e.g., using a modem (modulator/demodulator).

A modem local to the computer <NUM> can receive the data over networks wirelessly and/or on wireline (e.g., coaxial cable, fiber optics, telephone lines, etc.) and use an infrared or other transmitter to convert the data to an infrared or other signal. An infrared or other detector coupled to bus <NUM> can receive the data carried in the infrared or other signal and place the data on bus <NUM>.

Computer <NUM> also includes a communication interface <NUM> coupled to bus <NUM>. Communication interface <NUM> provides a two-way (or more) data communication coupling to a network link <NUM> that is connected to a local network <NUM>. For example, communication interface <NUM> may comprise a cable modem, an optical modem, or a DSL (digital subscription line), or even legacy media such as ISDN (integrated services digital network) cards, or other modem types, to provide a data communication connection to a corresponding type of telephone line or wireless medium. As another example, communication interface <NUM> may comprise a local area network (LAN) card to provide a data communication connection to a compatible LAN.

For example, network link <NUM> may provide a connection through local network <NUM> to a host computer <NUM> or to data equipment operated by an Internet Service Provider (ISP) (or telephone switching center) <NUM>. An example embodiment may be implemented in which the local network <NUM> comprises a communication medium (or multiple network media) with which a user's telephone or other data (and/or other) communication system may function. The ISP <NUM>, in turn, provides data communication services over one or more wide area network (WANs) and internetworks, including the worldwide packet-switched data communication networks now commonly referred to as the "Internet" <NUM> and the "World-Wide Web" (www) associated and/or interconnected therewith, and/or using TCP/IP (Transmission Control Protocol/Internet Protocol) or other modalities with similar connectivity features and/or capabilities.

The local network <NUM> and WAN Internet <NUM> both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals on network link <NUM> and through communication interface <NUM>, which carry the digital data to and from computer <NUM>, are exemplary forms of carrier waves transporting the information.

Computer <NUM> can send messages and receive data, including program code, through the network(s), network link <NUM> and communication interface <NUM>.

In the Internet example, a server <NUM> might transmit a requested code for an application program related to logistics or other computations through Internet <NUM>, ISP <NUM>, local network <NUM> and communication interface <NUM>. In an embodiment of the invention, one such downloaded application provides for scanning print related graphic media and self-lit electronic displays in relation to accessing visual, graphic and other information presented therewith.

In this manner, computer <NUM> may obtain application code in the form of a carrier wave.

Computer <NUM> thus gathers data from the database <NUM> and the scanner components <NUM> and directs the capture or other gathering of the graphic data presented therewith. An example embodiment may be implemented in which computer <NUM> gathers data from the database <NUM>, the server <NUM>, the scanner components <NUM> and/or the computer <NUM> via the WAN/Internet <NUM> local network <NUM> and the network link <NUM>, etc. Data contained in barcodes and other graphic information captured from the scanned media targets may also be sent to the database <NUM> for storage and access by computer <NUM>, later retrieval by the scanner computer <NUM> and/or other computers connected over any of the networks of the platform <NUM>.

An example embodiment may also be implemented in which the computer <NUM> gathers data from the database <NUM> by means of queries directed via the server <NUM> and over the internet (or other network) <NUM>, as well as the local network <NUM> and network link <NUM>, etc..

Example embodiments of the present invention are thus described in relation to a process for scanning a graphic medium scan target. An image of the scan target is captured over an exposure duration. An illumination of the scan target is actuated over an illumination duration brief relative to the exposure duration. The illumination of the scan target is deactivated upon an expiration of the illumination duration. The capturing the image step continues over a significant portion of the exposure duration, which persists after the expiration of the illumination duration.

In the specification and/or figures, example embodiments of the invention have been described in relation to a process is described for scanning a scan target related to an electronic display or a print based graphic medium. An image of the scan target is captured over an exposure duration and with an illumination activated at a fixed lighting intensity level and for a set illumination duration. The set illumination duration corresponds to a mere fraction of the exposure duration. The illumination deactivates upon expiration of the illumination duration. A quality related characteristic of the captured image is evaluated relative to a target quality metric.

Claim 1:
A method for scanning a graphic medium scan target, the method comprising the steps of:
computing an exposure duration and an illumination duration according to an automatic exposure control process;
capturing (<NUM>) an image of the scan target over the exposure duration;
energizing (<NUM>) illumination of the scan target for the illumination duration; and
deactivating (<NUM>) illumination of the scan target at a point in time during the exposure duration, wherein the exposure duration comprises a length of time that is significantly greater than a length of time corresponding to the illumination duration;
wherein the capturing, energizing, and deactivating are performed iteratively with increasing exposure duration values and a first set time duration of illumination duration, and upon reaching a maximum exposure duration value the illumination duration is increased relative to the first set time duration.