Source: http://www.google.com/patents/US7270273?dq=No.+6,411,949&ei=AUR7T-LGJqSr0AHy2aSiBg
Timestamp: 2017-10-24 01:29:49
Document Index: 645258762

Matched Legal Cases: ['art 2', 'art 2', 'Application No. 02', 'Application No. 02723063', 'Application No. 02', 'Application No. 06']

Patent US7270273 - Optical reader having partial frame operating mode - Google Patents
A method for decoding a decodable symbol using an optical reader having a 2D image sensor that is configured to operate in a partial frame capture operating mode. In a partial frame operating mode, the reader clocks out and captures at least one partial frame of image data having image data corresponding...http://www.google.com/patents/US7270273?utm_source=gb-gplus-sharePatent US7270273 - Optical reader having partial frame operating mode
Publication number US7270273 B2
Application number US 10/651,298
Also published as US7434733, US20040195332, US20070181693
Publication number 10651298, 651298, US 7270273 B2, US 7270273B2, US-B2-7270273, US7270273 B2, US7270273B2
Patent Citations (101), Non-Patent Citations (24), Referenced by (56), Classifications (9), Legal Events (4)
Optical reader having partial frame operating mode
US 7270273 B2
A method for decoding a decodable symbol using an optical reader having a 2D image sensor that is configured to operate in a partial frame capture operating mode. In a partial frame operating mode, the reader clocks out and captures at least one partial frame of image data having image data corresponding to less than all of the pixels of an image sensor pixel array. In one embodiment, the reader operating in a partial frame operating mode captures image data corresponding to a linear pattern of pixels of the image sensor, reads the image data, and attempts to decode for a decodable bar code symbol which may be represented in the image data.
1. A method of decoding a decodable symbol, said method comprising the steps of:
(a) operating an optical reader having a 2D image sensor;
(b) in a partial frame operating mode in which said optical reader avoids obtaining electrical signals representing light intensity at each pixel of said image sensor, capturing a first partial frame of image data corresponding to a first set of pixel positions of said 2D image sensor, the partial frame of image data including at least a portion of the decodable symbol;
(c) attempting to decode information encoded by the decodable symbol from the captured first partial frame of image data; and
(d) if in step (c) the reader fails to decode information encoded by the decodable symbol, capturing a second partial frame of image data, said second partial frame of image data corresponding to a second set of pixel positions different from said first set of pixel positions.
2. The method of claim 1, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a linear pattern of pixels.
3. The method of claim 1, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a plurality of angularly offset linear patterns of pixels.
4. The method of claim 1, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels.
5. The method of claim 1, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a grouping of pixels about a center of said image sensor.
6. The method of claim 1, wherein said optical reader is configured to switch operation of the reader to a full frame operating mode if the reader fails to decode information encoded by a decodable symbol from a partial frame of image data.
7. The method of claim 1, wherein said optical reader when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by not clocking out an electrical signal for each pixel of said image sensor.
8. The method of claim 1, wherein said optical reader when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by clocking out certain pixels of said image sensor at a rate that is too fast to allow development electrical signals representative of light intensity at the certain pixels.
9. The method of claim 1, wherein said capturing step (b) includes the step of capturing image data corresponding to a row of pixels of said image sensor.
10. An apparatus for decoding information from a decodable symbol, the apparatus comprising:
an optical reader having a 2D image sensor;
a control circuit configured to operate in a partial frame operating mode in which said control circuit operates the 2D image sensor to capture a partial frame of image data representing at least a portion of the decodable symbol, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor;
wherein said control circuit is configured to process the partial frame of image data to attempt to decode therefrom information encoded by the decodable symbol; and
wherein said control circuit is configured to determine whether a 2D decodable symbol is represented in the partial frame of image data.
11. An apparatus for decoding information from a decodable symbol, the apparatus comprising:
an imaging assembly having a 2D image sensor;
wherein said optical reader is configured to operate in a full frame operating mode to capture a full frame of image data.
12. The apparatus of claim 11, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by not clocking out an electrical signal for each pixel of said image sensor.
13. The apparatus of claim 11, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by clocking out certain pixels of said image sensor at a rate that is too fast to allow development electrical signals representative of light intensity at the certain pixels.
14. An apparatus for decoding information from a decodable symbol, the apparatus comprising:
a control circuit configured to operate in a partial frame operating mode in which said control circuit operates the 2D image sensor to capture a first partial frame of image data representing at least a portion of the decodable symbol and corresponding to a first set of pixels of said 2D image sensor, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor;
wherein said control circuit is configured to process the first partial frame of image data to attempt to decode therefrom information encoded by the decodable symbol; and
wherein said control circuit is configured to capture a second partial frame of image data, said second partial frame of image data corresponding to a second set of pixel positions of said 2D image sensor different from said first set.
15. A method of decoding a decodable symbol, said method comprising the steps of:
(a) operating a hand graspable optical reader having an imaging assembly including a 2D image sensor and optics focusing an image onto said 2D image sensor;
16. The method of claim 15, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a linear pattern of pixels.
17. The method of claim 15, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a plurality of angularly offset linear patterns of pixels.
18. The method of claim 15, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels.
19. The method of claim 15, wherein said capturing step referred to in (b) includes the step of capturing image data corresponding to a grouping of pixels about a center of said image sensor.
20. The method of claim 15, wherein said optical reader is configured to switch operation of the reader to a full frame operating mode if the reader fails to decode information encoded by a decodable symbol from a partial frame of image data.
21. The method of claim 15, wherein said optical reader when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by not clocking out an electrical signal for each pixel of said image sensor.
22. The method of claim 15, wherein said optical reader when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by clocking out certain pixels of said image sensor at a rate that is too fast to allow development electrical signals representative of light intensity at the certain pixels.
23. The method of claim 15, wherein said capturing step (b) includes the step of capturing image data corresponding to a row of pixels of said image sensor.
24. An apparatus for decoding information from a decodable symbol, the apparatus comprising:
an imaging assembly having a 2D image sensor and optics focusing an image onto said 2D image sensor;
a housing adapted to be grasped by a human hand;
25. An apparatus for decoding information from a decodable symbol, the apparatus comprising:
26. The apparatus of claim 25, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by not clocking out an electrical signal for each pixel of said image sensor.
27. The apparatus of claim 25, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by clocking out certain pixels of said image sensor at a rate that is too fast to allow development electrical signals representative of light intensity at the certain pixels.
28. The apparatus of claim 25, wherein said apparatus is configured to switch operation from said partial frame operating mode to said full frame operating mode if said attempt to decode said partial frame is not successful.
29. The apparatus of claim 25, wherein said partial frame of image data corresponds to a linear pattern of pixels.
30. The apparatus of claim 25, wherein said partial frame of image data corresponds a plurality of angularly offset linear patterns of pixels.
31. The apparatus of claim 25, wherein said partial frame of image data corresponds to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels.
32. The apparatus of claim 25, wherein said partial frame of image data corresponds to a grouping of pixels about a center of said image sensor.
33. The apparatus of claim 25, wherein said partial frame of image data corresponds to a row of pixels at or about a center of said image sensor.
34. An apparatus for decoding information from a decodable symbol, the apparatus comprising:
35. The apparatus of claim 34, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by not clocking out an electrical signal for each pixel of said image sensor.
36. The apparatus of claim 34, wherein said control circuit when operating in said partial frame operating mode avoids obtaining electrical signals representing light intensity at each pixel of said image sensor by clocking out certain pixels of said image sensor at a rate that is too fast to allow development electrical signals representative of light intensity at the certain pixels.
37. The apparatus of claim 34, wherein said apparatus is configured to switch operation from said partial frame operating mode to said full frame operating mode if said attempt to decode said partial frame is not successful.
38. The apparatus of claim 34, wherein said partial frame of image data corresponds to a linear pattern of pixels.
39. The apparatus of claim 34, wherein said partial frame of image data corresponds to a plurality of angularly offset linear patterns of pixels.
40. The apparatus of claim 34, wherein said partial frame of image data corresponds to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels.
41. The apparatus of claim 34, wherein said partial frame of image data corresponds to a grouping of pixels about a center of said image sensor.
42. The apparatus of claim 34, wherein said partial frame of image data corresponds to a row of pixels at or about a center of said image sensor.
This application claims priority to, and is a continuation-in-part of U.S. patent application Ser. No. 09/766,806, filed Jan. 22, 2001, now U.S. Pat. No. 6,637,658 which application is incorporated herein by reference in its entirety.
The invention relates to optical readers in general and in particular to methods for operating an optical reader having a 2D image sensor.
Optical readers having 2D image sensors commonly are used to read both 1D and 2D symbols. Some optical readers having a 2D image sensor read a 1 D symbol by capturing a 2D image representation, or “frame” of image data corresponding to a target area which comprises a 1 D symbol, and launching a scan line or lines in order to attempt to decode for 1 D symbols which may be represented in the area. Other optical readers having 2D image sensors read 1D symbols by capturing a 2D image representation of an area containing the 1 D symbol, preliminarily analyzing the image data represented in the area to determine that the image data comprises a representation of a 1D symbol, and then launching a scan line in an attempt to decode for the 1 D symbol determined to be present. In either case, a full frame 2D image representation is captured in order to decode for a 1 D symbol.
Capturing a 2D image representation requires a substantial amount of time, especially in applications wherein one or more “test” frames of image data must be captured prior to capture of a frame that is subjected to processing. Furthermore, assuming a constant processing speed, the time required for an optical reader to capture a 2D image representation increases with the resolution of the image sensor which is incorporated in the reader. Currently available CMOS mega pixel image sensors have low frame clock out rates of about 15 frames per second (FPS).
A user's satisfaction with an optical reader often varies directly with the decoding speed of the optical reader. Given that higher resolution, including mega pixel readers, are expected to grow in popularity, the frame capture time will become an increasingly important factor for consideration in performance of an optical reader.
A method and apparatus for decoding a decodable symbol using an optical reader having a 2D image sensor that is configured to operate in a partial frame capture operating mode. In a partial frame operating mode, the reader clocks out and captures at least one partial frame of image data having image data corresponding to less than all of the pixels of an image sensor pixel array. In one embodiment, the reader operating in a partial frame operating mode captures image data corresponding to a linear pattern of pixels of the image sensor, reads the image data, and attempts to decode for a decodable bar code symbol which may be represented in the image data.
FIGS. 2 b–2 h show various types of optical reader housings in which the invention may be incorporated;
FIG. 3 a is a process flow diagram illustrating frame clocking operations in an optical reader having an image sensor including a one-frame buffer.
FIGS. 4 a–4 g illustrate various image data patterns that may be captured by an optical reader operating in a partial frame capture mode according to the invention;
FIGS. 5 b–5 h show various types of optical reader housings in which the invention may be incorporated.
FIGS. 6 a–6 g illustrate various image data patterns that may be captured by an optical reader operating in a partial frame capture mode according to the invention;
FIG. 7 a is a block diagram of an optical reader of a type in which the invention may be incorporated;
FIGS. 7 b–7 h show various types of optical reader housings in which the invention may be incorporated;
FIG. 8 is a flow diagram showing an illustrative process in which a partial frame of an image of an encoded indicium is processed extract encoded information, according to principles of the invention;
FIG. 9 is another flow diagram showing an illustrative process in which a partial frame of an image of an encoded indicium is processed to extract encoded information, according to principles of the invention; and
FIG. 10 is yet another flow diagram showing an illustrative process in which a partial frame of an image of an encoded indicium is processed to extract encoded information, according to principles of the invention;
FIG. 11 is a perspective view of an imaging module;
FIG. 12 is an illustration showing an illumination pattern and an illumination pattern that may be projected by the imaging module of FIG. 11.
FIGS. 2 b through 2 g show examples of types of housings in which the present invention may be incorporated. FIGS. 2 b–2 g show 1D/2D optical readers 10-1, 10-2 and 10-3. Housing 12 of each of the optical readers 10-1 through 10-3 is adapted to be graspable by a human hand and has incorporated therein at least one trigger switch 74 for activating image capture and decoding and/or image capture and character recognition operations. Readers 10-1 and 10-2 include hard-wired communication links 79 for communication with external devices such as other data collection devices or a host processor, while reader 10-3 includes an antenna 80 for providing wireless communication device or a host processor.
Using CMOS fabrication techniques, image sensors are readily made so that electrical signals corresponding to certain pixels of a sensor can be selectively clocked out without clocking out electrical signals corresponding to remaining pixels of the sensor. CMOS image sensors are available from such manufacturers as Symagery, Pixel Cam, Omni Vision, Sharp, Natural Semiconductor, Toshiba, Hewlett-Packard and Mitsubishi. Further aspects of a partial frame clock out mode are described in commonly assigned application Ser. No. 09/766,806 entitled “Optical Reader Having Partial Frame Operating Mode,” now U.S. Pat. No. 6,637,658 filed concurrently herewith and incorporated herein by reference.
Referring to FIGS. 4 a–4 g the invention is an optical reader equipped with a 2D image sensor that is configured to operate in a partial frame capture mode. In a partial frame clock out mode, a control circuit of an optical reader clocks out (or “reads”) electrical signals corresponding to less than all of the 2D image sensor's pixels, and captures image data corresponding to the pixel locations into memory.
Partial frames of image data which may be clocked out and captured by an optical reader control circuit during a partial frame capture mode are illustrated in FIGS. 4 a–4 g in which valid zones 212 represent frame image data corresponding to image sensor pixel positions that are clocked out and invalid zones (indicated by the shaded regions of the views of FIGS. 4 a–4 g) represent potential image data positions corresponding to pixel positions that are not clocked out.
In the examples illustrated with reference to FIGS. 4 a–4 e an optical reader operating in a partial frame clock out mode clocks out electrical signals corresponding to linear patterns of pixels. It is useful to cause a reader to clock out electrical signals corresponding to linear patterns as shown in FIGS. 4 a–4 d when a reader will be used to decode mainly 1D linear bar code symbols.
Processor 144 is preferably devoted primarily to controlling the image acquisition process, the A/D conversion process and the storage of image data, including the ability to access memories 146 and 147 via a DMA channel. Processor 144 may also perform many timing and communication operations. Processor 144 may, for example, control the illumination of LEDs 122, the timing of image sensor 132 and an analog-to-digital (A/D) converter 136, the transmission and reception of data to and from a processor external to reader 110, through an RS-232, a network such as an Ethernet, a serial bus such as USB, a wireless communication link (or other) compatible I/O interface 137. Processor 144 may also control the outputting of user perceptible data via an output device 138, such as a beeper, a good read LED and/or a display monitor which may be provided by a liquid crystal display such as display 182. Control of output, display and I/O functions may also be shared between processors 142 and 144, as suggested by bus driver I/O and output/display devices 137′ and 138′ or may be duplicated, as suggested by microprocessor serial I/O ports 142A and 142B and I/O and display devices 137′ and 138′. As explained earlier, the specifics of this division of labor is of no significance to the present invention.
FIGS. 5 b–5 g show examples of types of housings in which the present invention may be incorporated. FIGS. 5 b–5 g show 1D/2D optical readers 110-1, 110-2 and 110-3. Housing 112 of each of the optical readers 110-1 through 110-3 is adapted to be graspable by a human hand and has incorporated therein at least one trigger switch 174 for activating image capture and decoding and/or image capture and character recognition operations. Readers 110-1 and 110-2 include hard-wired communication links 179 for communication with external devices such as other data collection devices or a host processor, while reader 110-3 includes an antenna 180 for providing wireless communication device or a host processor.
Any one of the readers described with reference to FIGS. 5 b–5 g may be mounted in a stationary position as is illustrated in FIG. 5 h showing a generic optical reader 110 docked in a scan stand 190. Scan stand 190 adapts portable optical reader 110 for presentation mode scanning. In a presentation mode, reader 110 is held in a stationary position and an indicia bearing article is moved across the field of view of reader 110.
Referring again to particular aspects of the invention, control circuit 140 in the example of FIG. 4 a executes a partial frame capture mode in order to clock out and capture pixel data illustrated by valid zone 212-1. Reading the pixel values of valid zone 212-1 is effective to decode 1D symbol 216-1 in the reader's full field of view. Given that clocking out and capturing image data of valid zone 212-1 consumes less time than clocking out and capturing a full frame of image data, it is seen that execution of a partial frame capture mode decreases the decode time of the reader. In prior art 2D optical readers, electrical signals corresponding to full frame 210 are clocked out in order to decode a single 1 D symbol 216-1. The pixels of valid zone 212-1 may comprise a single row of pixels (a scan line) or a plurality of rows.
In the example of FIG. 4 c, control circuit 140 executes a partial frame capture mode in order to clock out and capture image data defining valid zones 212-5 through 212-9. Valid zones 212-5 to 212-9 form a plurality of horizontal parallel lines. The pattern of valid zones shown in FIG. 4 c clocked out and captured in a partial frame capture mode is effective for decoding substantially horizontally oriented 1D symbols which are at an unknown height in a full field of view. It is seen that the reading of image data of valid zone 212-8 will not result in the decoding of symbol 216-3 because symbol 216-3 is not a 1D symbol. Nevertheless, because valid zone 212-8 intersects symbol bullseye 216 b, reading of image data of valid zone 212-8 may be effective to determine that a 2D symbol is likely present in the full field of view of image sensor 132. In one aspect of the invention, reader 110 may be configured to switch out of a partial frame capture mode and into a full frame capture mode when reading of image data captured in the partial frame capture mode reveals that a 2D symbol is likely to be represented in the image data corresponding to the image sensor's full field of view.
In the example of FIGS. 4 f and 4 g valid zones 212-12 and 212-13 correspond to nonlinear groupings of pixels. Capturing of the valid zone patterns 212-12 and 212-13 of FIGS. 4 f and 4 g is particularly useful for decoding symbol image data in the case that a symbol is likely to be at a certain position in relation to an image sensor's full frame field of view such as in the center of an image sensor's field of view as shown in FIG. 4 f.
The invention relates to a method for configuring an optical reader having a 2D image sensor so the reader captures and processes image data at higher speeds. Capturing a 2D image representation requires a substantial amount of time, especially in applications wherein one or more “test” frames of image data must be captured prior to capture of a frame that is subjected to processing as has been explained in commonly assigned U.S. patent application Ser. No. 09/766,922, entitled “Optical Reader Having Reduced Parameter Determination Delay,” filed Jan. 22, 2001, and incorporated herein by reference in its entirety. A 1D or 2D symbol that represents information and that is amenable to imaging and being recognized using a 2D image sensor is referred to generically herein as an encoded indicium. Objects carrying 1D or 2D symbols indicative of the object's identity or quality, of the contents of an object (such as a package), or that provide other information, are frequently used in performing business or commercial activities. Higher speed is useful in commercial or business settings. Higher speed permits greater productivity per unit of time, and concomitantly, allows reductions in cost through reductions in the number of imaging devices and or personnel required to accomplish a given repetitive task.
As will be understood by those of ordinary skill, the terms “commercial transaction” and “business transaction” as used herein include both transactions that involve an agreement or promise for which consideration is exchanged and the activities that may be conducted in preparation for or in completion of such agreements, as well as interactions that are unilateral, such as the making of a gift (a promise for which consideration is not exchanged), or internal activities within an organization, such as maintaining inventory records, maintaining personnel records or records of assets, or other activities that an be categorized as “overhead” in a business context. Activities performed in governmental or quasi-governmental settings are also contemplated, such as the use of encoded indicia by such organizations as the United States Postal Service and the military, as well as by State and local governmental agencies.
In some embodiments, the encoded indicium is a symbol that comprises a plurality of fields or regions. An example of such an encoded indicium is a check or bank draft, which represents a payment of money, and which is a two-dimensional document having a plurality of fields, such as a date, a payee, an amount, a signature of a maker, and information regarding a financial institution holding the funds represented by the check, and an account against which the funds are payable.
In one embodiment, the partial frame operating mode is employed to clock out and capture image data corresponding to at least one linear pattern sufficient so that a 1D symbol in the field of view of the image sensor may be decoded without clocking out and capturing an entire frame of image data. The partial frame of image data that is clocked out from the image sensor during the partial frame capture operating mode may be, for example, a row of symbols at or near the center of the image sensor or a limited number of lines of image data corresponding to pixel locations of the image sensor, possibly at varying angular orientations. The control circuit may be configured so that if the control circuit cannot decode a 1D symbol during the course of operating in the partial frame capture mode, or detects that a 2D symbol is represented in the captured image data, the control circuit switches operation to a full frame capture mode.
In one aspect, the invention features a method of conducting a business transaction involving information recorded in an encoded indicium. The method comprises the steps of operating an optical reader having a 2D image sensor; capturing with the 2D image sensor a partial frame of image data from an encoded indicium; and processing image data of the partial frame of image data to extract information encoded by the encoded indicium whereby the purposes of the business transaction are advanced.
In one embodiment, the capturing step includes the step of capturing image data corresponding to a linear pattern of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a plurality of angularly offset linear patterns of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a grouping of pixels about a center of the image sensor. In one embodiment, the processing step includes the step of reading the image data out of a memory device. In one embodiment, the processing step includes the steps of reading the image data out of a memory device and attempting to decode for a decodable symbol which may be represented in the image data.
In one embodiment, the method further includes the step of capturing a full frame of image data if the processing step reveals that a 2D symbol is likely partially represented in the partial frame of image data.
In one embodiment, the method further includes the step of capturing an adaptively positioned partial frame of image data if the processing step reveals that a 2D symbol is likely partially represented in the partial frame of image data.
In one embodiment, the processing step includes the step of attempting to decode for a decodable symbol represented in the image data, the method further including the step of capturing a full frame of image data if the processing step reveals that a 2D symbol is likely partially represented in the partial frame of image data.
In another aspect, the invention relates to a method of conducting a business transaction involving information recorded in an encoded indicium. The method comprises the steps of: (a) operating an optical reader having a 2D image sensor; (b) in a partial frame operating mode, capturing a partial frame of image data, the partial from of image data including at least a portion of the encoded indicium; (c) attempting to extract information encoded by the encoded indicium from the captured partial frame of image data; and (d) if in step (c) the reader fails to extract information encoded by the encoded indicium, switching operation of the reader to a full frame capture mode.
In one embodiment, the capturing step includes the step of capturing image data corresponding to a linear pattern of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a plurality of angularly offset linear patterns of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a grouping of pixels about a center of the image sensor.
In still another aspect, the invention relates to a method of conducting a business transaction involving information recorded in an encoded indicium. The method comprises the steps of: (a) operating an optical reader having a 2D image sensor; (b) in a partial frame operating mode, capturing a partial frame of image data, the partial from of image data including at least a portion of the encoded indicium; (c) attempting to extract information encoded by the encoded indicium from the captured partial frame of image data; and (d) if in step (c) the reader fails to extract information encoded by the encoded indicium, switching operation of the reader to a second partial frame capture mode.
In one embodiment, the capturing step includes the step of capturing image data corresponding to a linear pattern of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a plurality of angularly offset linear patterns of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a plurality of vertically spaced apart horizontally oriented linear patterns of pixels. In one embodiment, the capturing step includes the step of capturing image data corresponding to a grouping of pixels about a center of the image sensor. In one embodiment, the method further comprises the step of switching operation of the reader to a full frame operating mode if the reader fails to extract information encoded by the encoded indicium from data captured using the second partial frame capture mode.
In yet another aspect, the invention features an apparatus for conducting a business transaction involving information recorded in an encoded indicium. The apparatus comprises an optical reader having a 2D image sensor configured to image an encoded indicium; a control module configured to operate the 2D image sensor to capture a partial frame of image data from the encoded indicium; and a processing module configured to process the partial frame of image data to extract therefrom information encoded by the encoded indicium, whereby the purposes of the business transaction are advanced.
In one embodiment, the apparatus further comprises an analysis module configured to deduce that a 2D encoded indicium is present in the partial frame of image data. In one embodiment, the apparatus further comprises a control module that configures the 2D sensor to operate in a full frame operating mode.
In one embodiment, the apparatus further comprises a sensor module configured to sense that a 2D encoded indicium is present in the partial frame of image data. In one embodiment, the apparatus further comprises a control module that configures the 2D sensor to operate in a second partial frame operating mode.
Encoded indicia, including 1D and 2D symbols such as bar codes, stacked bar codes, and two dimensional encoded symbologies, are commonly used in many business settings. Some representative examples include the labeling of goods and/or packages containing the goods, the use of encoded indicia to identify documents (for example patient records in a hospital or managed health care facility), and the use of encoded indicia to reduce the possibility of fraud or the use of counterfeit documents (such as the addition of encoded indicia to drivers' licenses). As already alluded to, some commonly used adjuncts to business transactions, such as checks or bank drafts, can also be considered as encoded indicia having a plurality of fields or regions in which encoded information is present.
Referring to FIGS. 6 a–6 g, there is shown an optical reader equipped with a 2D image sensor that is configured to operate in a partial frame capture mode. In a partial frame clock out mode, a control circuit of an optical reader clocks out (or “reads”) electrical signals corresponding to less than all of the 2D image sensor's pixels, and captures image data corresponding to the pixel locations into memory. It should be understood that while the 2D image sensor can view, or image, the entire area from which illumination is provided to its pixels, in the partial frame mode contemplated, only a subset of such pixels are actually interrogated or caused to provide electrical signals that are then used for analysis. The partial frame mode is controlled by a control module, as will be explained in greater detail below. The partial frame of image data is processed using a processing module configured to extract information encoded by the encoded indicium, as will be explained in greater detail below.
Partial frames of image data which may be clocked out and captured by an optical reader control circuit (or control module) during a partial frame capture mode are illustrated in FIGS. 6 a–6 g in which valid zones 1012 represent frame image data corresponding to image sensor pixel positions that are clocked out and invalid zones 1014 represent potential image data positions corresponding to pixel positions that are not clocked out.
Border 1010 defines the full field of view of an optical reader in the case the reader is operated in a full frame captured mode while symbols 1016-1, 1016-2, 1016-3, 1016-6, 1016-6 and 1016-7 are symbols entirely within the full field of view of an optical reader defined by border 1010 but are only partially within certain valid zones shown. Valid zones 1012-1, 1012-3, 1012-7, 1012-8, 1012-9, 1012-10, and 1012-13 are valid zones of image data that partially contain representations of a decodable symbol while valid zones 1012-11 and 1012-12 are valid zones of image data captured during a partial frame capture mode which contain representations of an entire decodable symbol.
In the examples illustrated with reference to FIGS. 6 a–6 d an optical reader operating in a partial frame clock out mode clocks out electrical signals corresponding to linear patterns of pixels. It is useful to cause a reader to clock out electrical signals corresponding to linear patterns as shown in FIGS. 6 a–6 d when a reader will be used to decode mainly 1D linear bar code symbols.
In the examples illustrated with reference to FIGS. 6 e, 6 f and 6 g an optical reader operating in a partial frame clock out mode clocks out electrical signals corresponding to non-linear groupings of pixels. It is useful to cause a reader to clock out electrical signals corresponding to pixel groupings as shown in FIGS. 6 e, 6 f and 6 g when a reader will be used to decode symbols which are expected to be within a certain position in an image sensor's field of view.
A reader may be configured so that the reader automatically switches out of partial frame capture mode on the sensing of a certain condition. For example a reader according to the invention may be made to switch out of partial frame capture operating mode and into a full frame capture mode on the sensing that a 2D symbol is partially represented in the partial frame of image data, or on the condition that processing of the partial frame of image data fails to result in image data being decoded. The control module can control the mode of operation of the reader based upon instructions provided in a computer program operating on an electronic processor, and can cause the reader to operate in either of the partial frame capture mode or the full frame capture mode, as appropriate.
An optical reading system in which the invention may be employed is described with reference to the block diagram of FIG. 7 a.
Optical reader 1110 includes an illumination assembly 1120 for illuminating a target object T, such as a 1D or 2D bar code symbol, and an imaging assembly 1130 for receiving an image of object T and generating an electrical output signal indicative of the data optically encoded therein. Illumination assembly 1120 may, for example, include an illumination source assembly 1122, together with an illuminating optics assembly 1124, such as one or more lenses, diffusers, wedges, reflectors or a combination of such elements, for directing light from light source 1122 in the direction of a target object T. Illumination assembly 1120 may comprise, for example, laser or light emitting diodes (LEDs) such as white LEDs or red LEDs. Illumination assembly 1120 may include target illumination and optics for projecting an aiming pattern 1127 on target T. Illumination assembly 1120 may be eliminated if ambient light levels are certain to be high enough to allow high quality images of object T to be taken. Imaging assembly 1130 may include an image sensor 1132, such as a 1D or 2D CCD, CMOS, NMOS, PMOS, CID OR CMD solid state image sensor, together with an imaging optics assembly 1134 for receiving and focusing an image of object T onto image sensor 1132. The array-based imaging assembly shown in FIG. 7 a may be replaced by a laser array based imaging assembly comprising multiple laser sources, a scanning mechanism, emit and receive optics, at least one photodetector and accompanying signal processing circuitry.
The partial frame clock out mode is readily implemented utilizing an image sensor which can be commanded by a control module to clock out partial frames of image data or which is configured with pixels that can be individually addressed. Using CMOS fabrication techniques, image sensors are readily made so that electrical signals corresponding to certain pixels of a sensor can be selectively clocked out without clocking out electrical signals corresponding to remaining pixels of the sensor. CMOS image sensors are available from such manufacturers as Symagery, Pixel Cam, Omni Vision, Sharp, National Semiconductor, Toshiba, Hewlett-Packard and Mitsubishi. A partial frame clock out mode can also be carried out by selectively activating a frame discharge signal during the course of clocking out a frame of image data from a CCD image sensor, as is explained in U.S. patent application Ser. No. 09/766,922, entitled “Optical Reader Having Reduced Parameter Determination Delay,” previously incorporated herein by reference.
Optical reader 1110 of FIG. 7 a also includes programmable control circuit (or control module) 1140 which preferably comprises an integrated circuit microprocessor 1142 and an application specific integrated circuit (ASIC 1144). The function of ASIC 1144 could also be provided by a field programmable gate array (FPGA). Processor 1142 and ASIC 1144 are both programmable control devices which are able to receive, to output and to process data in accordance with a stored program stored in memory unit 1145 which may comprise such memory elements as a read/write random access memory or RAM 1146 and an erasable read only memory or EROM 1147. Other memory units that can be used include EPROMs and EEPROMs. RAM 1146 typically includes at least one volatile memory device but may include one or more long term non-volatile memory devices. Processor 1142 and ASIC 1144 are also both connected to a common bus 1148 through which program data and working data, including address data, may be received and transmitted in either direction to any circuitry that is also connected thereto. Processor 1142 and ASIC 1144 differ from one another, however, in how they are made and how they are used. The processing module that is configured to extract information encoded by the encoded indicium employs some or all of the capabilities of processor 1142 and ASIC 1144, and comprises the hardware and as necessary, software and or firmware, required to accomplish the extraction task, including as necessary decoding tasks to convert the raw data of the image to the information encoded in the encoded indicium.
More particularly, processor 1142 is preferably a general purpose, off-the-shelf VLSI integrated circuit microprocessor which has overall control of the circuitry of FIG. 7 a, but which devotes most of its time to decoding image data stored in RAM 1146 in accordance with program data stored in EROM 1147. Processor 1144, on the other hand, is preferably a special purpose VLSI integrated circuit, such as a programmable logic array or gate array that is programmed to devote its time to functions other than decoding image data, and thereby relieves processor 1142 from the burden of performing these functions.
The actual division of labor between processors 1142 and 1144 will naturally depend on the type of off-the-shelf microprocessors that are available, the type of image sensor which is used, the rate at which image data is output by imaging assembly 1130, etc. There is nothing in principle, however, that requires that any particular division of labor be made between processors 1142 and 1144, or even that such a division be made at all. This is because special purpose processor 1144 may be eliminated entirely if general purpose processor 1142 is fast enough and powerful enough to perform all of the functions contemplated by the present invention. It will, therefore, be understood that neither the number of processors used, nor the division of labor there between, is of any fundamental significance for purposes of the present invention.
With processor architectures of the type shown in FIG. 7 a, a typical division of labor between processors 1142 and 1144 will be as follows. Processor 1142 is preferably devoted primarily to such tasks as decoding image data, once such data has been stored in RAM 1146, recognizing characters represented in stored image data according to an optical character recognition (OCR) scheme, handling menuing options and reprogramming functions, processing commands and data received from control/data input unit 1139 which may comprise such elements as trigger 1174 (see FIG. 7 f) and keyboard 1178 (see FIG. 7 g) and providing overall system level coordination.
Processor 1144 is preferably devoted primarily to controlling the image acquisition process, the A/D conversion process and the storage of image data, including the ability to access memories 1146 and 1147 via a DMA channel. The A/D conversion process can include converting analog signals to digital signals represented as 8-bit (or gray scale) quantities. As A/D converter technology improves, digital signals may be represented using more that 8 bits. Processor 1144 may also perform many timing and communication operations. Processor 1144 may, for example, control the illumination of LEDs 1122, the timing of image sensor 1132 and an analog-to-digital (A/D) converter 1136, the transmission and reception of data to and from a processor external to reader 1110, through an RS-232, a network such as an Ethernet or other packet-based communication technology, a serial bus such as USB, and/or a wireless communication link (or other) compatible I/O interface 1137. Processor 1144 may also control the outputting of user perceptible data via an output device 1138, such as a beeper, a good read LED and/or a display monitor which may be provided by a liquid crystal display such as display 1182 (see FIGS. 7 e and 7 g). Control of output, display and I/O functions may also be shared between processors 1142 and 1144, as suggested by bus driver I/O and output/display devices 1137″ and 1138′ or may be duplicated, as suggested by microprocessor serial I/O ports 1142A and 1142B and I/O and display devices 1137′ and 1138′. As explained earlier, the specifics of this division of labor is of no significance to the present invention.
Some or all of the above optical and electronic components may be incorporated in an imaging module as are described in commonly assigned U.S. patent application Ser. No. 09/411,936, incorporated herein by reference in its entirety. An imaging module 2110 as described in the incorporated by reference U.S. patent application Ser. No. 09/411,936 application is shown in FIG. 11. A representation of a preferred illumination pattern projected by the illumination system of module 1210 is shown in FIG. 12. In FIG. 12, area 1272 represents the region of a target area T illuminated by illumination LEDs of the module, while area 1274 represents the region of a target area highlighted by the module's aiming LEDs and their associated optics. It is seen that the aiming LEDs of the module and their associated optics preferably project a solitary horizontal line onto a target area. LEDs of imaging module 2110 can be substituted for by such light sources as laser diodes, filament based lamps, other solid state light sources, and fiber optic illumination devices.
FIGS. 7 b–7 g show examples of types of housings in which the 2D imager of the present invention may be incorporated. FIGS. 7 b–7 g show 1D/2D optical readers 1110-1, 1110-2 and 1110-3. Housing 1112 of each of the optical readers 1110-1 through 1110-3 is adapted to be graspable by a human hand and has incorporated therein at least one trigger switch 1174 for activating image capture and decoding and/or image capture and character recognition operations. Readers 1110-1 and 1110-2 include hard-wired communication links 1179 for communication with external devices such as other data collection devices or a host processor, while reader 1110-3 includes an antenna 1180 for providing wireless communication to an external device or a host processor.
In addition to the above elements, readers 1110-2 and 1110-3 each include a display 1182 for displaying information to a user and a keyboard 1178 for enabling a user to input commands and data into the reader. Control circuit 1140 may cause a graphical user interface (GUI) to be displayed on display 1182. A pointer on the GUI may be moved by an actuator or actuators protruding from housing 1112.
Any one of the readers described with reference to FIGS. 7 b–7 g may be mounted in a stationary position as is illustrated in FIG. 7 h showing a generic optical reader 1110 docked in a scan stand 1190. Scan stand 1190 adapts portable optical reader 1110 for presentation mode scanning. In a presentation mode, reader 1110 is held in a stationary position and an indicium-bearing article is moved across the field of view of reader 1110. By comparison, in a hand-held mode, the reader 1110 is manually positioned so that the 2D imager can view an encoded indicium within a target area of the reader.
As will become clear from the ensuing description, the invention need not be incorporated in a portable optical reader. The invention may also be incorporated, for example, in association with a control circuit for controlling a non-portable fixed mount imaging assembly that captures image data representing image information formed on articles transported by an assembly line, or manually transported across a checkout counter at a retail point-of-sale location. Further, in portable embodiments of the invention, the reader need not be hand held. The reader may part or wholly hand worn, finger worn, waist worn or head worn for example.
Referring again to particular aspects of the invention, control circuit 140 in the example of FIG. 6 a executes a partial frame capture mode in order to clock out and capture pixel data illustrated by valid zone 1012-1. Reading the pixel values of valid zone 1012-1 is effective to decode 1D symbol 1016-1 in the reader's full field of view. Given that clocking out and capturing image data of valid zone 1012-1 consumes less time than clocking out and capturing a full frame of image data, it is seen that execution of a partial frame capture mode decreases the decode time of the reader. In prior art 2D optical readers, electrical signals corresponding to full frame 1010 are clocked out in order to decode a single 1D symbol 1016-1. The pixels of valid zone 1012-1 may comprise a single row of pixels (a scan line) or a plurality of rows.
In the example of FIG. 6 b, control circuit 1140 executes a partial frame capture mode in order to capture data defining valid zones 1012-2, 1012-3 and 1012-4 of a full frame of image data corresponding to a full field of view of a 2D image sensor. Valid zones 1012-2, 1012-3 and 1012-4 are line patterns of image data at various angular orientations. Reading of pixels of linear valid zones arranged at various angular orientations is effective to decode a 1 D symbol which may be located at an oblique angle in a field of view. It is seen that reading of pixels of linear valid zone 1012-3 will result in the successful decoding of 1D bar code symbol 1016-2. Zones 1012-2, 1012-3 and 1012-4 may be one or more pixels wide.
In the example of FIG. 6 c, control circuit 1140 executes a partial frame capture mode in order to clock out and capture image data defining valid zones 1012-5 through 1012-9. Valid zones 1012-5 to 1012-9 form a plurality of horizontal parallel lines. The pattern of valid zones shown in FIG. 6 c clocked out and captured in a partial frame capture mode is effective for decoding substantially horizontally oriented 1D symbols which are at an unknown height in a full field of view. It is seen that the reading of image data of valid zone 1012-8 will not result in the decoding of symbol 1016-3 because symbol 1016-3 is not a 1 D symbol. Nevertheless, because valid zone 1012-8 intersects symbol bullseye 1016 b, reading of an image data of valid zone 1012-8 may be effective to determine that a 2D symbol is likely present in the full field of view of image sensor 1132. In one aspect of the invention, reader 1110 may be configured to switch out of a partial frame capture mode and into a full frame capture mode when reading of image data captured in the partial frame capture mode reveals that a 2D symbol is likely to be represented in the image data corresponding to the image sensor's full field of view.
The states of operation of reader 1110 operating in accordance with the invention are normally selected by actuating appropriate buttons of keyboard 1178, or control of a GUI, or by the reading of menuing symbols, as are explained in commonly assigned U.S. Pat. No. 5,929,418 incorporated herein by reference. In alternative embodiments, software can be used to control which states of operation will be active at different times. For example, it is possible to program a computer to begin operation of the reader device in a default state, such as a partial frame capture mode of the 2D image sensor. It is possible to write computer code that will switch the operation to a second partial frame imaging mode if a sensor module senses the presence of one or more finder patterns. It is possible to write computer code that will switch the operation to a full frame imaging mode if an analysis module reveals the presence of a 2D encoded indicium.
It should be apparent that several operating states of the invention are possible. In a first operating state, reader 1110 is made to operate only in a partial frame capture mode until the time the first operating state is deactivated.
In a second operating state, as is alluded to in the example of FIG. 6 c, the reader operates in a partial frame capture mode until the time that reading of image data captured in the partial frame capture mode reveals that a 2D symbol is likely to be included in the full frame field of view of image sensor 1132. The revelation that a 2D symbol is likely to be included in the full frame field of view of image sensor 1132 is accomplished using an analysis module that analyses the features of the partial frame of image data. When reading of the partial frame of image data reveals that a 2D symbol is likely to be included in a full frame field of view, control circuit 1140 captures at least one full frame of image data from sensor 1132 and attempts to decode for the 2D symbol determined likely to be represented in the full frame of image data. A reader operating in the second operating state may also be made to switch to a full frame operating mode on the condition that a symbol is not successfully decoding during operation of the reader in the partial frame operating mode.
A third operating state of a reader operating in accordance with the invention is described with reference to FIGS. 6 d and 6 e. Operating in accordance with a third operating state, a reader operates in a partial frame capture mode to clock out and capture image data of valid zone 1012-10 which corresponds to a predetermined pattern and position in field of view 10. It is seen that reading of image data of zone 1012-10 will not be effective to decode symbol 1016-4 because symbol 1016-4 is of a type of 2D symbol known as a stacked linear bar code. Control circuit 1140 may nevertheless detect that symbol is a 2D symbol given that valid zone 1012-10 intersects a finder pattern 1016 f of symbol 1016-4. Sensing with a sensing module that a 2D symbol is likely present in the field of view when reading the partial frame image data corresponding to valid zone 1012-10, the reader operating in the third operating state then continues to operate in a partial frame mode to clock out and capture image data that defines a second valid zone 1012-11 of pixel positions as seen in FIG. 6 e. The second valid zone 1012-11 is not of a predetermined size and position, but rather is of an adaptive position whose position, and possibly size, orientation and shape depends on the result of the reading of the image data corresponding to the first valid zone 1012-10. Specifically, the second valid zone 1012-11 is normally at least of a size and position that is likely to encompass the symbol 1016-4 detected to be present when reading of the image data of first valid zone 1012-10. It is seen that the third operating state is likely to be operative to further reduce the clocking out and capture of irrelevant image data, and therefore is likely to further increase decoding speed. In the third operating state, additional adaptive position valid zones may be clocked out and captured if the reading of image data of first adaptive valid zone 1012-11 does not result in a symbol being decoded.
In the example of FIGS. 6 f and 6 g valid zones 1012-12 and 1012-13 correspond to nonlinear groupings of pixels. Capturing of the valid zone patterns 1012-12 and 1012-13 of FIGS. 6 f and 6 g is particularly useful for decoding symbol image data in the case that a symbol is likely to be at a certain position in relation to an image sensor's full frame field of view such as in the center of an image sensor's field of view as shown in FIG. 6 f.
In the example of FIG. 6 f control circuit 1140 can successfully decode symbol 1016-6 because symbol 1016-6 is located entirely within valid zone 1012-12.
In the example of FIG. 6 g, control circuit 1140 cannot decode symbol 1016-7 if operating in the first operating state since symbol 1016-7 is a 2D symbol and is not entirely located within valid zone 1012-13. If operating in the second operating state, then a reader capturing image data within valid zone 1012-13 may successfully decode symbol 1016-7 by reading the image data of zone 1012-13 to determine that a 2D symbol is present, switching operation to a full frame capture mode to capture a full frame 1010 of image data, and processing the full frame of image data to decode symbol 1016-7. A reader operating in the third operating state described hereinabove may decode symbol 1016-7, in the example of FIG. 6 g, by reading image data within valid zone 1012-13, capturing image data within an adaptively defined valid zone (not shown) of sufficient size and position to encompass symbol 1016-7, and then processing the image data within the adaptively defined valid zone to decode symbol 1016-7.
FIG. 8 is a flow diagram 1300 showing an illustrative process in which a partial frame of an image of an encoded indicium is processed to extract encoded information. The process begins as indicated in the oval 1310 labeled “START.” The reader images an encoded indicium using the 2D image sensor operating in a partial frame mode, as indicated at box 1320. The control module causes a partial frame of the image to be captured or clocked out, as indicated at box 1330. The processing module processes the partial frame of image data to extract information encoded in the encoded indicium, as indicated at box 1340. The result of the processing by the processing module is examined to determine whether information has indeed been extracted, and a test is performed as indicated by diamond 1350. If the result of the test is positive, as indicated by the arrow labeled “YES,” the information is provided, as indicated by box 1360. The process is then completed, as indicated by oval 1370, labeled “END.” However, if the result of the test performed at step 1350 is negative, as indicated by the arrow labeled “NO,” the control module switches to a full frame mode of operation, as indicated at box 1355. The result of processing a full frame of the image is then provided at box 1360, and the process ends at oval 1370. The process 1300 can be repeated as many times as required to extract information from a plurality of encoded indicia.
FIG. 9 is another flow diagram 1400 showing an illustrative process in which a partial frame of an image of an encoded indicium is processed to extract encoded information. The process begins as indicated in the oval 1410 labeled “START.” The reader images an encoded indicium using the 2D image sensor operating in a first partial frame mode, as indicated at box 1420. The control module causes a first partial frame of the image to be captured or clocked out, as indicated at box 1430. The processing module processes the first partial frame of image data to extract information encoded in the encoded indicium, as indicated at box 1440. The result of the processing by the processing module is examined to determine whether information has indeed been extracted, and a test is performed as indicated by diamond 1450. If the result of the test is positive, as indicated by the arrow labeled “YES,” the information is provided, as indicated by box 1460. The process is then completed, as indicated by oval 1470, labeled “END.” However, if the result of the test performed at step 1450 is negative, as indicated by the arrow labeled “NO,” the control module switches to a second partial frame mode of operation, as indicated at box 1455. The second partial frame is not necessarily of a predetermined size and position, but rather is of an adaptive position whose position, and possibly size, orientation and shape depends on the result of the reading of the image data corresponding to the first partial frame. For example, the second partial frame may be determined by the sensor module, using such information as one or more finder patterns, or one or more characteristics of known symbologies that suggest or define a size, an orientation, and/or a shape of a likely region to use as the second partial frame. The result of processing the second partial frame of the image is then provided at box 1460, and the process ends at oval 1470. The process 1400 can be repeated as many times as required to extract information from a plurality of encoded indicia.
Yet another mode of operation is possible, in which the region that is examined is incrementally increased. In brief, in this operating mode, a first partial frame of image data is clocked out and analyzed. If the data provides information, the result is presented. However, if the first partial frame does not provide decoded information, the operation of the system can be switched to a second partial frame mode, and if that mode of operation also fails to provide information, the operation can be switched to a third mode, such a full frame operating mode. As many incrementally larger partial frames as appear useful can be successively clocked out and analyzed in an effort to search for decodable information. However, one must also consider as a limitation that if the total operating time to obtain and examine a succession of incrementally larger partial frames equals or exceeds the time required to clock out and analyze a full frame of data, there is no improvement in processing time to be gained. Accordingly, depending on partial frame clock out time, and depending on the processing speed of the analysis module, one or more sequences of incrementally increasing partial frame regions can be defined beyond which it is more efficient to simply examine the full frame of image data. An illustrative example is given in the flow chart depicted in FIG. 10, in which a second partial frame mode is used before the full frame mode is activated.
FIG. 10 is another flow diagram 1500 showing an illustrative process in which a partial frame of an image of an encoded indicium is processed to extract encoded information. The process begins as indicated in the oval 1510 labeled “START.” The reader images an encoded indicium using the 2D image sensor operating in a first partial frame mode, as indicated at box 1520. The control module causes a first partial frame of the image to be captured or clocked out, as indicated at box 1530. The processing module processes the first partial frame of image data to extract information encoded in the encoded indicium, as indicated at box 1540. The result of the processing by the processing module is examined to determine whether information has indeed been extracted, and a test is performed as indicated by diamond 1550. If the result of the test is positive, as indicated by the arrow labeled “YES,” the information is provided, as indicated by the path of arrows labeled “YES” from diamond 1555 through diamond 1560 to box 1570, labeled “PROVIDE INFORMATION.” The process is then completed, as indicated by oval 1580, labeled “END.” However, if the result of the test performed at step 1550 is negative, as indicated by the arrow labeled “NO,” the control module switches to a second partial frame mode of operation, as indicated at box 1555. The second partial frame is not necessarily of a predetermined size and position, but rather is of an adaptive position whose position, and possibly size, orientation and shape depends on the result of the reading of the image data corresponding to the first partial frame. For example, the second partial frame may be determined by the sensor module, using such information as one or more finder patterns, or one or more characteristics of known symbologies that suggest or define a size, an orientation, and/or a shape of a likely region to use as the second partial frame. In the second partial frame mode, additional information corresponding to the additional pixels that are to be interrogated is clocked out and the resulting partial frame of image data is analyzed. A test of the result of processing the second partial frame of the image is performed at diamond 1560, labeled “INFORMATION EXTRACTED?” If the result of the test is positive, as indicated by the arrow labeled “YES,” the information is provided, as indicated by box 1570. The process is then completed, as indicated by oval 1580, labeled “END.” However, if the result of the test performed at step 1560 is negative, as indicated by the arrow labeled “NO,” the control module switches to a full frame mode of operation, as indicated at box 1565. The result of processing a full frame of the image is then provided at box 1570, and the process ends at oval 1580. The process 1500 can be repeated as many times as required to extract information from a plurality of encoded indicia.
Those of ordinary skill will recognize that many functions of electrical and electronic apparatus can be implemented in hardware (for example, hard-wired logic), in software (for example, logic encoded in a program operating on a general purpose processor), and in firmware (for example, logic encoded in a non-volatile memory that is invoked for operation on a processor as required). The present invention contemplates the substitution of one implementation of hardware, firmware and software for another implementation of the equivalent functionality using a different one of hardware, firmware and software. To the extent that an implementation can be represented mathematically by a transfer function, that is, a specified response is generated at an output terminal for a specific excitation applied to an input terminal of a “black box” exhibiting the transfer function, any implementation of the transfer function, including any combination of hardware, firmware and software implementations of portions or segments of the transfer function, is contemplated herein.
According to its major aspects and broadly stated, the present invention relates to a method and apparatus for controlling an optical reader to reduce the reader's parameter determination delay. According to the invention, in one embodiment an image sensor is adapted to clock out image data from an image sensor according to two modes of operation, a “low resolution” clock out mode of operation and a “normal resolution” clock out mode of operation.
In a low resolution mode, some pixels of the reader's image sensor pixel array can be clocked out at a normal clock out speed sufficient to develop electrical signals that accurately represent the intensity of light incident on the pixel array, while other pixels of the array are either not clocked out or are clocked out at a higher clock out rate which is insufficient to allow development of electrical signals that accurately represent the intensity of light at the respective pixels but which nevertheless, result in an increase in the overall frame clock out rate of the frame of image data. In a normal resolution mode of operation the image sensor can be caused to clock out electrical signals corresponding to each pixel of the array at a constant “normal mode” speed which is a speed sufficient to ensure that the electrical signal corresponding to each pixel accurately represents the intensity of light incident on the pixel.
An optical reader according to the invention, in one embodiment operates an image sensor in a low resolution mode of operation in order to clock out and capture a parameter-determining frame of image data at high speed, reads pixel data from the parameter determination frame to determine an operation parameter based on actual illumination conditions, then utilizes the operation parameter in operating an image sensor according to high resolution mode in the clocking out of a succeeding frame of image data that is captured and subjected to comprehensive image data processing which may include image data searching, decoding, and/or recognition processing. Clocking out some of the pixels of an array at high speed during execution of the low resolution mode significantly decreases the reader's parameter determination delay.
While the present invention has been explained with reference to the structure disclosed herein, it is not confined to the details set forth and this invention is intended to cover any modifications and changes as may come within the spirit and scope of the following claims.
US3684888 Apr 20, 1970 Aug 15, 1972 Nuklearmerstechnik Und Ind Ele Device for measuring the cross-section of wire and the like
US5512739 * Mar 15, 1995 Apr 30, 1996 Omniplanar, Inc. Dual processor omnidirectional bar code reader with dual memory for bar code location and orientation
US6385352 * Oct 26, 1994 May 7, 2002 Symbol Technologies, Inc. System and method for reading and comparing two-dimensional images
1 "Device Performance Specification-Kodak KAC-9630 CMOS Image Sensor," Sep. 2004, revision 1.1. Http://www.kodak.com/global/plugins/acrobat/en/digital/ccd/products/cmos/KAC-9630LongSpec.pdf. pp. 1-22.
2 "Dual Slope Dynamic Range Expansion" from FillFactory NV, Schaliënhoevedreef 20B, B-2800 Mechelen, Belgium. Http://www.fillfactory.com/htm/technology/htm/dual-slope.htm, pp. 1-2, 2000.
3 "Full Specification" Revision 1 dated Aug. 5, 2002. http://www.kodak.com/global/plugins/acrobat/en/digital/ccd/products/cmos/KAC-0311LongSpec.pdf. pp. 1-56.
4 "LinLog Technology" from Photonfocus AG, Bahnhofplatz 10, CH-8853 Lachen, Switzerland. Http://www.photonfocus.com/html/eng/cmos/linlog.php. pp. 1-5, 2003.
5 A CompactFlash interface is an interface designed in accordance with the CompactFlash standard as described in the CompactFlash Specification version 2.0 maintained at the website http://www.compactflash.org. pp. 1-2, 2003.
6 Auto focus systems and algorithms are described in more detail on the webpage maintained at the address http://www.cs.mtu.edu/~shene/DigiCam/User-Guide/5700/AUTO-FOCUS/Auto-Focus.html. pp. 1-4, 2004.
7 Claims 1-4 as of Mar. 6, 2006, Application No. 02 723 063.0, Publication No. EP1354291 A2, Puublication date Oct. 22, 2003.
8 Claims 1-40 of U.S. Appl. No. 11/238,176, Bar Code Reading Device Having Partial Frame Image Capture Operating Mode, filed Sep. 28, 2005.
9 El Gamal, Professor A., Lecture Notes 1, 2, 4, 5, 6, 7, 10 and Handout #3 and #28, "Image Sensors and Digital Cameras" for EE 392B, Spring 2001.
10 EP Application No. 02723063.0-2210, Summons To Attend Oral Proceeding dated Jul. 1, 2005, received from Foreign Associate Jul. 5, 2005.
11 European Patent Office, Office Action dated Feb. 14, 2006, Application No. 02 723 063.0, Publication No. EP1354291 A2, Publication date Oct. 22, 2003, 9 pages.
12 European Search Report for European Patent Application No. 06 015 349.1 dated Sep. 26, 2006 (6 pgs.).
13 Fossum, Eric R., CMOS Active Pixel Image Sensors, Nuclear Instruments and Methods in Physics Research A 395 (1997) 291-297.
14 Jakl, Edward A., "Why CMOS Image Sensors are Poised to Surpass CCDs," International IC '99, Conference Proceedings, pp. 64-71.
15 Marshall Electronics, Optical Systems Division, Monochrome Monolithic Image Sensor With Analogue and Digital Outputs VVL1070 Specification, Believed to be published in 1994, pp. 1-24.
16 Micron's Wide VGA MT9V022 image sensor from Micron Technology, Inc., 8000 South Federal Way, Post Office Box 6, Boise, ID 83707-0006. http://download.micron.com/pdf/flyers/mt9v022<SUB>-</SUB>(mi-0350)<SUB>-</SUB>flyer.pdf. pp. 1-2, 2004.
17 New claims 66-77 of U.S. Appl. No. 10/801,937, Optical Reader Processing Two-Dimensional Electronic Representation, filed Mar. 16, 2004, Claims filed with Amendment dated Aug. 15, 2005.
18 PC Card Standard 8.0 Release-Apr. 2001 maintained by the Personal Computer Memory Card International Association (PCMCIA) and available through the website at http://www.pcmcia.org. pp. 1-2.
19 Sony Corporation, ICX084AL, Technical Specification, Believed to be published prior to Jan. 22, 2000.
20 Symbol Technologies, Inc., LS 4800 Series Product Reference Guide, May 1996, Holtsville, NY.
21 Tian, Hui et al., "Analysis of 1/f Noise in Switched MOSFET Circuits," Information Systems Laboratory, Electrical Engineering Department, Stanford University, Stanford, California 94305, 21 pp., Apr. 24, 2001.
22 VLSI Vision LTD., High Resolution EIA-CCIR Monochrome Monolithic Camera Specification, VVL-1060, Apr. 1994, pp. 1-23.
23 VLSI Vision LTD., Serial Interface Specification, VVL-1060, Apr. 1994, pp. 1-9.
24 VVL1070 Engineering Evaluation Kit Specification, Sep. 27, 1994, V1.1, pp. 1-5.
US8430300 Jun 19, 2007 Apr 30, 2013 Codebroker, Llc Using validity events to control the use of coupons containing barcodes in mobile devices that display the barcodes for reading by barcode readers
US8794520 * Sep 30, 2008 Aug 5, 2014 Hand Held Products, Inc. Method and apparatus for operating indicia reading terminal including parameter determination
US8842604 Sep 14, 2009 Sep 23, 2014 Qualcomm Incorporated Wireless communication systems with femto nodes
US9367725 * Nov 3, 2011 Jun 14, 2016 Cognex Corporation Method and apparatus for performing different decoding algorithms in different locations
US20070035615 * Dec 20, 2005 Feb 15, 2007 Hua-Chung Kung Method and apparatus for adjusting output images
US20070051812 * Aug 23, 2006 Mar 8, 2007 Intermec Ip Corp. Method and apparatus employing imaging and/or scanning for reading machine-readable symbols such as barcode symbols
US20100067443 * Sep 14, 2009 Mar 18, 2010 Qualcomm Incorporated Wireless communication systems with femto nodes
US20100067514 * Sep 14, 2009 Mar 18, 2010 Qualcomm Incorporated Wireless communication systems with femto nodes
US20100078477 * Sep 30, 2008 Apr 1, 2010 Hand Held Products, Inc. Method and apparatus for operating indicia reading terminal including parameter determination
US20160321490 * May 6, 2016 Nov 3, 2016 Cognex Corporation Method and apparatus for performing different decoding algorithms in different locations
DE102012110375B4 * Oct 30, 2012 Apr 27, 2017 Cognex Corp. Verfahren und Vorrichtung zum Dekodieren von auf Objekten aufgetragenen Codes für den Einsatz mit einem Bildsensor, der ein zweidimensionales Sichtfeld beinhaltet
WO2007127385A2 * Apr 27, 2007 Nov 8, 2007 Codebroker Llc Customizing barcode images for particular displays
WO2007127385A3 * Apr 27, 2007 Aug 21, 2008 Codebroker Llc Customizing barcode images for particular displays
U.S. Classification 235/462.25, 235/462.09
Cooperative Classification G06K7/1093, G06K7/1098, G06K7/10722
European Classification G06K7/10S9H, G06K7/10S9V, G06K7/10S4D
Free format text: CHANGE OF NAME;ASSIGNOR:WELCH ALLYN DATA COLLECTION, INC.;REEL/FRAME:020004/0425
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BARBER, CHARLES P.;GERST, CARL W., III;SMITH, GEORGE S.,II;AND OTHERS;REEL/FRAME:020004/0351;SIGNING DATES FROM 20010226 TO 20010306