Patent Description:
There has been a self-checkout terminal that enables self-checkout by a customer. In such a self-checkout terminal, for example, an example in which the self-checkout terminal is started if a customer is detected by an infrared sensor has been proposed.

However, since a new sensor needs to be set in the self-checkout terminal in the past, there have been problems such as securing of a setting space, an increase in the number of components, an increase in cost, and the like.

<CIT> relates to a self-checkout terminal including a reading unit and a light emitting unit. The reading unit reads commodity information from a commodity held over a reading position. The light emitting unit emits light in a first color to illuminate the reading position and emits light in a second color in response to the reading of the commodity information by the reading unit.

<CIT> relates to a reading device including an image capturing device, a light emitting device, and a processor. The processor controls the image capturing device to capture an image of an image capturing area. When the reading device is in a standby mode, the processor determines, based on the captured image, whether an object is in the image capturing area.

<CIT> relates to an information processing apparatus comprising an image capturing module configured to photograph an object held over an image capturing section; a first recognition module configured to compare a feature amount of the object photo-graphed by the image capturing module with a feature amount for collation of each of commodities pre-stored in a dictionary to obtain a similarity degree therebetween and recognize, from different commodities, a commodity matching with the object through the similarity degree; a display control module configured to display, on a first screen, a first input section corresponding to the commodity recognized by the first recognition module and a second input section corresponding to commodities in advance; an input module configured to receive the selection on the first or second input section displayed by the display control module; and a registration module configured to sales-register the commodity corresponding to the first or second input section received by the input module.

According to a first aspect of the present disclosure, it is provided an article information reading apparatus, comprising a reader configured to read, from an image captured by an imaging section, a code symbol attached to an article; a detector configured to detect a change in brightness from the image captured by the imaging section; and a reading controller configured to start operation of the reader on condition that the detector detects the change in the brightness.

Optionally, the apparatus according to the first aspect of the invention further comprises an illumination controller configured to control, based on an operation state of the reader and an operation state of the detector, brightness of an illuminating section that illuminates an imaging range of the imaging section.

Optionally, in the apparatus according to the first aspect of the invention, on condition that the reader does not read the code symbol for a first predetermined time, the reading controller ends operation of the reader, and the illumination controller changes an illumination state of the illuminating section from a first illumination state in which the illuminating section is emitting light at maximum brightness to a second illumination state in which the brightness of the illuminating section is reduced.

Optionally, in the apparatus according to the first aspect of the invention, the illuminating section comprises a light emitting diode.

Optionally, in the apparatus according to the first aspect of the invention, after changing the illumination state of the illuminating section to the second illumination state, the illumination controller changes, on condition that brightness of the image captured by the imaging section is a first predetermined value or more for a second predetermined time, the illumination state of the illuminating section to a third illumination state in which the illuminating section is extinguished.

Optionally, in the apparatus according to the first aspect of the invention, if the illumination state of the illuminating section is the second illumination state or the third illumination state, on condition that the detector detects a change in brightness from the image captured by the imaging section, the reading controller starts the operation of the reader, and the illumination controller changes the illumination state of the illuminating section to the first illumination state.

Optionally, in the apparatus according to the first aspect of the invention, if the illumination state of the illumination controller is the third illumination state, the illumination controller changes the illumination state of the illuminating section to the second illumination state on condition that the brightness of the image captured by the imaging section is smaller than a second predetermined value for a third predetermined time.

According to a second aspect of the present disclosure, it is comprised a self-checkout terminal, comprising a loading stand for accommodating articles; a payment processing section; and
an article information reading apparatus, comprising a reader configured to read, from an image captured by an imaging section, a code symbol attached to an article; a detector configured to detect a change in brightness from the image captured by the imaging section; and a reading controller configured to start operation of the reader on condition that the detector detects the change in the brightness.

Optionally, the self-checkout terminal according to the second aspect of the invention further comprises an illumination controller configured to control, based on an operation state of the reader and an operation state of the detector, brightness of an illuminating section that illuminates an imaging range of the imaging section.

Optionally, in the self-checkout terminal according to the second aspect of the invention, on condition that the reader does not read the code symbol for a first predetermined time, the reading controller ends operation of the reader, and the illumination controller changes an illumination state of the illuminating section from a first illumination state in which the illuminating section is emitting light at maximum brightness to a second illumination state in which the brightness of the illuminating section is reduced.

Optionally, in the self-checkout terminal according to the second aspect of the invention, the illuminating section comprises a light emitting diode.

Optionally, in the self-checkout terminal according to the second aspect of the invention, after changing the illumination state of the illuminating section to the second illumination state, the illumination controller changes, on condition that brightness of the image captured by the imaging section is a first predetermined value or more for a second predetermined time, the illumination state of the illuminating section to a third illumination state in which the illuminating section is extinguished.

Optionally, in the self-checkout terminal according to the second aspect of the invention, if the illumination state of the illuminating section is the second illumination state or the third illumination state, on condition that the detector detects a change in brightness from the image captured by the imaging section, the reading controller starts the operation of the reader, and the illumination controller changes the illumination state of the illuminating section to the first illumination state.

Optionally, in the self-checkout terminal according to the second aspect of the invention, if the illumination state of the illumination controller is the third illumination state, the illumination controller changes the illumination state of the illuminating section to the second illumination state on condition that the brightness of the image captured by the imaging section is smaller than a second predetermined value for a third predetermined time.

According to a third aspect of the present disclosure, it is provided an article information reading method, comprising reading, from an image captured by an imaging section, a code symbol attached to an article; detecting a change in brightness from the image captured by the imaging section; and starting reading on condition that the change in the brightness is detected.

Optionally, the method according to the third aspect of the invention further comprises controlling, based on an operation state of the reading and an operation state of the detecting, brightness of an illuminating section that illuminates an imaging range of the imaging section.

Optionally, the method according to the third aspect of the invention further comprises on condition that reading does not read the code symbol for a first predetermined time, ending the reading, and changing an illumination state of the illuminating section from a first illumination state in which the illuminating section is emitting light at maximum brightness to a second illumination state in which the brightness of the illuminating section is reduced.

Optionally, the method according to the third aspect of the invention further comprises after changing the illumination state to the second illumination state, changing, on condition that brightness of the image captured by the imaging section is a first predetermined value or more for a second predetermined time, the illumination state of the illuminating section to a third illumination state in which the illuminating section is extinguished.

Optionally, the method according to the third aspect of the invention further comprises if the illumination state of the illuminating section is the second illumination state or the third illumination state, on condition that a change in brightness from the image captured by the imaging section is detected, starting the reading, and changing the illumination state of the illuminating section to the first illumination state.

Optionally, the method according to the third aspect of the invention further comprises if the illumination state is the third illumination state, changing the illumination state of the illuminating section to the second illumination state on condition that the brightness of the image captured by the imaging section is smaller than a second predetermined value for a third predetermined time.

An embodiment provides an article information reading apparatus capable of implementing, without changing a hardware configuration of the self-checkout terminal in the past, a function of detecting approach of a customer.

An article information reading apparatus in an embodiment includes a reading section, a detecting section, and a reading control section. The reading section reads, from an image captured by an imaging section, a code symbol attached to an article. The detecting section detects a change in brightness from the image captured by the imaging section. The reading control section starts operation of the reading section on condition that the detecting section detects the change in the brightness. An article information reading method involves reading, from an image captured by an imaging section, a code symbol attached to an article; detecting a change in brightness from the image captured by the imaging section; and starting reading on condition that the change in the brightness is detected.

A self-POS terminal according to a first embodiment is explained below with reference to the drawings. This embodiment is an example in which an article information reading apparatus is applied to a self-POS terminal provided in a retail store such as a convenience store or a supermarket, a customer settling purchased commodities by himself or herself using the self-POS terminal. In the embodiment explained below, a commodity is an example of an article. The present invention is not limited by the embodiment explained below.

First, an overall configuration of the self-POS terminal is explained. <FIG> is a perspective view illustrating an example of an exterior of the self-POS terminal according to the embodiment. A self-POS terminal <NUM> is an apparatus with which a customer himself or herself acts as an operator and performs registration and accounting of commodities. The self-POS terminal <NUM> is called self-checkout apparatus as well.

The self-POS terminal <NUM> is a terminal for the customer to register, by himself or herself, commodities to be purchased and perform accounting. The self-POS terminal <NUM> includes a first loading stand <NUM> provided on the front right side, a second loading stand <NUM> provided on the front left side, and a first housing <NUM> provided in the front center.

The customer who uses the self-POS terminal <NUM> places, on the first loading stand <NUM>, a basket or the like including commodities to be purchased. The customer places, on the second loading table <NUM>, a bag in which registered commodities are put. The customer registers, using an apparatus placed on the first housing <NUM>, the commodities taken out from the basket. The customer puts the registered commodities in the bag placed on the second loading stand <NUM>. The customer performs the registration on the respective commodities collected in the basket. If the registration of the respective commodities is completed, the customer performs accounting processing of the registered commodities using an apparatus included in the first housing <NUM>. According to such a procedure, the customer performs registration processing and the accounting processing of the commodities to be purchased.

More in detail, the second loading stand <NUM> includes a pedestal <NUM>, a bag hanging hook <NUM>, and a temporary placing stand <NUM>. The bag hanging hook <NUM> and the temporary placing stand <NUM> are supported by a column <NUM> provided on the pedestal <NUM> and are provided above the pedestal <NUM>. The pedestal <NUM> is a stand on which a commodity or the like unsuitable to be put in a bag such as a commodity larger than the bag is placed. The bag handing hook <NUM> is a hook for hanging a bag in which registered commodities are put. The temporary placing stand <NUM> is a stand on which commodities requiring attention for packing such as fragile commodities are temporarily placed.

The first housing <NUM> includes, on the inside, a depositing and dispensing section <NUM> that executes depositing and dispensing of coins, bills, and the like. Further, the housing <NUM> includes a coin depositing port <NUM>, a coin dispensing port <NUM>, a bill depositing port <NUM>, and a bill dispensing port <NUM>. The coin depositing port <NUM> is a depositing port for coins deposited in the depositing and dispensing section <NUM> as a price of a commodity by the customer. The coin dispensing port <NUM> is a dispensing port for coins dispensed from the depositing and dispensing section <NUM> as change. The bill depositing port <NUM> is a depositing port for bills deposited in the depositing and dispensing section <NUM> as a price of a commodity by the customer. The bill dispensing port <NUM> is a dispensing port for bills dispensed from the depositing and dispensing section <NUM> as change. Balances (or quantities) of bills and coins stored by the depositing and dispensing section <NUM> are counted for each of denominations by a publicly-known technique.

The self-POS terminal <NUM> includes, on the upper surface of the first housing <NUM>, a second housing <NUM>, a display section <NUM>, a handy scanner <NUM>, a card reader writer <NUM>, and a warning lamp <NUM>.

The second housing <NUM> includes, on the inside, a scanner <NUM> (see <FIG>) and a receipt printer <NUM>. The scanner <NUM> reads a code symbol (for example, a barcode) given to a commodity held over a reading window <NUM>. The scanner <NUM> is an example of an article information reading apparatus. The structure and the function of the scanner <NUM> are explained in detail below.

The second housing <NUM> includes a receipt issue port <NUM> that discharges a receipt or the like output by the receipt printer <NUM>. The receipt printer <NUM> discharges, from the receipt issue port <NUM>, a receipt formed by printing sales information of commodities subjected to transaction processing on paper.

The second housing <NUM> supports the display section <NUM> provided above the second housing <NUM>. The display section <NUM> is, for example, a liquid crystal display. The display section <NUM> displays, for example, commodity information of registered commodities. Further, the display section <NUM> displays a guidance screen for informing the customer of an operation method of the self-POS terminal <NUM>, a total amount of commodities, a deposit amount, a change amount, and the like and displays, for example, a settlement screen for selecting a payment method.

The display section <NUM> includes a touch panel <NUM> for operating the self-POS terminal <NUM>. The touch panel <NUM> detects a part operated (touched) on the display section <NUM> and determines that an operation request corresponding to display content displayed in the part where the display section <NUM> is operated is performed.

The handy scanner <NUM> is a hand-held scanner. The handy scanner <NUM> is used if it may be difficult to hold a barcode or the like attached to a commodity over the reading window <NUM> of the scanner <NUM>, for example, if the commodity is heavy or the commodity is large.

The card reader writer <NUM> executes reading and writing of information concerning electronic settlement from and in a storage medium such as a card medium used for the electronic settlement such as a credit card or an electronic money.

The warning lamp <NUM> flashes in, for example, red to thereby notify a store clerk that an abnormality occurs in the self-POS terminal <NUM>. The warning lamp <NUM> notifies the store clerk that the customer operates the self-POS terminal <NUM> by mistake.

The structure of the scanner <NUM> is explained with reference to <FIG> is an example of an exterior view and a sectional view of the scanner <NUM> incorporated in the self-POS terminal <NUM>. For explanation, a coordinate system xyz illustrated in <FIG> is set. As illustrated in <FIG>, the scanner <NUM> is used in a state in which the scanner <NUM> is embedded in the second housing <NUM>.

As illustrated in <FIG>, the scanner <NUM> has a substantially rectangular parallelepiped shape formed by locking a front cover <NUM> and a rear cover <NUM>. The reading window <NUM> is set in an opening section 1a on the front surface of the front cover <NUM>. The customer holds a commodity over the reading window <NUM> to thereby cause the scanner <NUM> to read a code symbol attached to the commodity.

A light emitting section <NUM>, an LED (Light Emitting Diode) for notification <NUM>, a camera <NUM>, a mirror <NUM>, an LED for illumination <NUM>, and a diffusion plate <NUM> illustrated in <FIG> are set on the inside of the reading window <NUM> (the opening section 1a). <FIG> is an xz sectional view of the scanner <NUM>.

The light emitting section <NUM> notifies an operation state of the scanner <NUM> to the customer using a light emission pattern (a light emission color or a lighting state) of the LED for notification <NUM>.

The camera <NUM> includes an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) and an optical system such as a lens. The camera <NUM> images a region on the inner side of an imaging range Q through the reading window <NUM>. The camera <NUM> is an example of an imaging section.

The mirror <NUM> changes an imaging direction of the camera <NUM> to the direction of the reading window <NUM>.

The LED for illumination <NUM> irradiates illumination light on the imaging range Q. The LED for illumination <NUM> is configured by, for example, a white LED. The LED for illumination <NUM> is an example of an illuminating section. As illustrated in <FIG>, a plurality of LEDs for illumination <NUM> are set. However, the number of the LEDs for illumination <NUM> is determined as appropriate based on an output and a radiation angle, breadth of the imaging range Q, and the like of an LED in use.

The diffusion plate <NUM> diffuses the illumination light radiated by the LED for illumination <NUM>. Consequently, since diffused light is irradiated on the imaging range Q, luminance unevenness of the illumination light is reduced and uniform illumination can be performed. A shadow of an object is eased. This contributes to acquisition of an image that is easily recognized.

Hardware of the self-POS terminal <NUM> is explained. <FIG> is a hardware block diagram illustrating an example of a hardware configuration of the self-POS terminal <NUM>. The self-POS terminal <NUM> includes a control section <NUM>, a storing section <NUM>, an input and output controller <NUM>, and a communication I/F (Interface) <NUM>.

The control section <NUM> includes a CPU (Central Processing Unit) <NUM>, a ROM (Read Only Memory) <NUM>, and a RAM (Random Access Memory) <NUM>. The CPU <NUM> is connected to the ROM <NUM> and the RAM <NUM> via a bus line <NUM>. The CPU <NUM> develops, in the RAM <NUM>, a control program P1 stored in the ROM <NUM> or the storing section <NUM>. The CPU <NUM> operates according to the control program P1 developed in the RAM <NUM> to control the operation of the self-POS terminal <NUM>. That is, the control section <NUM> has the configuration of a general computer.

The control section <NUM> is connected to the storing section <NUM>, the input and output controller <NUM>, and the communication I/F <NUM> via the bus line <NUM>.

The storing section <NUM> is a nonvolatile memory such as a flash memory in which stored information is retained even if a self-POS terminal <NUM> is turned off, a HDD (Hard Disk Drive), or the like. The control section <NUM> stores, for example, programs including the control program P1. The control program P1 is a program for causing the self-POS terminal <NUM> to exert functions of the self-POS terminal <NUM>.

The control program P1 may be provided while being incorporated in the ROM <NUM> in advance. The control program P1 may be provided while being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disc) as a file of a form installable in the control section <NUM> or an executable form. Further, the control program P1 may be provided by being stored on a computer connected to a network such as the Internet and downloaded through the network. The control program P1 may be provided or distributed through a network such as the Internet.

The storing section <NUM> stores a PLU (Price Look-Up) file F1, a commodity registration file F2, and a sales file F3. The PLU file F1 is a master file in which commodity information (commodity codes, commodity names, prices, and the like) of commodities sold in the store is stored. Since the commodities sold in the store change every day, the self-POS terminal <NUM> acquires the latest PLU file F1 from a not-illustrated store server using the communication I/F <NUM>.

The commodity registration file F2 is a file in which commodity information (commodity names, prices, and the like) of commodities purchased by the customer acquired from the PLU file F1 is stored based on commodity registration operation by the customer.

The input and output controller <NUM> is connected to the scanner <NUM> (the camera <NUM>, the LED for illumination <NUM>, and the LED for notification <NUM>), the depositing and dispensing section <NUM>, the display section <NUM>, the touch panel <NUM>, the handy scanner <NUM>, the card reader writer <NUM>, the warning lamp <NUM>, and the receipt printer <NUM> illustrated in <FIG>. The input and output controller <NUM> controls, based on a command from the control section <NUM>, the operation of the various kinds of hardware connected to the input and output controller <NUM>. Explanation of the functions of the respective kinds of hardware is omitted because the functions are explained above.

The communication I/F <NUM> mutually performs communication with the store server, an attendant terminal, and the like not illustrated in the figures. The attendant terminal is a terminal that manages operation states and the like of a plurality of self-POS terminals <NUM> provided in the store.

A functional configuration of the self-POS terminal <NUM> is explained with reference to <FIG> is a functional block diagram illustrating an example of the functional configuration of the self-POS terminal <NUM>. The control section <NUM> of the self-POS terminal <NUM> develops the control program P1 in the RAM <NUM> and operates the control program P1 to thereby realize, as functional sections, an imaging control section <NUM>, an illumination control section <NUM>, a code-symbol reading section <NUM>, a customer detecting section <NUM>, a reading control section <NUM>, a clocking section <NUM>, a commodity registering section <NUM>, an accounting processing section <NUM>, an operation control section <NUM>, and a display control section <NUM>.

The imaging control section <NUM> controls the operation of the camera <NUM> to thereby cause the camera <NUM> to image the outside of the self-POS terminal <NUM> through the reading window <NUM>. The imaging control section <NUM> acquires an image captured by the camera <NUM>.

The illumination control section <NUM> controls, based on an operation state of the code-symbol reading section <NUM> and an operation state of the customer detecting section <NUM>, brightness of the LED for illumination <NUM> (illuminating section) that illuminates an imaging range of the camera <NUM>. The illumination control section <NUM> is an example of an illumination control section.

Specifically, the illumination control section <NUM> changes, on condition that the code-symbol reading section <NUM> does not read a code symbol for a first predetermined time, an illumination state of the LED for illumination <NUM> from a first illumination state in which the LED for illumination <NUM> is emitting light at the maximum brightness to a second illumination state in which brightness of the LED for illumination <NUM> is reduced.

After changing the illumination state of the LED for illumination <NUM> to the second illumination state, the illumination control section <NUM> changes, on condition that brightness of the image captured by the camera <NUM> is equal to or larger than a first predetermined value for a second predetermined time, the illumination state of the LED for illumination <NUM> to a third illumination state in which the LED for illumination <NUM> is extinguished.

If the illumination state of the LED for illumination <NUM> is the second illumination state or the third illumination state, the illumination control section <NUM> changes the illumination state of the LED for illumination <NUM> to the first illumination state on condition that the customer detecting section <NUM> detects a change in the brightness from the image captured by the camera <NUM>.

If the illumination state of the LED for illumination <NUM> is the third illumination state, the illumination control section <NUM> changes the illumination state of the LED for illumination <NUM> to the second illumination state on condition that the brightness of the image captured by the camera <NUM> is smaller than the second predetermined value for a third predetermined time. A function of the illumination control section <NUM> is explained in detail below (<FIG>).

The code-symbol reading section <NUM> reads a code symbol attached to the commodity from the image captured by the camera <NUM>. The code-symbol reading section <NUM> is an example of a reading section.

The customer detecting section <NUM> detects a change in the brightness from the image captured by the camera <NUM>. By detecting the change in the brightness, the customer detecting section <NUM> performs customer detection processing for detecting a customer approaching the self-POS terminal <NUM>. The customer detecting section <NUM> calculates average brightness of the image captured by the camera <NUM>, that is, an average of pixel values of all pixels. The customer detecting section <NUM> is an example of a detecting section. A function of the customer detecting section <NUM> is explained in detail below (<FIG>).

The reading control section <NUM> starts the operation of the code-symbol reading section <NUM> on condition that the customer detecting section <NUM> detects a change in the brightness. The reading control section <NUM> ends the operation of the code-symbol reading section <NUM> on condition that the code-symbol reading section <NUM> does not read the code symbol for the first predetermined time. The reading control section <NUM> is an example of a reading control section.

In order to control the operation of the illumination control section <NUM>, the clocking section <NUM> clocks elapsed times after occurrence of various events such as execution of imaging by the camera <NUM> and calculation of average brightness of an image. The clocking by the clocking section <NUM> is explained in detail below (<FIG>).

The commodity registering section <NUM> reads out commodity information from the PLU file F1 based on the code symbol read by the code-symbol reading section <NUM> and executes commodity registration processing for registering the read-out commodity information in the commodity registration file F2.

The accounting processing section <NUM> performs accounting processing based on content registered in the commodity registration file F2. Specifically, for example, if settlement is performed by cash, the accounting processing section <NUM> dispenses, if there is change, the change based on an amount of money (bills and coins) deposited by the customer and a total amount of commodities and issues, from the receipt printer <NUM>, a receipt on which commodity information and settlement information (a total amount, a deposit amount, a change amount, and the like) of commodities subjected to the commodity registration processing are printed.

The operation control section <NUM> detects operation of the self-POS terminal <NUM> by the customer.

The display control section <NUM> displays, on the display section <NUM> or the like, information corresponding to an operation state of the self-POS terminal <NUM>.

The customer detection processing performed by the customer detecting section <NUM> is explained with reference to <FIG> is a diagram for explaining the customer detection processing.

<FIG> illustrates an example of an image I1 captured by the camera <NUM> at time t=t0 if a customer C is present in a position far from the self-POS terminal <NUM>. The image I1 captured at this time indicates a distribution of brightness of a region on the inner side of an imaging range Q including the customer C.

A main use of the camera <NUM> incorporated in the scanner <NUM> is to read a code symbol of a commodity held over the reading window <NUM>. Therefore, a focus position of the camera <NUM> is adjusted to a position near the reading window <NUM>. Therefore, if an image including the customer C present in a position far apart from the reading window <NUM> is captured, the captured image I1 is blurred. That is, a contour of the customer C, that is, a human shape cannot be recognized in the image I1. However, since, in general, a contrast difference is present between a background and the customer C, the image I1 is an image visualizing a contract difference between a region indicating the background and a region indicating the customer C.

In order to realize efficiency of image processing, the customer detecting section <NUM> divides an image captured by the camera <NUM> into a plurality of blocks. The image I1 illustrated in <FIG> is an example in which an image captured by the camera <NUM> is divided into longitudinal and lateral <NUM>×<NUM> blocks.

The customer detecting section <NUM> calculates an average of pixel values (brightness) of a plurality of pixels belonging to each of the divided blocks and sets the average as a pixel value (brightness) of the pertinent block. Consequently, in the image I1, it is possible to visualize a difference in brightness between a region Ra1 corresponding to the background and a region Rb1 corresponding to the customer C, although a shape indicating the customer C cannot be recognized.

<FIG> illustrates an example of an image I2 captured by the camera <NUM> at time t=t0+Δt. Information stored in the image I2 is the same as the image I1 explained above. At this time, it is assumed that the customer C moves toward the camera <NUM>, that is, the self-POS terminal <NUM>.

Since the region having the difference in brightness between the customer C and the background moves according to the movement of the customer C, a region Ra2 corresponding to the background and a region Rb2 corresponding to the customer C included in the image I2 are regions different in shapes and brightness from the region Ra1 corresponding to the background and the region Rb1 corresponding to the customer C included in the image I1.

<FIG> is an example of a differential image I3 indicating a result obtained by deducting the image I2 from the image I1 (I1-I2). The differential image I3 is a binary image obtained by binarizing a differential result with a predetermined threshold Th. That is, in the differential image I3, "<NUM>" is stored in a block of |I2-I1|>Th. On the other hand, in the differential image I3, "<NUM>" is stored in a block of |I2-I1|≤Th.

The customer detecting section <NUM> detects that a change in brightness occurs if there are a predetermined number or more of blocks in which "<NUM>" is stored in the differential image I3. The customer detecting section <NUM> determines that the customer C is approaching the self-POS terminal <NUM>.

The customer detecting section <NUM> repeatedly executes the series of processing explained above to thereby generate the differential image I3 at a time interval of Δt. The customer detecting section <NUM> determines, at the time interval of Δt, whether the customer C is approaching the self-POS terminal <NUM>.

The customer detecting section <NUM> may calculate an apparent movement vector (an optical flow) from the region Rb1 in the image I1 and the region Rb2 in the image I2 and determine whether the region where the brightness changes is moving in a direction approaching the scanner <NUM>. By performing such processing, it is possible to more accurately detect the approach of the customer C.

Transition of an operation state of the scanner <NUM> is explained with reference to <FIG> is a state transition diagram illustrating an example the transition of the operation state of the scanner <NUM>.

A state in which the code-symbol reading section <NUM> of the scanner <NUM> is reading a code symbol is represented as a state M1. In the state M1, the customer detecting section <NUM> stops the customer detection processing. In the state M1, the illumination control section <NUM> lights the LED for illumination <NUM> at the maximum brightness (maximizes a forward direction current If of the LED for illumination <NUM>). This state is a first illumination state.

In the state M1, if the code-symbol reading section <NUM> reads a code symbol, the scanner <NUM> retains the state M1 (Arc A1).

On the other hand, in the state M1, if the code-symbol reading section <NUM> does not read a code symbol for a first predetermined time (for example, ten seconds), the scanner <NUM> shifts to a customer detection state A (Arc A2).

The customer detection state A is a state in which the customer detecting section <NUM> is performing the customer detection processing. This state is represented as a state M2. In the state M2, the code-symbol reading section <NUM> stops reading processing of a code symbol. In the state M2, the illumination control section <NUM> lights the LED for illumination <NUM> at <NUM>% of the maximum brightness (sets the forward direction current If of the LED for illumination <NUM> to <NUM>% of the maximum value). This state is a second illumination state.

In the state M2, if a change in brightness is not detected in an image captured by the camera <NUM>, the scanner <NUM> retains the state M2 (Arc A3).

On the other hand, in the state M2, if a change in brightness is detected in the image captured by the camera <NUM>, the scanner <NUM> shifts to the state M1 (Arc A4).

In the state M2, if average brightness of the image captured by the camera <NUM> is a first predetermined value (for example, a pixel value <NUM> in an <NUM>-bit gradation image) or more for a second predetermined time (for example, five seconds), the scanner <NUM> shifts to a customer detection state B (Arc A5).

The customer detection state B is a state in which the customer detecting section <NUM> is performing the customer detection processing. This state is represented as a state M3. In the state M3, the code-symbol reading section <NUM> stops the reading processing of a code symbol. In the state M3, the illumination control section <NUM> extinguishes the LED for illumination <NUM> (sets the forward direction current If of the LED for illumination <NUM> to <NUM>). This state is a third illumination state.

In the state M3, if a change in brightness is not detected in the image captured by the camera <NUM>, the scanner <NUM> retains the state M3 (Arc A6).

On the other hand, in the state M3, if a change in brightness is detected in the image captured by the camera <NUM>, the scanner <NUM> shifts to the state M1 (Arc A7).

In the state M3, if the average brightness of the image captured by the camera <NUM> is smaller than a second predetermined value (for example, a pixel value <NUM> in an <NUM>-bit gradation image) for a third predetermined time (for example, one second), the scanner <NUM> shifts to the customer detection state A (Arc A8).

Various setting values (the first predetermined time, the second predetermined time, the third predetermined time, the first predetermined value, the second predetermined value, and the forward direction current If of the LED for illumination <NUM>) illustrated in <FIG> are examples and only have to be set as appropriate based on an evaluation experiment or the like.

Explanation of a flow of processing performed by the self-POS terminal.

A flow of overall processing performed by the self-POS terminal <NUM> is explained with reference to <FIG> is a flowchart illustrating an example of a flow of processing performed by the self-POS terminal <NUM> according to the embodiment.

The customer detecting section <NUM> performs customer detection processing for detecting a customer (Act <NUM>).

Further, the customer detecting section <NUM> determines, based on a result of the customer detection processing, whether the customer is approaching the self-POS terminal <NUM> (Act <NUM>). If the customer detecting section <NUM> determines that the customer is approaching the self-POS terminal <NUM> (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the customer detecting section <NUM> does not determine that the customer is approaching the self-POS terminal <NUM> (No in Act <NUM>), the processing returns to Act <NUM>.

If the customer detecting section <NUM> determines Yes in Act <NUM>, the commodity registering section <NUM> reads a code symbol and performs commodity registration processing for registering a commodity indicated by the read code symbol (Act <NUM>). In <FIG>, the respective kinds of processing in Acts <NUM>, <NUM>, and <NUM> are simplified. A detailed flow of these kinds of processing is explained below (<FIG>).

Subsequently, the accounting processing section <NUM> performs accounting processing for accounting the commodity registered by the commodity registration processing (Act <NUM>). Thereafter, the self-POS terminal <NUM> ends the processing illustrated in <FIG>.

Explanation of a flow of processing performed by the scanner.

A flow of processing performed by the scanner <NUM> is explained in detail with reference to <FIG> is a flowchart illustrating an example of a flow of processing performed by the scanner <NUM> incorporated in the self-POS terminal <NUM> according to the embodiment. The flowchart of <FIG> illustrates a flow of the respective kinds of processing in Acts <NUM>, <NUM>, and <NUM> in <FIG> in detail.

The reading control section <NUM> starts the scanner <NUM> and causes the code-symbol reading section <NUM> to read a code symbol (Act <NUM>). This state is equivalent to the state M1 illustrated in <FIG>. At this time, the illumination control section <NUM> changes the illumination state of the LED for illumination <NUM> to the first illumination state.

The reading control section <NUM> determines whether the code-symbol reading section <NUM> reads a code symbol (Act <NUM>). If the reading control section <NUM> determines that the code-symbol reading section <NUM> reads a code symbol (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the reading control section <NUM> does not determine that the code-symbol reading section <NUM> reads a code symbol (No in Act <NUM>), the processing proceeds to Act <NUM>.

If the reading control section <NUM> determines Yes in Act <NUM>, the commodity registering section <NUM> additionally registers the code symbol of the commodity read in Act <NUM> in the commodity registration file F2 to thereby update the commodity registration file F2 (Act <NUM>).

The commodity registering section <NUM> determines whether registration of all commodities is completed (Act <NUM>). If the commodity registering section <NUM> determines that the registration of all the commodities is completed (Yes in Act <NUM>), the scanner <NUM> ends the processing illustrated in <FIG>. On the other hand, if the commodity registering section <NUM> does not determine that the registration of all the commodities is completed (No in Act <NUM>), the processing returns to Act <NUM>.

On the other hand, if the reading control section <NUM> determines No in Act <NUM>, the clocking section <NUM> determines whether ten seconds (the first predetermined time) elapse after the code-symbol reading section <NUM> reads the code symbol (Act <NUM>). If the clocking section <NUM> determines that ten seconds elapse (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the clocking section <NUM> does not determine that ten seconds elapse (No in Act <NUM>), the processing returns to Act <NUM>.

If the clocking section <NUM> determines Yes in Act <NUM>, the illumination control section <NUM> and the reading control section <NUM> shift the scanner <NUM> to the customer detection state A (the state M2 illustrated in <FIG>) (Act <NUM>). At this time, the reading control section <NUM> stops the operation of the code-symbol reading section <NUM>. The illumination control section <NUM> changes the illumination state of the LED for illumination <NUM> to the second illumination state.

Subsequently, the customer detecting section <NUM> determines whether the customer is detected (Act <NUM>). If the customer detecting section <NUM> detects that the customer is detected (Yes in Act <NUM>), the processing returns to Act <NUM>. On the other hand, if the customer detecting section <NUM> does not determine that the customer is detected (No in Act <NUM>), the processing proceeds to Act <NUM>.

If the customer detecting section <NUM> determines No in Act <NUM>, the customer detecting section <NUM> determines whether the average brightness of the image captured by the camera <NUM> is higher than <NUM> (the first predetermined value) (Act <NUM>). If the customer detecting section <NUM> determines that the average brightness of the image is higher than <NUM> (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the customer detecting section <NUM> does not determine that the average brightness of the image is higher than <NUM> (No in Act <NUM>), the processing returns to Act <NUM>.

If the customer detecting section <NUM> determines Yes in Act <NUM>, the clocking section <NUM> determines whether five seconds (the second predetermined time) elapse after the customer detecting section <NUM> determines that the average brightness of the image is higher than <NUM> (Act <NUM>). If the clocking section <NUM> determines that five seconds elapse (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the clocking section <NUM> does not determine that five seconds elapse (No in Act <NUM>), the processing returns to Act <NUM>.

If the clocking section <NUM> determines Yes in Act <NUM>, the illumination control section <NUM> and the reading control section <NUM> shift the scanner <NUM> to the customer detection state B (the state M3 illustrated in <FIG>) (Act <NUM>). At this time, the reading control section <NUM> stops the operation of the code-symbol reading section <NUM>. The illumination control section <NUM> extinguishes the LED for illumination <NUM> (the third illumination state).

Subsequently, the customer detecting section <NUM> determines whether the customer is detected (Act <NUM>). If the customer detecting section <NUM> determines that the customer is detected (Yes in Act <NUM>), the processing returns to Act <NUM>. On the other hand, if the customer detecting section <NUM> does not determine that the customer is detected (No in Act <NUM>), the processing proceeds to Act <NUM>.

If the customer detecting section <NUM> determines No in Act <NUM>, the customer detecting section <NUM> determines whether the average brightness of the image captured by the camera <NUM> is smaller than <NUM> (the second predetermined value) (Act <NUM>). If the customer detecting section <NUM> determines that the average brightness of the image is smaller than <NUM> (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the customer detecting section <NUM> does not determine that the average brightness of the image is smaller than <NUM> (No in Act <NUM>), the processing returns to Act <NUM>.

If the customer detecting section <NUM> determines Yes in Act <NUM>, the clocking section <NUM> determines whether one second (the third predetermined time) elapses after the customer detecting section <NUM> determines that the average brightness of the image is smaller than <NUM> (Act <NUM>). If the clocking section <NUM> determines that one second elapses (Yes in Act <NUM>), the processing proceeds to Act <NUM>. On the other hand, if the clocking section <NUM> does not determine that one second elapses (No in Act <NUM>), the processing returns to Act <NUM>.

As explained above, in the scanner <NUM> (the article information reading apparatus) in the first embodiment, the code-symbol reading section <NUM> (reading section) reads the code symbol attached to the commodity (an article) using the image captured by the camera <NUM> (imaging section). The customer detecting section <NUM> (detecting section) detects a change in brightness using the image captured by the camera <NUM> to thereby detect approach of the customer to the self-POS terminal <NUM>. The reading control section <NUM> (reading control section) starts the operation of the code-symbol reading section <NUM> on condition that the customer detecting section <NUM> detects a change in brightness. Therefore, both of the reading of the code symbol and the detection of the customer can be executed using the image captured by the same camera <NUM>. Therefore, it is possible to implement the function of detecting the approach of the customer without changing the hardware configuration of the scanner in the past.

In the scanner <NUM> (the article information reading apparatus) in the first embodiment, the illumination control section <NUM> (illumination control section) controls, based on the operation state of the code-symbol reading section <NUM> (the reading section) and the operation state of the customer detecting section <NUM> (the detecting section), the brightness of the LED for illumination <NUM> (the illuminating section) that illuminates the imaging range of the camera <NUM> (the imaging section). Therefore, it is possible to reduce power consumption of the scanner <NUM> by changing brightness of illumination according to ambient brightness.

In the scanner <NUM> (the article information reading apparatus) in the first embodiment, the reading control section <NUM> (the reading control section) ends the operation of the code-symbol reading section <NUM> (the reading section) on condition that the code-symbol reading section <NUM> (the reading section) does not read a code symbol for the first predetermined time. The illumination control section <NUM> (the illumination control section) changes the illumination state of the LED for illumination <NUM> (the illuminating section) from the first illumination state in which the LED for illumination <NUM> is emitting light at the maximum brightness to the second illumination state in which the brightness is reduced. Therefore, if performing the customer detection processing, it is possible to reduce the power consumption of the scanner <NUM> by stopping the operation of the scanner <NUM> and reducing the brightness of the illumination.

After the illumination control section <NUM> (the illumination control section) changes the illumination state of the LED for illumination <NUM> (the illuminating section) to the second illumination state, the scanner <NUM> (the article information reading apparatus) in the first embodiment changes, on condition that the brightness of the image captured by the camera <NUM> (the imaging section) is the first predetermined value or more for the second predetermined time, the illumination state to the third state in which the LED for illumination <NUM> is extinguished. Therefore, if performing the customer detection processing, if the background is bright, the customer detecting section <NUM> (the detecting section) performs the customer detection processing in a state in which the LED for illumination <NUM> is extinguished. Consequently, it is possible to further reduce the power consumption of the scanner <NUM>.

In the scanner <NUM> (the article information reading apparatus) in the first embodiment, if the illumination state of the LED for illumination <NUM> (the illuminating section) is the second illumination state or the third illumination state, the reading control section <NUM> (the reading control section) causes the code-symbol reading section <NUM> (the reading section) to start operation on condition that the customer detecting section <NUM> (the detecting section) detects a change in brightness from the image captured by the camera <NUM> (the imaging section). The illumination control section <NUM> (the illumination control section) changes the illumination state of the LED for illumination <NUM> (the illuminating section) to the first illumination state. Therefore, since the scanner <NUM> starts operation if the customer is detected, it is possible to start the scanner <NUM> without delay if the customer uses the self-POS terminal <NUM>.

In the scanner <NUM> (the article information reading apparatus) in the first embodiment, if the illumination state of the LED for illumination <NUM> (the illuminating section) is the third illumination state, the illumination control section <NUM> changes the illumination state of the LED for illumination <NUM> (the illuminating section) to the second illumination state on condition that the brightness of the image captured by the camera <NUM> (the imaging section) is smaller than the second predetermined value for the third predetermined time. Therefore, it is possible to stably perform the customer detection processing irrespective of fluctuation in brightness by changing, according to the brightness of the background, the brightness of illumination in performing the customer detection processing.

For example, the scanner <NUM> in the embodiment detects approach of the customer and transitions the operation state. However, the scanner <NUM> may be applied to a general facing-type POS terminal. That is, the customer detecting section <NUM> may detect approach of the store clerk to the scanner <NUM> to thereby transition the operation state of the scanner <NUM>.

Claim 1:
An article information reading apparatus (<NUM>), comprising:
a reader (<NUM>) configured to read, from an image captured by an imaging section (<NUM>), a code symbol attached to an article;
characterized by further comprising:
a customer detecting section (<NUM>) configured to perform customer detection processing for determining if a customer is approaching the article information reading apparatus (<NUM>),
wherein the customer detection processing includes:
capturing by the imaging section (<NUM>) a first image and after a time interval (Δt) a second image (I2),
dividing each of the captured images into a plurality of blocks,
calculating an average pixel brightness of a plurality of pixels belonging to each of the plurality of blocks and setting the calculated average as a brightness of the corresponding block,
generating after the time interval (Δt) a differential image by deducting from the brightness of each block of the first image the brightness of each block of the second image, binarizing the result with a predetermined threshold and setting the corresponding block of the differential image to "one" or "zero" according to the result of the binarization, and
if there are a predetermined number or more of blocks set to "one" in the differential image determining that the customer is approaching the article information reading apparatus (<NUM>), and
a reading controller (<NUM>) configured to start operation of the reader (<NUM>) on condition that the customer detecting section (<NUM>) has determined that the customer is approaching the article information reading apparatus (<NUM>).