Source: http://www.google.com/patents/US7868759?ie=ISO-8859-1&dq=5251294
Timestamp: 2015-05-28 05:03:59
Document Index: 602117063

Matched Legal Cases: ['art.\n12', 'art 110', 'art 110', 'art 210', 'art 210', 'art 210', 'art 500']

Patent US7868759 - Shopping cart bottom of the basket item detection - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsEmbodiments of the invention address deficiencies of the art in respect to bottom of the basket (BOB) item detection and provide a method, system and computer program product for high-contrast BOB item detection. In one embodiment of the invention, a shopping cart BOB item detection data processing system...http://www.google.com/patents/US7868759?utm_source=gb-gplus-sharePatent US7868759 - Shopping cart bottom of the basket item detectionAdvanced Patent SearchPublication numberUS7868759 B2Publication typeGrantApplication numberUS 11/534,882Publication dateJan 11, 2011Filing dateSep 25, 2006Priority dateSep 25, 2006Fee statusPaidAlso published asUS20080074261Publication number11534882, 534882, US 7868759 B2, US 7868759B2, US-B2-7868759, US7868759 B2, US7868759B2InventorsThomas G. ZimmermanOriginal AssigneeInternational Business Machines CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (11), Referenced by (12), Classifications (10), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetShopping cart bottom of the basket item detection
US 7868759 B2Abstract
Embodiments of the invention address deficiencies of the art in respect to bottom of the basket (BOB) item detection and provide a method, system and computer program product for high-contrast BOB item detection. In one embodiment of the invention, a shopping cart BOB item detection data processing system can include high contrast material applied in proximity to a shopping cart BOB; an optical sensor positioned to generate an image of the high contrast material; BOB detection logic and an alert disposed in proximity to a cash register at the check stand. The BOB detection logic can include program code enabled to analyze the image to detect either an obscuring or an obstruction of the high contrast material. As such, the alert can be operable to issue an alert responsive to the BOB detection logic detecting one an obscuring or an obstruction of the high contrast material.
1. In a check stand, a shopping cart bottom of the basket (BOB) item detection data processing system comprising:
high contrast material applied in proximity to a shopping cart BOB;
an optical sensor positioned to generate an image of the high contrast material;
BOB detection logic comprising program code enabled to analyze the image to detect one of an obscuring and an obstruction of the high contrast material; and,
an alert disposed in proximity to a cash register at the check stand and operable to issue an alert responsive to the BOB detection logic detecting one of an obscuring and an obstruction of the high contrast material, wherein
the high contrast material is applied to a bottom rail of the shopping cart BOB nearest to the check stand and a bottom rail of the shopping cart BOB furthest from the check stand.
2. The system of claim 1, wherein the high contrast material is applied to a hollow tube surrounding the bottom rail of the shopping cart BOB nearest to the check stand and to a hollow tube surrounding the bottom rail of the shopping cart BOB furthest from the check stand.
3. The system of claim 1, wherein the high contrast material is applied to a floor surface below the shopping cart BOB.
4. The system of claim 1, wherein the high contrast material is one of reflective, retro-reflective and fluorescent material.
5. The system of claim 4, further comprising a light source proximate to the optical sensor.
6. The system of claim 1, wherein the alert is one of a visual alert and an audio alert.
7. The system of claim 1, further comprising additional optical sensors each positioned to generate an image of the high contrast material for analysis by the program code of the BOB detection logic.
8. A shopping cart bottom of the basket (BOB) item detection method comprising:
acquiring an optical image of high contrast material proximate to a shopping cart BOB adjacent to a check stand;
determining whether the high contrast material is one of obscured and obstructed by an item in the BOB; and,
responsive to determining one of an obscuring and an obstruction of the high contrast material, triggering an alert to a check stand clerk, wherein
the determining whether the high contrast material is one of obscured and obstructed by an item in the BOB comprises:
detecting high contrast material in a bottom rail of the BOB nearest to the check stand;
further detecting high contrast material in a bottom rail of the BOB furthest from the check stand; and
determining whether portions of the high contrast material in the bottom rail of the BOB furthest from the check stand have become obscured or obstructed from view relative to portions of the high contrast material in the bottom rail of the BOB nearest to the check stand.
the acquiring the optical image of the high contrast material proximate to the shopping cart BOB adjacent to the check stand comprises concurrently acquiring multiple different optical images of high contrast material proximate to a shopping cart BOB adjacent to a check stand.
the determining whether the high contrast material is one of obscured and obstructed by an item in the BOB comprises comparing a previously stored image of the high contrast material to the optical image to identify differences that exceed a threshold sufficient to conclude that the high contrast material has been one of obscured and obstructed by an item in the BOB.
11. The method of claim 8, further comprising applying the high contrast material to a hollow tube and attaching the hollow tube to a rail on the BOB of the shopping cart.
12. A computer program product comprising a computer usable tangible medium embodying computer usable program code for shopping cart bottom of the basket (BOB) item detection the computer program product comprising:
computer usable program code for acquiring an optical image of high contrast material proximate to a shopping cart BOB adjacent to a check stand;
computer usable program code for determining whether the high contrast material is one of obscured and obstructed by an item in the BOB; and,
computer usable program code for triggering an alert to a check stand clerk responsive to determining an obscuring or an obstruction of the high contrast material,
the determining whether the high contrast material is one of obscured and obstructed by an item in the BOB, comprises:
13. The computer program product of claim 12, wherein the acquiring the optical image of the high contrast material proximate to the shopping cart BOB adjacent to the check stand, comprises concurrently acquiring multiple different optical images of high contrast material proximate to a shopping cart BOB adjacent to a check stand.
the determining whether the high contrast material is one of obscured and obstructed by an item in the BOB, comprises comparing a previously stored image of the high contrast material to the optical image to identify differences that exceed a threshold sufficient to conclude that the high contrast material has been one of obscured and obstructed by an item in the BOB.
The present invention relates to the field of retail store checkout systems and more particularly to shopping cart bottom of the basket detection.
Several systems have been developed to alert a store cashier to the presence of a parcel positioned on the lower tray of a shopping cart as that cart passes through the checkout aisle. U.S. Pat. No. 4,327,819 issued to Coutta on May 4, 1982 for OBJECT DETECTION SYSTEM FOR A SHOPPING CART, U.S. Pat. No. 4,725,822 issued to Hooley on Feb. 1, 1988 for SHOPPING CART WITH LOWER TRAY SIGNALING DEVICE, and U.S. Pat. No. 4,736,098 issued to Rehrig on Apr. 5, 1988 for SIGNALING METHOD AND APPARATUS FOR A CONVENTIONAL SHOPPING CART each disclose systems whereby a combination of a light transmitter, light detector and a reflector mounted on the lower tray of a shopping cart act in concert to detect the presence of unpaid for articles on the lower tray of a shopping cart passing through a checkout aisle. Unique to the systems described in the these patents is the use of springs which bias the lower tray towards one position so that the increased weight of parcels placed on the lower tray depresses the tray, bringing the reflector into the path of the beam of light emitting from the transmitter.
Conventional bottom-of-the-basket (BOB) detectors can require some sort of constant monitoring by checkout personnel. Conventional BOB detectors further can require expensive hardware investments and time consuming shopping cart retrofits in order to accommodate the complicated imaging sensor systems. For many BOB detectors, the cost of the sensing camera can be enormous dissuading widespread adoption. Likewise, more complex detection equipment often translates into substantial training costs for checkout personnel.
Embodiments of the invention address deficiencies of the art in respect to BOB detection and provide a novel and non-obvious method, system and apparatus for high-contrast BOB item detection In one embodiment of the invention, a shopping cart BOB item detection data processing system can include high contrast material applied in proximity to a shopping cart BOB; a light source to illuminate the high contrast material; an optical sensor positioned to generate an image of the high contrast material; BOB detection logic and an alert disposed in proximity to a cash register at the check stand. The BOB detection logic can include program code enabled to analyze the image to detect either an obscuring or an obstruction of the high contrast material. As such, the alert can be operable to issue an alert responsive to the BOB detection logic detecting one an obscuring or an obstruction of the high contrast material.
It is to be recognized that obscuring can include attenuating the brightness of the image, as with a translucent or cloudy liquid; bending light (e.g. a clear liquid or clear plastic), reflecting light (e.g. shiny metal) and filtering light spectra (e.g. colored liquid or solid), or otherwise changing physical properties of light. Obstructing, by comparison, can include totally blocking light (e.g. an opaque body such as a cardboard box), partially blocking light (e.g. wire cage for an animal) and dynamically blocking light (e.g. ball rolling under the basket). It is possible for a BOB object to be of such material and construction to exhibit a plurality of these optical properties, and hence both obscure and obstruct detection of the high contrast material.
In one aspect of the embodiment, the high contrast material can be applied to a bottom rail of the shopping cart BOB nearest to the check stand and a bottom rail of the shopping cart BOB furthest from the check stand. In another aspect of the embodiment, the high contrast material can be applied to a hollow tube surrounding a bottom rail of the shopping cart BOB nearest to the check stand and to a hollow tube surrounding a bottom rail of the shopping cart BOB furthest from the check stand. In yet another aspect of the embodiment, the high contrast material can be applied to a floor surface below the shopping cart BOB. Notably, in one aspect of the embodiment, the high contrast material can include retro-reflective tape. In another aspect of the embodiment, the high contrast material can include colored paint, including fluorescent paint and reflecting paint.
In another embodiment of the invention, a shopping cart BOB item detection method can be provided. The method can include acquiring an optical image of high contrast material proximate to a shopping cart BOB adjacent to a check stand, determining whether the high contrast material either has become obscured or obstructed by an item in the BOB, and triggering an alert to a check stand clerk in response to determining that the high contrast material has become obscured or obstructed.
In one aspect of the embodiment, determining whether the high contrast material has been obscured or obstructed by an item in the BOB can include detecting high contrast material in a bottom rail of the BOB nearest to the check stand, further detecting high contrast material in a bottom rail of the BOB furthest from the check stand, and determining whether portions of the high contrast material in the bottom rail of the BOB furthest from the check stand have become obscured or obstructed from view relative to portions of the high contrast material in the bottom rail of the BOB nearest to the check stand.
FIG. 1 is a pictorial illustration of a check stand configured for shopping cart BOB item detection;
FIGS. 2A through 2C are schematic illustrations of different configurations for the check stand of FIG. 1;
FIG. 3 is a block diagram illustrating a BOB item detection data processing system for use in the check stand of FIG. 1; and,
FIG. 4 is a flow chart illustrating a process for BOB item detection in the data processing system of FIG. 3.
FIG. 5 depicts a top image in which an object is not within a shopping cart BOB and a bottom image in which an object is within the shopping cart BOB.
Embodiments of the invention provide a method, system and computer program product for shopping cart BOB item detection. In accordance with an embodiment of the present invention, a high contrast material can be disposed in proximity to the BOB of a shopping cart, such as on the bottom rails of the shopping cart, or on the floor below the shopping cart BOB. A video camera can be configured to detect the high contrast material and the obscuring of the high contrast material can be viewed as an indication that shopping cart items in the shopping cart have obstructed the view of the video camera. In response, an alert can be issued to the cashier.
In further illustration, FIG. 1 is a pictorial illustration of a check stand configured for shopping cart BOB item detection. As shown in FIG. 1, a check stand 130 can be provided in concert with a video sensor 150. The check stand 130 can be configured to accommodate a shopping cart 110 and can include a checkout register 180. A high contrast material 140 such as retro-reflective tape can be placed in proximity to the shopping cart 110 BOB 120 such as below the BOB 120, or on the rails of the BOB 120, to name only two possible positions. The positioning of the high contrast material 140 can be such that an item in the BOB 120 can obscure or obstruct imagery of the high contrast material 140 as viewed by the video sensor 150 illuminated by a light source 190. In an aspect of the embodiment, light source 190 can include an infrared light source incorporating light emitting diodes. Other aspects of the embodiment can include a light source 190 producing ultraviolet light so as to excite fluorescent paint when used as the high contrast material 140.
For example, referring to FIG. 2A, the high contrast material 240 can be placed on nylon or plastic hollow tubes and attached to the rails of the BOB 290 of the shopping cart 210 such that an item in the BOB 290 of the shopping cart 210 can obscure or obstruct a view of the high contrast material 240 by a video sensor 250 affixed in proximity to the check stand 230. To this end, the video sensor 250 can be arranged to provide video sensor 250 a sufficient view of the high contrast material 240. Examples include mounting the video sensor 250 above the BOB 290 of the shopping cart 210 and aiming the video sensor 250 at a downwards angle towards the BOB 290. In this way, with an item placed in the BOB 290, the rail of the BOB 290 furthest from the camera 250 will become obscured, while the nearest rail of the BOB 290 to the camera 250 will remain in view. Accordingly, the nearest rail of the BOB 290 can act as a synchronization track to the furthest rail—the detection rail.
Alternatively, referring to FIG. 2B, the high contrast material 240 such as fluorescent paint, can be painted onto the rails of the BOB 290. As yet a further alternative, as shown in FIG. 2C, the high contrast material 240 can be placed on the floor adjacent to the check stand 230 below the BOB 290. In all cases, the camera 250 can be a monochromatic camera. The camera 250 further can include a set of individual cameras positioned about the check stand 230. When multiple individual cameras are positioned, each can provide item detection for the BOB 290 and the resulting imagery analysis for each of the cameras can be combined to determine whether an item is in the BOB 290.
In any event, referring again to FIG. 1, BOB item detection logic 160 can be coupled to the video sensor 150. The BOB item detection logic 160 can include program code enabled to detect an obscuring or obstruction of the view of the BOB 120 by an item placed in the BOB 120. The detection of the obscuring or obstruction can be facilitated by use of the high contrast material 140. Responsive to detecting an obscuring or obstruction of the high contrast material 140, a coupled alert 170 can be triggered such as a light placed adjacent to the cash register 180 on the check stand 130.
In specific illustration, FIG. 5 depicts the processed imagery for a shopping cart having an unobstructed, unobscured view of the shopping cart BOB as compared to processed imagery for the same shopping cart having an obstructed view of the shopping cart BOB. In particular, as shown in FIG. 5, a top view of a shopping cart 500 includes a shopping cart BOB 510 and rails 520 with high contrast material applied. In the top image, a video sensor 530 can produce an image that can be processed into the reference template 540A for a shopping cart BOB 510 without items in therein. Referring to the bottom image of FIG. 5, an object 550 placed in the shopping cart BOB 510 can produce an image that can be processed into the non-matching comparison image 540B indicating an obstructed and/or obscured view of the rails 520.
In further illustration, FIG. 3 is a block diagram illustrating a BOB item detection data processing system for use in the check stand of FIG. 1. The data processing system can include an optical sensor 330 disposed opposite high contrast material 310 through the BOB 320 of a shopping basket. The optical sensor 330 can be coupled to image processing logic 340. The image processing logic 340 can include program code enabled to compare sensed imagery through the optical sensor 330 to pre-stored BOB imagery 360 to determine whether the view of the high contrast material 310 has become obscured or obstructed due to an item in the BOB 320. Where sensed imagery reflects obscuring and/or obstruction which exceeds a threshold value 350, an alert 370 can be issued.
In a preferred embodiment, image processing logic 340 transforms the image attained through optical sensor 330 into a binary image that best matches (lines up) with the pre-stored BBO imagery 360. A binary image can be attained by applying a threshold to the grayscale values of image attained through optical sensor 330, producing a binary image of the rails 520. Next, the image processing logic 340 can apply an affine transform to the binary rail image to best align the binary rail image to the pre-stored BOB imagery 360. The pre-stored BOB imagery 360 can be a binary rail image from a shopping cart with no items in the BOB and oriented in the most probably position, i.e. shopping cart parallel to the check stand 130.
In more specific illustration, FIG. 4 is a flow chart illustrating a process for BOB item detection in the data processing system of FIG. 3. Beginning in block 410, a reference template can be loaded for indicating when an image of the high contrast material associated with the BOB of a shopping cart has become obstructed and/or obscured. In block 420, an image of the BOB of a shopping cart can be acquired. In block 430, the acquired image can be processed and in block 440 processed image can be compared with the loaded reference template. In decision block 450, if the processed image has a disparity with a reference template beyond an acceptable threshold, in block 460 an alert can be activated.
In a preferred embodiment, block 430 received a binary rail image that is aligned with the pre-stored BOB imagery 360 and calculates the mismatch between the two images. The mismatch is calculated as the sum of the exclusive OR (XOR) of each pixel of the two images. Specifically, if a pixel in the pre-stored BOB imagery 360 is different from a corresponding pixel of the rail image (e.g. one is bright the other is dark), a 1 is added to the sum, representing a pixel mismatch. The resulting sum is the score of how dissimilar the two images are. If the mismatch score exceeds a fixed threshold (block 450) an alert is activated (block 460). The threshold is determined experimentally to minimize false accepts and false rejects.
In an alternate embodiment, BOB Imagery 360 can be replaced with a mathematical description and can serve as the reference template (loaded in block 410) and compared (block 440) against the processed image (block 430) to determine (block 450) if high contrast material is obstructed and or obscured. Referring to FIG. 5 the mathematical description of reference template 540A can include two zero slope lines of particular length and particular vertical displacement from each other.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS3725894 *Sep 27, 1971Apr 3, 1973Geisler EPhotocell controlled shopping cart package detectorUS4327819Aug 1, 1980May 4, 1982Coutta John MObject detection system for a shopping cartUS4736098 *Feb 10, 1986Apr 5, 1988Rehrig InternationalSignalling method and apparatus for a conventional shopping cartUS5500526May 26, 1994Mar 19, 1996Solar Wide Industries, Ltd.Monitoring device for monitoring the passage of objects through passageUS5610584May 2, 1995Mar 11, 1997Schrade; Chester R.Detection of goods on the bottom rack of a cartUS6741177Mar 28, 2002May 25, 2004Verifeye Inc.Method and apparatus for detecting items on the bottom tray of a cartUS7246745 *Feb 2, 2005Jul 24, 2007Evolution Robotics Retail, Inc.Method of merchandising for checkout lanesUS20030014217 *Jun 19, 2002Jan 16, 2003Robert WarnerProgrammable photoelectric sensor and a system for adjusting the performance characteristics of the sensorUS20030184440 *Mar 28, 2002Oct 2, 2003Ballantyne William JohnMethod and apparatus for detecting items on the bottom tray of a cartUS20050189412 *Feb 2, 2005Sep 1, 2005Evolution Robotics, Inc.Method of merchandising for checkout lanesUSRE32151 *Mar 28, 1983May 20, 1986Ransburg CorporationVariable low-pressure fluid color change cycle* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS8590789 *Sep 14, 2011Nov 26, 2013Metrologic Instruments, Inc.Scanner with wake-up modeUS8740085Feb 10, 2012Jun 3, 2014Honeywell International Inc.System having imaging assembly for use in output of image dataUS8823951Jul 15, 2011Sep 2, 2014Leddartech Inc.3D optical detection system and method for a mobile storage systemUS8833657 *Jun 22, 2011Sep 16, 2014Willie Anthony JohnsonMulti-pass biometric scannerUS8982094Mar 11, 2013Mar 17, 2015Shenzhen Huiding Technology Co., Ltd.Device-to-device communications based on capacitive sensing and coupling via human body or direct device-to-device couplingUS20110253785 *Jun 22, 2011Oct 20, 2011Willie Anthony JohnsonMulti-Pass Biometric ScannerUS20120218107 *Dec 13, 2010Aug 30, 2012Yvan MimeaultEntity detection system and method for monitoring an areaUS20130062409 *Sep 14, 2011Mar 14, 2013Metrologic Instruments, Inc.Scanner with wake-up modeUS20140002646 *Jun 26, 2013Jan 2, 2014Ron SchefferBottom of the basket surveillance system for shopping cartsDE102012206268A1Apr 17, 2012Oct 25, 2012Ford Global Technologies, LlcVerfahren und Vorrichtung zum dynamischen Bereitstellen von Platzverwaltungshinweisen f�r ein FahrzeugDE102012207579A1May 8, 2012Nov 15, 2012Ford Global Technologies, LlcSystem und Verfahren zum automatischen Freigeben eines Automodus in einer pers�nlichen KommunikationseinrichtungDE102013214906A1Jul 30, 2013Feb 6, 2014Ford Global Technologies, LlcVorrichtung und Verfahren zum Senden von statischen und dynamischen Informationen an ein pers�nliches Kommunikationsger�t in einem Fahrzeug* Cited by examinerClassifications U.S. Classification340/568.5, 235/383International ClassificationG08B13/14, G06K15/00Cooperative ClassificationA47F9/045, G08B13/1481, B62B3/1488European ClassificationG08B13/14N, A47F9/04C, B62B3/14SLegal EventsDateCodeEventDescriptionJun 11, 2014FPAYFee paymentYear of fee payment: 4Sep 4, 2012ASAssignmentFree format text: PATENT ASSIGNMENT AND RESERVATION;ASSIGNOR:INTERNATIONAL BUSINESS MACHINES CORPORATION;REEL/FRAME:028895/0935Effective date: 20120731Owner name: TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORASep 26, 2006ASAssignmentOwner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW YFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ZIMMERMAN, THOMAS G.;REEL/FRAME:018302/0971Effective date: 20060920RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services