Patent Description:
For example, most retail stores now have Self-Service Checkouts (SCOs) where customers of the stores can self-checkout. Customers utilizing SCOs typically have to pick items from the store shelves, carry them to the SCOs, scan the item barcodes at the SCOs, and pay for the goods. The problem with this approach is that the customers have to handle the items multiple times before checking out (pick from shelves, place in cart, remove from cart, scan at the SCOs, bag the items, etc.).

Consequently, many retailers now offer mobile applications accessible from their customer phones that permit their customers to scan item barcodes as they shop in the stores and place scanned items in bags of a cart or a basket. Scan as you shop applications have streamlined the customer experience within the stores. However, these applications still have a number of problems, which have limited customer adoption of this technology.

The scan as you shop applications require the user to actively operate their mobile phones as they shop. This creates a usability issue because one customer hand has to hold a picked item while the other customer hand has to operate the phone and interact with the mobile application during shopping. Many customers find this experience too cumbersome and difficult.

As a result, some retailers have developed smart carts that comprise a variety of sensors, processors, displays, and software applications (similar to the scan as you shop applications). This frees the customers from having to hold their phones while shopping and picking items, but it creates other problems for the retailers. Retailers now have to purchase and deploy fairly complex and expensive devices, which must be maintained, supported, and purchased. None of these expenses and activities were required when customers had a mobile application, which was deployed to and processed on their own phones and which could be updated and supported via a cloud through a cellular or Wi-Fi connection to the phones.

As a result, there is a need for an improved, less expensive, less complex, and more practical device with a revised customer workflow, which can maintain the existing mobile shopping applications on the customer devices without requiring the customers to operate their devices while shopping. <CIT> describes a handsfree scanning system comprising an application stored at and executed by a personal mobile computing device. International patent application published under number <CIT> describes communication between a mobile application at a user mobile electronic device and a shopping cart, with a status indicator on the shopping cart to indicate that the shopping cart is in use. <CIT> describes opportunistically charging a rechargeable power source of a portable electronic unit.

In various embodiments, a system, a device, and methods for operating a portable scan-assistance device while shopping are presented.

According to a first aspect of the present invention, there is provided a device, comprising: a status light; a wireless transceiver; an image sensor; a processor; non-transitory computer-readable storage medium comprising executable instructions; and the executable instructions when executed by the processor cause the processor to perform operations comprising: establishing a wireless connection with a mobile device; relaying item codes captured by the image sensor to the mobile device over the wireless connection; and controlling illumination of the status light based on statuses associated with the wireless connection and the image sensor; wherein the executable instructions when executed by the processor cause the processor to perform additional operations comprising: capturing metrics for the item codes, length of time associated with the wireless connection, and the statuses; storing the metrics in storage of the device.

Aptly, the device further comprises a latching mechanism to attach and detach a housing of the device to objects.

Aptly, objects comprise, carts, baskets, bags, clothing, a shopping scooter, or body parts of an individual.

Aptly, the device further comprises a chain that fits through a hole in a housing of the device and is adapted to be affixed around a neck of an individual or to be placed over a head of the individual with the device worn as a necklace.

Aptly, the device further comprises a Quick Response (QR) code affixed as a label to a front surface of a housing of the device.

Aptly, the executable instructions when executed by the processor cause the processor to perform further operations comprising: detecting an administrative mode of operation; and providing the metrics from the storage.

Aptly, the executable instructions associated with the controlling further cause the processor to perform additional operations comprising: changing colors of the status light based on the statuses.

Aptly, the executable instructions associated with the controlling further cause the processor to perform additional operations comprising: changing a blink rate associated with an illuminated color of the status light based on a particular status.

Aptly, the executable instructions associated with the controlling further cause the processor to perform additional operations comprising: changing the status light from illuminating a first color to a second color when a connection status indicates that the wireless connection is established.

Aptly, the executable instructions associated with the controlling further cause the processor to perform additional operations comprising: changing the status light from no illumination to a green color when a successful item code status is reported by the image sensor.

Aptly, the executable instructions associated with the controlling further cause the processor to perform further operations comprising: changing the status light from no illumination to a red color when an unsuccessful item code status is reported by the image sensor.

According to a second aspect of the present invention, there is provided a method, comprising: establishing a wireless connection with a mobile device operated by a customer of a store; identifying an item code placed in a field-of-view of an image sensor; controlling illumination of a status light based on statuses associated with the wireless connection and the image sensor; sending the item code to a mobile shopping application over the wireless connection; and retaining metrics for a length of time that the wireless connection remains active with the mobile device.

Aptly, establishing further includes establishing the wireless connection through interaction with a pairing agent on the mobile device.

Aptly, identifying further includes illuminating a status light red when the item code is unable to be identified indicating that the customer should retry placing the item code within the field-of-view of the image sensor.

Aptly, identifying further includes illuminating a status light green when the item code is identified.

Aptly, iterating the identifying and the sending until the wireless connection is terminated by the mobile shopping application.

According to a third aspect of the present invention there is provided a system, comprising: at least one server; a portable scan-assistance device, wherein the portable scan-assistance device comprises a device of the first aspect of the present invention; and a mobile device operated by a customer of a store; wherein the mobile device is configured to process a mobile shopping application to interact with a transaction manager of the at least one server for a shopping trip of the customer at the store, to establish a wireless connection to the portable scan-assistance device, to receive item codes captured by an image sensor of the portable scan-assistance device, and to pass the item codes from the mobile application to the transaction manager to record items in a virtual cart of the customer for the shopping trip; wherein the at least one server is configured to interact with the mobile application, to lookup the item codes, and to maintain the virtual shopping cart for the customer during the shopping trip; wherein the portable scan-assistance device is configured to establish the wireless connection with a pairing agent of the mobile device, to capture, via an image sensor, the item codes, to illuminate a status light when the item codes are captured, to pass the item codes to the mobile application over the wireless connection, and to retain metrics associated with a length of time of the wireless connection and successful and unsuccessful capturing of the item codes.

Aptly, the portable scan-assistance device is further configured to control one or more of a color and a blink rate of the status light based on the wireless connection and the successful and the unsuccessful capturing of the item codes.

According to an embodiment, a portable scan device is provided. The portable scan device comprises a status light; a wireless transceiver; an image sensor; a processor; and a non-transitory computer-readable storage medium comprising executable instruction. The executable instructions when executed by the processor cause the processor to perform operations, comprising: establishing a wireless connection with a mobile device; relaying item codes captured by the image sensor to the mobile device over the wireless connection; controlling illumination of the status light based on statuses associated with the wireless connection and the image sensor; capturing metrics for the item codes, length of time associated with the wireless connection, and the statuses; and storing the metrics in storage of the device.

<FIG> is a diagram of a system/platform <NUM> providing and operating a portable scan-assistance device while shopping, according to an example embodiment. It is to be noted that the components are shown schematically in greatly simplified form, with only those components relevant to understanding of the embodiments being illustrated.

Furthermore, the various components (that are identified in system/platform <NUM>) are illustrated and the arrangement of the components are presented for purposes of illustration only. It is to be noted that other arrangements with more or less components are possible without departing from the teachings of providing and operating a portable scan-assistance device, presented herein and below.

System/platform <NUM> (herein after just "system <NUM>") provides a processing environment by which customers of a retail store can shop handsfree using a portable scan-assistance device that can be attached to carts, bags, baskets, shopping scooters, or worn by the customer while shopping. The users mobile device (such as phone) establishes a connection to the scan-assistance device in an automated manner (tapping or scanning a Quick Response (QR) label affixed to the scan-assistance device. Once the customer's phone is connected to the scan-assistance device, the customer can put their phone away and shop in the store. As items are picked for purchase by the customer, the customer places the item barcode over a small camera of the scan-assistance device and the item code is read and forwarded to the customer's mobile shopping application that processes on the customer's phone over a wireless connection. The mobile shopping application provides the item code to the store's server where the item information is obtained, and pricing and the item is added to a virtual cart being maintained by the server for the customer while the customer is within the store shopping. The customer can shop without operating their phone utilizing both hands while shopping, the actual shopping session is still handled by the customer phone's mobile application via a connection to the store server. Various aspects of the scan-assistance device and the workflows associated with a customer shopping session are now discussed with reference to the <FIG>, <FIG>, and <FIG>.

As used herein, the terms "user," "consumer," and/or "customer," may be used interchangeably and synonymously herein and below. This refers to an individual who is interacting with a portable scan-assistance during a shopping trip of the individual within a store.

The system <NUM> comprises a retail server <NUM>, a scan-assistance device <NUM>, and a customer device <NUM>.

Retail server <NUM> comprises at least one processor <NUM> and a non-transitory computer-readable storage medium <NUM>. Medium <NUM> comprises executable instructions for a transaction manager <NUM>. The executable instructions when provided to processor <NUM> from medium <NUM> cause the processor <NUM> to perform operations discussed herein and below with respect to transaction manager <NUM>.

Each scan-assistance device <NUM> comprises at least one processor <NUM>, an image sensor <NUM>, one or more status lights <NUM>, a wireless transceiver <NUM>, and a non-transitory computer-readable storage medium <NUM>. Medium <NUM> comprises executable instructions or firmware for a pair/transfer/status manager <NUM>. The executable instructions/firmware when provided to processor <NUM> from medium <NUM> cause the processor <NUM> to perform operations discussed herein and below with respect to pair/transfer/status manager <NUM>.

Each customer device <NUM> comprises at least one processor <NUM>, a camera <NUM>, a touch display <NUM>, a wireless transceiver <NUM>, and a non-transitory computer-readable storage medium <NUM>. Medium <NUM> comprises executable instructions for a pair agent <NUM> and a retail shopping app <NUM>. The executable instructions when provided to processor <NUM> from medium <NUM> cause the processor <NUM> to perform operations discussed herein and below with respect to <NUM> and <NUM>.

<FIG> is a diagram of externally visible components of a portable scan-assistance device <NUM> affixed to a handle <NUM> of a shopping cart <NUM>, according to an example embodiment.

Portable scan-assistance device <NUM> further comprises a housing <NUM> and a QR label <NUM> affixed to a front-facing surface of the housing <NUM>. A top edge of the housing above the QR label <NUM> the status light <NUM> or status lights <NUM> are visible in a rectangular formation. An opening in the housing <NUM> permits visibility to a front area of the front surface of the housing <NUM> for the image sensor <NUM>. An opposite end of the housing <NUM> comprises a latching or affixing mechanism/means <NUM>.

Mechanism <NUM> permits portable scan-assistance device <NUM> to be clipped or fastened onto a cart handle <NUM> of a cart <NUM>. In an embodiment, mechanism <NUM> is manufactured into the housing <NUM> as a component of the housing, the mechanism <NUM> forms a partial circle in a tube shape that is stretchable, such that the mechanism <NUM> can be stretched to fit over and latch onto handle <NUM>.

In an embodiment, mechanism <NUM> may be detachable from housing <NUM>, such as a two-way clip that clips to one end of the housing <NUM> and clips to another object, such as a bag, a purse, a basket, shopping scooter, or the cart <NUM>.

In an embodiment, mechanism <NUM> is a chain that fits through a manufactured hole or loop in housing <NUM>, such that the chain with the portable scan-assistance device <NUM> can be worn as a necklace or a watch around the customer's neck or wrist.

In an embodiment, mechanism <NUM> is Velcro straps rather than clips.

Portable scan-assistance device <NUM> when affixed to a cart <NUM>, basket, shopping scooter, bag, or worn by the customer includes an opening that exposes the image sensor <NUM>. Image sensor <NUM> looks for item barcodes of items placed in front of portable scan-assistance device <NUM>.

With the physical features and attributes of portable scan-assistance device <NUM> discussed, a workflow for a shopping trip of a customer within a store is now discussed within the context of system <NUM>.

Initially, a customer acquires a portable scan-assistance device <NUM>. This may be as a wearable item, an attachable item to a cart, basket, bag, shopping scooter, or purse, or an item already affixed to a cart <NUM>, shopping scooter, or a basket of the store.

The customer obtains their device <NUM> (such as their phone) opens their retail app <NUM>. The user-facing interface includes an option to connect to a portable scan-assistance device <NUM>. When the customer selects this option, pair agent is activated. There are two primarily mechanisms by which the customer can connect and establish a communication session between their device <NUM> and portable scan-assistance device.

In a first option, when the user selects the connection option within the user-facing interface of retail app <NUM>, the camera <NUM> is activated on device <NUM>. The customer points the camera's focus at the QR label <NUM> of portable scan-assistance device <NUM>. Pair agent <NUM> then interacts with wireless transceiver <NUM> and pair/transfer/status manager <NUM> and wireless transceiver <NUM> to make a wireless connection <NUM> between portable scan-assistance device <NUM> and customer device <NUM>. This wireless connection <NUM> is a Bluetooth® Low Energy (LE) wireless connection between the portable scan-assistance device <NUM> and the customer device <NUM>. Here, transceivers <NUM> and <NUM> are Bluetooth® wireless transceivers.

In a second option, when the user selects the connection option within the user-facing interface of retail app <NUM>, pair agent <NUM> interacts with wireless transceiver <NUM>, pair/transfer/status manager <NUM>, and wireless transceiver <NUM> to connect portable scan-assistance device <NUM> to customer device <NUM> over a wireless connection <NUM> when the customer taps device <NUM> on portable scan-assistance device <NUM>. This wireless connection <NUM> is a Near Field Communication (NFC) connection between the portable scan-assistance device <NUM> and customer device <NUM>. Here transceivers <NUM> and <NUM> are NFC wireless transceivers.

In an embodiment, both customer device <NUM> and portable scan-assistance device <NUM> comprises two wireless transceivers <NUM>, one for Bluetooth® and one for NFC, such that the customer can make the initial wireless connection <NUM> utilizing Bluetooth or utilizing NFC.

Once wireless connection <NUM> is established between customer device <NUM> and portable scan-assistance device <NUM>, image sensor <NUM> begins to look for item barcodes placed by the customer in the field of view of image sensor <NUM>. The customer may also put their device <NUM> away for the remaining of the shopping trip (or at least until checkout). The device <NUM> may be put in a pocket or bag of the customer during the shopping trip while connection <NUM> remains active during the shopping trip. Device <NUM> is not needed during the shopping trip after connection <NUM> for the customer to complete their shopping trip. Although it is noted that the customer may voluntarily operate device <NUM> for purposes of seeing what is scanned and what is in the customer's virtual cart at any point in time desired by the customer.

Image sensor <NUM> obtains an image of the item barcode placed in its field of view and it is passed over connection <NUM> to retail app <NUM> (retail app <NUM> remains active on device <NUM> during the shopping trip even if the customer has device <NUM> put away in a bag or pocket during the shopping trip). App <NUM> obtains the item details for the item code passed to it over connection <NUM> interacts with transaction manager <NUM> for purposes of updating the virtual cart of the customer and obtaining item information and pricing which is returned back to app <NUM> for viewing by the customer (if desired).

This continues until the customer is finished with the shopping trip and is ready to checkout (pay for the items in the virtual shopping cart). Payment can be achieved in a variety of manners. In one example, the customer simply exits the store and overhead tracking cameras detect that action as an intent to pay. Transaction manager <NUM> obtains a registered payment card for the customer and processes payment to complete the checkout. In another example, app <NUM> displays a barcode for the virtual card on the touch display <NUM> of device <NUM> when the customer activates an option within a user-facing interface of app <NUM> indicating that the customer is ready to pay. The customer then places the touch display <NUM> with the barcode under a scanner of a Self-Service Terminal (SST) or under a Point-Of-Sale POS terminal. This causes transaction manager <NUM> to recall the virtual cart with its items, item descriptions, and pricing to be displayed on a display of the SST or POS and the customer proceeds through the payment processing to complete the checkout. In still another example, the customer can pay via the payment screens through the retail app <NUM> by activating a payment option on the device <NUM>.

Pair/Transfer/Status manager <NUM> also controls status light <NUM> during operation. For example, when a successful connection is made between customer device <NUM> and portable scan-assistance device <NUM>, pair/transfer/status manager <NUM> illuminates the status light a color blue (indicating connection <NUM> is active). When an item code is not captured successfully by image sensor <NUM>, the light is changed to a color red. When the item code is captured successfully by image sensor <NUM>, the light is changed to a color green. The status light may be a solid red color when there is no connection <NUM>. Moreover, in an embodiment, when pair/transfer/status manager <NUM> detects a low battery level for portable scan-assistance device <NUM>, the light may blink red, which is an indicating to staff that the portable scan-assistance device <NUM> should have the batteries replaced or should be charged. In fact, any combination of light colors or light effects (long blinks, short blinks, solid and unblinking, etc.) may be used to indicate various statuses of a given shopping session or when there is no shopping session. Pair/Transfer/Status manager <NUM> controls and can be configured to unique create color illuminations or effects (blinks at different rates) based on the statuses.

When retail app <NUM> detects that the customer has paid for the virtual cart of items through a message sent by transaction manager <NUM>, app <NUM> terminates the wireless connection <NUM>. Pair/Transfer/Status manager <NUM> then changes the status light <NUM> to a solid red color as an indication that there is no longer a customer shopping session and there is no longer any wireless connection <NUM>.

Portable scan-assistance device <NUM> only requires a minimum amount of hardware and software. The software <NUM> may be firmware that establishes connection <NUM> with device <NUM>, controls status light <NUM> based on statuses (no connection, connection, successful item code read, unsuccessful item code read, connection terminated, etc.), and passes read item codes over connection <NUM> to app <NUM>. Thus, portable scan-assistance device <NUM> is inexpensive to manufacturer and maintain. Furthermore, portable scan-assistance device <NUM> is portable such that it is not tied to any given cart, basket, shopping scooter or bag and can be reused with multiple carts, baskets, shopping scooters, and bags.

In an embodiment, software <NUM> (pair/transfer/status manager <NUM>) comprises storage that collect metrics, such as items scanned; time of day, day of week, and calendar day of scan; time spent scanning; time spent per shopping session (based on time of wireless connection <NUM>); total number of bad scans or unsuccessful scans; etc. Device <NUM> may permit two modes of operation one for administrative and one for shopping. During administrative operation, the collected metrics can be obtained from storage for analysis.

In an embodiment, device <NUM> is a passthrough, intermediate, or proxy to customer device <NUM> for purposes of passing item codes during a shopping trip to app <NUM> for recording in a virtual shopping cart for the customer with transaction manager <NUM>.

A customer is not required to operate their device <NUM> during a shopping trip with system <NUM> and can shop freely with two hands with portable scan-assistance device <NUM>. Furthermore, the software required for mobile shopping remains on the customer's device <NUM> as app <NUM>, such that the retailer can distribute, maintain, update, and upgrade app <NUM> remotely via a cellular or Wi-Fi connection to device <NUM>. Moreover, there is no expensive hardware to maintain on portable scan-assistance device <NUM> as all that is required is a non-powerful or cheap processor <NUM>, an inexpensive image sensor <NUM>, an inexpensive wireless transceiver <NUM>, an inexpensive LED status light <NUM>, and non-complex firmware <NUM>.

In an embodiment, portable scan-assistance device <NUM> is detachable and reattach able device that can be affixed to carts, bags, baskets, shopping scooters, or worn by a customer (necklace, watch, or clipped onto a belt loop, clothing, a hat, or other clothing of the customer).

In an embodiment, customer device <NUM> is a phone, a tablet, or a wearable processing device (watch, glasses, etc.).

In an embodiment, retail server <NUM> is one of several servers that logically cooperate as one server in a cloud environment (cloud).

The above-referenced embodiments and other embodiments are now discussed with <FIG>.

<FIG> is a diagram of a method <NUM> for operating a portable scan-assistance device during a customer shopping trip within a store, according to an example embodiment. The software module(s) that implements the method <NUM> is referred to as a "portable scan assistant. " The portable scan assistant is implemented as executable instructions programmed and residing within memory and/or a non-transitory computer-readable (processor-readable) storage medium and executed by one or more processors of a device. The processor(s) of the device that executes the portable scan assistant are specifically configured and programmed to process the portable scan assistant. The portable scan assistant may have access to one or more network connections during its processing. The network connections can be wired, wireless, or a combination of wired and wireless.

In an embodiment, the device that executes the portable scan assistant is device <NUM> (as discussed in system <NUM> of <FIG> and <FIG>).

In an embodiment, the portable scan assistant is all or some combination of <NUM>.

At <NUM>, the portable scan assistant establishes a wireless connection <NUM> with a mobile device <NUM> operated by a customer of a store.

In an embodiment, at <NUM>, the portable scan assistant establishes the wireless connection <NUM> through interaction with a pairing agent <NUM> on the mobile device <NUM>.

In an embodiment, the wireless connection <NUM> is an NFC established connection.

In an embodiment, the wireless connection <NUM> is a Bluetooth® LE connection.

At <NUM>, the portable scan assistant identifies an item code placed in a field-of-view of an image sensor <NUM>.

In an embodiment, at <NUM>, the portable scan assistant illuminates a status light <NUM> red when the item code is unable to be identified indicating that the customer should retry placing the item code within the field-of-view of the image sensor <NUM>.

In an embodiment, at <NUM>, the portable scan assistant illuminates a status light <NUM> green when the item code is identified/captured by the image sensor <NUM>.

At <NUM>, the portable scan assistant sends the item code a mobile shopping application <NUM> over the wireless connection <NUM>.

In an embodiment, at <NUM>, the portable scan assistant iterates back to <NUM> and <NUM> until the wireless connection is terminated by the mobile shopping application <NUM> indicating that the customer's shopping trip has entered or completed payment with transaction manager <NUM>.

In an embodiment, at <NUM>, the portable scan assistant retains metrics for a length of time that the wireless connection <NUM> remains active with the mobile device <NUM>.

One now appreciates how a portable device <NUM> with minimal hardware and processing capabilities can serve as an extension to or an add on device to a mobile device <NUM> of a customer during a shopping trip at a store. The portable device <NUM> acts as a wireless scanner or wireless peripheral device of the mobile device <NUM> during the shopping trip. This permits the customer to use two hands to handle items while shopping and populating item entries in their virtual shopping cart.

It should be appreciated that where software is described in a particular form (such as a component or module) this is merely to aid understanding and is not intended to limit how software that implements those functions may be architected or structured. For example, modules are illustrated as separate modules, but may be implemented as homogenous code, as individual components, some, but not all of these modules may be combined, or the functions may be implemented in software structured in any other convenient manner.

Furthermore, although the software modules are illustrated as executing on one piece of hardware, the software may be distributed over multiple processors or in any other convenient manner.

The above description is illustrative, and not restrictive. Many other embodiments will be apparent to those of skill in the art upon reviewing the above description. The scope of embodiments should therefore be determined with reference to the appended claims.

Claim 1:
A device, comprising:
a wireless transceiver (<NUM>);
an image sensor (<NUM>);
a processor (<NUM>);
non-transitory computer-readable storage medium (<NUM>) comprising executable instructions; and
the executable instructions when executed by the processor (<NUM>) cause the processor (<NUM>) to perform operations comprising:
establishing (<NUM>) a wireless connection with a mobile device (<NUM>); and
relaying (<NUM>) item codes captured by the image sensor (<NUM>) to the mobile device (<NUM>) over the wireless connection;
characterised in that: the device further comprises
a status light (<NUM>);
wherein the executable instructions when executed by the processor (<NUM>) cause the processor (<NUM>) to perform operations comprising:
controlling (<NUM>,<NUM>) illumination of the status light (<NUM>) based on statuses associated with the wireless connection and the image sensor (<NUM>);
wherein the executable instructions when executed by the processor (<NUM>) cause the processor (<NUM>) to perform additional operations comprising:
capturing (<NUM>) metrics for the item codes, length of time associated with the wireless connection, and the statuses; and
storing the metrics in storage of the device.