Smart shelf system

The present invention describes a shelf system for monitoring items coupled with support utilities. The system is configured to detect item change caused by customer actions and optimize the camera system and computing resources of a remote server. The system also is configured to sense certain visual indicators with customer actions.

BACKGROUND OF THE INVENTION

This application relates to systems, methods, devices, and other techniques for a smart shelf of monitoring items coupled with support utilities. The system is configured to detect items addition, removal or change caused by customer actions and optimizes computing resources of a remote server. The system is also configured to sense items that are removed, added or misplaced automatically. The system also can coordinate the shelf, camera systems and LED lights to optimize shopping experience. The system also can utilize mirrors to widen the field of view of camera system.

Retail stores frequently display products on shelves for easy accessibility by customers. A shelf may be attached to a wall, a shelf, a stand, or any other surface. Typically, one or more products or items are placed on a shelf. A shelf sometimes includes a label or other signage indicating the name or type of items placed on a shelf. Customers can frequently remove, add or change items on a shelf.

Therefore, it is desirable to have a shelf system that is configured to detect actions caused by customer actions and optimize the camera system and computing resources of a remote server. Also it is beneficial to have the system sense items that are removed, added or misplaced automatically. Also it is beneficial to have LED lights blinking to guide customers based on their previous choices and some predetermined patterns.

SUMMARY OF THE INVENTION

This application relates to systems, methods, devices, and other techniques for a smart shelf of monitoring items coupled with support utilities. The system is configured to detect items addition, removal or change caused by customer actions and optimizes computing resources of a remote server. The system is also configured to sense items that are removed, added or misplaced automatically. The system also can coordinate the shelf, camera systems and LED lights to optimize shopping experience. The system also can utilize mirrors to widen and deepen the field of view of camera system.

In some embodiments, the invention is related to a shelf system that can improve shopping experiences, comprising: at least one smart shelf, wherein a set of load sensors are placed on each corner of the at least one smart shelf, wherein the set of load sensors are configured to measure load data placed at the each corner of the at least one smart shelf; a data processing device coupled to the set of load sensors, wherein the data processing device is configured to calculate weight and change in weight by combining the load data from the each corner of the at least one smart shelf, wherein the data processing device is configured to determine location of an item removed or placed by calculating the location based on changes of load data at the each corner of the at least one smart shelf; a set of cameras coupled to the shelf system, wherein the set of cameras is configured to capture video information of the item on the at least one smart shelf; a set of indicators coupled to the shelf system, wherein each of the set of indicators is placed under each item coupled to the shelf system, wherein the each of the set of indicators is configured to blink when the each item above the each of the set of indicators is removed; and a remote server coupled to the data processing device and the set of cameras via a network, wherein the remote server is configured to use computational resources to process the video information from the set of cameras, wherein the remote server is configured to receive information of the location of the item removed or placed from the data processing device, wherein the remote server is configured to prioritize computational resources to any cameras of the set of cameras with a view of the location of the item removed or placed from the data processing device. In some embodiments, the shelf system has the network that is connected by Ethernet.

In some embodiments, the set of load sensors, the set of cameras and the set of cameras are using power over Ethernet.

In some embodiments, the invention may describe a shelf system, comprising: at least one smart shelf, wherein a set of load sensors are placed on each corner of the at least one smart shelf, wherein the set of load sensors are configured to measure load data placed at the each corner of the at least one smart shelf; a data processing device coupled to the set of load sensors, wherein the data processing device is configured to calculate weight and change in weight by combining the load data from the each corner of the at least one smart shelf, wherein the data processing device is configured to determine location of an item removed or placed by calculating the location based on changes of load data at the each corner of the at least one smart shelf; a set of cameras coupled to the shelf system, wherein the set of cameras is configured to capture video information of the item on the at least one smart shelf; a remote server coupled to the data processing device and the set of cameras via a network, wherein the remote server is configured to use computational resources to process the video information from the set of cameras, wherein the remote server is configured to receive information of the location of the item removed or placed from the data processing device, wherein the remote server is configured to prioritize computational resources to any cameras of the set of cameras with a view of the location of the item removed or placed from the data processing device; a set of visual indicators coupled to the at least one smart shelf, wherein the set of visual indicators are coupled to blink to identify the geo-location of the at least one smart shelf, wherein the set of visual indicators are configured to blink pre-determined patterns to convey digital data to the remote server via the set of cameras, wherein one type of the digital data is unique ID of the at least one smart shelf, wherein the unique ID is related to the physical location of the at least one smart shelf, wherein the set of visual indicators are configured to direct a shopper to a specific item the shopper has purchased before, or an item on the shopper's request, or an item that has a special discount.

In some embodiments, the shelf system has the network that is connected by Ethernet.

In some embodiments, the set of load sensors, the set of cameras and the set of cameras are using power over Ethernet.

In some embodiments, the invention may describe a shelf system, comprising: at least one smart shelf, wherein a set of load sensors are placed on each corner of the at least one smart shelf, wherein the set of load sensors are configured to measure load data placed at the each corner of the at least one smart shelf; a data processing device coupled to the set of load sensors, wherein the data processing device is configured to calculate weight and change in weight by combining the load data from the each corner of the at least one smart shelf, wherein the data processing device is configured to determine location of an item removed or placed by calculating the location based on changes of load data at the each corner of the at least one smart shelf; a set of cameras coupled to the shelf system, wherein the set of cameras is configured to capture video information of the item on the at least one smart shelf, whereas another shelf contains a mirror on the another shelf s bottom, where the at least one smart shelf has a camera of the set of cameras pointing up at the mirror of the another shelf, with a field of view of any items on the at least one smart shelf; a remote server coupled to the data processing device and the set of cameras via a network, wherein the remote server is configured to use computational resources to process the video information from the set of cameras, wherein the remote server is configured to receive information of the location of the item removed or placed from the data processing device, wherein the remote server is configured to prioritize computational resources to any cameras of the set of cameras with a view of the location of the item removed or placed from the data processing device, wherein a video image processing algorithm is used to identify the products removed, added or misplaced, wherein changes in weight are used to increase the confidence of identification of the products removed, added or misplaced. a set of visual indicators coupled to the at least one smart shelf, wherein the set of visual indicators are coupled to blink to identify the geo-location of the at least one smart shelf, wherein the set of visual indicators are configured to blink pre-determined patterns to convey digital data to the remote server via the set of cameras, wherein one type of the digital data is unique ID of the at least one smart shelf, wherein the unique ID is related to the physical location of the at least one smart shelf, wherein the set of visual indicators are configured to direct a shopper to a specific item the shopper has purchased before, or an item on the shopper's request, or an item that has a special discount.

In some embodiments, the shelf system has the network that is connected by Ethernet.

In some embodiments, the set of load sensors, the set of cameras and the set of cameras are using power over Ethernet.

These and other aspects, their implementations and other features are described in details in the drawings, the description and the claims.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1shows an example diagram of a shelf system100for autonomously monitoring items.

In some implementations, the system100comprises a shelf support105. In some embodiments, a shelf support can be represented as a board having a regular pattern of holes for inserting shelves, used chiefly for display of items or products. In some embodiments, a shelf support can be any means to attach multiple shelves with items for sale.

In some embodiments, the system comprises a shelf110. In some embodiments, a shelf can be any shape of solid surface that items or products can be put on. In some embodiments, a shelf is attached physically to the shelf support105. In some embodiments, multiple shelves are attached to the shelf support105. In some embodiments, various computer chips, various sensors, different circuitry and other components may attach to the shelf110.

In some embodiments, the load cells115are coupled to the shelf110. In some embodiments, the load cells comprises different sensors, such as motion detecting sensors, force sensors, load sensors, weight sensors, light sensors and other sensors. In some embodiments, the load cells comprise processors. In some embodiments, the load cells comprise communication units. In some embodiments, the communication units are wireless communication units. In some embodiments, the communications units are wired communication units. In some embodiments, load cells are coupled to the remote server130by a device processing device140via communication unit or units.

In some embodiments, item120is placed on the shelf110. In some embodiments, In some embodiments, multiple items are placed on the shelf110.

In some embodiments, there are multiple shelves similar to the shelf110are coupled to the shelf support105.

In some embodiments, the system may also includes the following features: camera system145coupled to the remote server, wherein the camera system145is configured to have a field of view of the shelf110, item120and other items, wherein the set of camera system145is used to track location information of a set of shoppers and item120and other items.

In some embodiments, a set of indicators150are coupled to the shelf system, wherein each of the set of indicators is placed under each item coupled to the shelf system, wherein the each of the set of indicators is configured to blink when the each item above the each of the set of indicators is removed. In some embodiments, the camera system145is configured to view both item120and indicator150.

In some embodiments, the system comprises: A shelf system, comprising: at least one smart shelf110, wherein a set of load sensors115are placed on each corner of the at least one smart shelf, wherein the set of load sensors are configured to measure load data placed at the each corner of the at least one smart shelf; a data processing device140coupled to the set of load sensors, wherein the data processing device is configured to calculate weight and change in weight by combining the load data from the each corner of the at least one smart shelf, wherein the data processing device is configured to determine location of an item120removed or placed by calculating the location based on changes of load data at the each corner of the at least one smart shelf; a set of cameras145coupled to the shelf system, wherein the set of cameras is configured to capture video information of the item on the at least one smart shelf; a set of indicators150coupled to the shelf system, wherein each of the set of indicators is placed under each item coupled to the shelf system, wherein the each of the set of indicators is configured to blink when the each item above the each of the set of indicators is removed; and a remote server130coupled to the data processing device and the set of cameras via a network, wherein the remote server is configured to use computational resources to process the video information from the set of cameras, wherein the remote server is configured to receive information of the location of the item removed or placed from the data processing device, wherein the remote server is configured to prioritize computational resources to any cameras of the set of cameras with a view of the location of the item removed or placed from the data processing device.

In some embodiments, the network is connected by Ethernet. in some embodiments, the set of load sensors, the set of cameras and the set of cameras are using power over Ethernet.

FIG. 2shows an example diagram of a shelf with load cells.

In some embodiments, a shelf210has load cell A220at any of the shelf210corner.

In some embodiments, a shelf210has load cell A220and load cell B230at any two of the shelf210corner.

In some embodiments, a shelf210has load cell A220, load cell B230and load cell C240at any three of the shelf210corner.

In some embodiments, a shelf210has load cell A220, load cell B230, load cell C240, and load cell D250at any four of the shelf210corner.

In some embodiments, load cells, including load cell A220, load cell B230, load cell C240, and load cell D250can detect loads put on the shelf210and sense locations of items put on the shelf.

FIG. 3shows another example diagram of example diagram of a shelf system for autonomously monitoring items.

In some implementations, in some implementations, the system300comprises a shelf support305. In some embodiments, a shelf support can be represented as a board having a regular pattern of holes for inserting shelves, used chiefly for display of items or products.

In some embodiments, the system comprises a shelf310. In some embodiments, a shelf can be any shape of solid surface that items or products can be put on. In some embodiments, a shelf is attached physically to the shelf support305. In some embodiments, multiple shelves are attached to the shelf support305. In some embodiments, various computer chips, various sensors, different circuitry and other components may attach to the shelf310.

In some embodiments, the load cells315are coupled to the shelf310. In some embodiments, the load cells comprises different sensors, such as motion detecting sensors, force sensors, load sensors, weight sensors, light sensors and other sensors. In some embodiments, the load cells comprise processors. In some embodiments, the load cells comprise communication units. In some embodiments, the communication units are wireless communication units. In some embodiments, the communications units are wired communication units. In some embodiments, load cells are coupled to the remote server330by a device processing device340via communication unit or units.

In some embodiments, item320is placed on the shelf310. In some embodiments, multiple items are placed on the shelf310.

In some embodiments, there are other shelves similar to the shelf310are coupled to the shelf support305.

In some embodiments, a set of indicators350are coupled to the shelf system, wherein each of the set of indicators is placed under each item coupled to the shelf system, wherein the each of the set of indicators is configured to blink when the each item above the each of the set of indicators is removed.

In some embodiments, another shelf370is placed above shelf310. Another shelf370is also coupled to the shelf support305. A mirror or mirrors380is coupled to the another shelf370. A camera system345coupled to the shelf310and has a field of view of item320and indicator350via the mirror380. Wider and deeper field of view of the camera system345can be achieved by the mirror380.

In some embodiments, the shelf system300comprises: at least one smart shelf310, wherein a set of load sensors315are placed on each corner of the at least one smart shelf, wherein the set of load sensors are configured to measure load data placed at the each corner of the at least one smart shelf a data processing device340coupled to the set of load sensors, wherein the data processing device is configured to calculate weight and change in weight by combining the load data from the each corner of the at least one smart shelf, wherein the data processing device is configured to determine location of an item320removed or placed by calculating the location based on changes of load data at the each corner of the at least one smart shelf; a set of cameras345coupled to the shelf system, wherein the set of cameras is configured to capture video information of the item on the at least one smart shelf, whereas another shelf370contains a mirror380on the another shelf's bottom, where the at least one smart shelf has a camera of the set of cameras345pointing up at the mirror of the another shelf370, with a field of view of any items on the at least one smart shelf; a remote server330coupled to the data processing device and the set of cameras via a network, wherein the remote server is configured to use computational resources to process the video information from the set of cameras, wherein the remote server is configured to receive information of the location of the item removed or placed from the data processing device, wherein the remote server is configured to prioritize computational resources to any cameras of the set of cameras with a view of the location of the item removed or placed from the data processing device, wherein a video image processing algorithm is used to identify the products removed, added or misplaced, wherein changes in weight are used to increase the confidence of identification of the products removed, added or misplaced; and a set of visual indicators350coupled to the at least one smart shelf310, wherein the set of visual indicators350are coupled to blink to identify the geo-location of the at least one smart shelf, wherein the set of visual indicators are configured to blink pre-determined patterns to convey digital data to the remote server via the set of cameras, wherein one type of the digital data is unique ID of the at least one smart shelf, wherein the unique ID is related to the physical location of the at least one smart shelf, wherein the set of visual indicators are configured to direct a shopper to a specific item the shopper has purchased before, or an item on the shopper's request, or an item that has a special discount.

In some embodiments, the network is connected by Ethernet. In some embodiments, the set of load sensors, the set of cameras and the set of cameras are using power over Ethernet.