# Patent

## Title
VLC location data applications in a retail setting

## Abstract

A retail merchandising system includes a plurality of gondolas positioned in a retail space, a plurality of visible light communication (VLC) sources positioned in the retail space, and at least one VLC sensor disposed at a fixed location relative to each of the plurality of gondolas. The plurality of VLC sources and the at least one VLC sensor are configured to cooperatively identify a location of the gondolas in the retail space. With pre-stored planograms and the locations of the store gondolas, product locations can be readily determined.

## Background
CROSS-REFERENCES TO RELATED APPLICATIONS
(NOT APPLICABLE)
STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT
(NOT APPLICABLE)
BACKGROUND OF THE INVENTION
The invention relates to VLC location data applications in a retail setting and, more particularly, to the use of VLC location technology and pre-stored planogram information to identify product locations and provide customer content.
Networks of devices and algorithms may be used to locate dedicated receivers and/or mobile devices within buildings. Indoor positioning is regarded as a key component of location-aware mobile computing, which refers to applications that utilize a user's location to provide content relevant to the location.
Global Positioning Systems (GPS) lose significant power when passing through construction materials and suffer from multi-path propagation effects that make them unsuitable for indoor environments. Techniques based on received signal strength indication (RSSI) from WiFi and Bluetooth® wireless access points have also been explored. However, indoor environments can cause radio waves to propagate in dynamic and unpredictable ways, limiting the accuracy of positioning systems based on RSSI.
Visible light communication (VLC) is a data communications medium that uses visible light between 400 and 800 THz (780-375 nm). VLC is a subset of optical wireless communications technologies. The technology uses fluorescent lamps (ordinary lamps, not special communications devices) to transmit signals at 10 kb/s, or LEDs for up to 500 Mb/s.
Specially designed electronic devices generally containing a photodiode can receive signals from light sources. A cell phone camera or a digital camera is a satisfactory signal receiver. There also exist dedicated receivers designed specifically for this purpose.
In a retail establishment, especially “big box” retail, it is not uncommon for a store map to be derived from construction plans generated from a CAD program or the like. It is difficult to account for changes or updates made during construction, and as a consequence, store maps may not be accurate enough to cooperate with VLC location technology (which can be accurate to within a few inches or less).
BRIEF SUMMARY OF THE INVENTION
An aisle in a retail store may be defined by back to back shelves (facing adjacent aisles) and end caps at both ends of each shelf combination. This shelf and end cap assembly is typically referred to as a gondola. The products on the shelves may be arranged according to a predefined planogram. If the retail establishment knows the location of the gondolas and it also knows where the products are (or should be) on the shelves based on the planograms, the system can identify exactly where a particular product is in the store.
The system of the preferred embodiments identifies the locations of the gondolas using VLC technology. In an exemplary application, a VLC sensor is affixed at each of four corners of the gondola, and these sensors provide detailed location data to the system in the form of x and y coordinates. The system then accesses pre-stored planogram information to determine product locations based on the detected corners of the gondola. In an alternative embodiment, a single VLC sensor may be used and location data may be extrapolated.
The VLC source(s) may also be accessed by an app on a customer's mobile phone or by a mobile device on a shopping cart. The app could use the mobile phone built-in camera or some other sensor array. The system can use the customer location in the store in combination with product locations to provide location-based content to the customer.
In an exemplary embodiment, a retail merchandising system includes a plurality of gondolas positioned in a retail space, a plurality of visible light communication (VLC) sources positioned in the retail space, and at least one VLC sensor disposed at a fixed location relative to each of the plurality of gondolas. The plurality of VLC sources and the at least one VLC sensor are configured to cooperatively identify a location of the gondolas in the retail space. The VLC sources may be overhead lights in the retail space. The system may include four VLC sensors respectively positioned at four corners of each of the plurality of gondolas. The VLC sources and the VLC sensors may define the location of the gondolas in terms of x and y coordinates relative to boundaries of the retail space.
In one arrangement, a system server communicating with the VLC sources and the VLC sensors is programmed to process data received from the VLC sensors to identify the location of the gondolas. In this context, each of the gondolas may define at least one aisle, and the system server may store at least one planogram for each aisle. The system server may be programmed to identify a product location of a specific product in the retail space based on the location of the gondolas and the planograms. A customer mobile device may be configured to receive signals from the VLC sources, where the system server may be programmed to determine a location of the customer mobile device and to communicate with the customer mobile device. The system server may be programmed to identify product information based on the location of the customer mobile device and the planograms, where the system server communicates the product information to the customer mobile device. The product information may be a product discount or special offer.
In another exemplary embodiment, a method of operating a retail establishment using visual light communication (VLC) technology includes the steps of (a) positioning a plurality of gondolas in the retail establishment; (b) positioning a plurality of VLC sources in the retail establishment; (c) positioning at least one VLC sensor at a fixed location relative to each of the plurality of gondolas; and (d) identifying a location of the gondolas in the retail space based on signals from the VLC sources and the at least one VLC sensor. Step (c) may be practiced by positioning four VLC sensors at respective four corners of each of the plurality of gondolas. Step (d) may be practiced by defining the location of the gondolas in terms of x and y coordinates relative to boundaries of the retail establishment. The method may additionally include storing planogram information in a system server, and identifying a product location of a specific product in the retail space based on the location of the gondolas and the planogram information. With a customer mobile device configured to receive signals from the VLC sources, the method may further include determining a location of the customer mobile device and communicating with the customer mobile device. The method may still further include identifying product information based on the location of the customer mobile device and the planogram information, and communicating the product information to the customer mobile device. The method may also include determining or updating a layout of the retail establishment stored in the system server based on the location of the gondolas.
In yet another exemplary embodiment, a system includes a plurality of gondolas positioned in a retail space, where the plurality of gondolas are aligned in rows and define shopping aisles between them; a plurality of visible light communication (VLC) sources positioned in the retail space; and a VLC sensor disposed at each of four corners of each of the plurality of gondolas. The plurality of VLC sources and the at least one VLC sensor are configured to cooperatively identify a location of the gondolas in the retail space. A system server communicating with the VLC sources and the VLC sensors stores planograms of the products placed in the shopping aisles. The system server may be configured to identify locations of the products in the retail space placed in the shopping aisles based on the locations of the gondolas and the planograms.



BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects and advantages will be described in detail with reference to the accompanying drawings, in which:
FIG. 1 is a schematic block diagram of an exemplary VLC location service system; and
FIG. 2 is a schematic illustration of an exemplary gondola in a retail establishment.



DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a block diagram illustrating an example of a visible light communication (VLC) location service system 10 in accordance with preferred embodiments of the disclosed technology. The system 10 includes multiple VLC-modulated sources 12 that are stationed within an establishment and each configured to send a location signal containing the location of the corresponding VLC source. The VLC sources 12 are preferably implemented as overhead lights such that the transmitted light emanates downward onto the users, e.g., customers or customers in a store, as well as each user's mobile device 14 and any dedicated receivers 16 positioned in the establishment. In the exemplary system, a system server 18 may communicate with the mobile device 14 and/or the dedicated receivers 16 over a wireless communication channel, e.g., using Wi-Fi.
In some embodiments, with reference to FIG. 2, aisles in a retail store may be defined by back to back shelves (facing adjacent aisles) 20 and end caps 22 at both ends of each shelf combination 20. This shelf and end cap assembly 20, 22 may be referred to as a gondola 24. A gondola may alternatively include a single shelf array 20 and/or just one or none of the end caps 22.
Retail establishments may utilize planograms to define where and in what quantity products are placed on the shelves. A planogram is a visual representation of a store's products on the shelves. Product positioning may be important for merchandising, marketing, customer familiarity, and the like. In some embodiments, the planograms typically include enough detail such that if the store knows the location of the gondolas, the store also knows where the products are (or should be) on the shelves. As such, the location of a particular product in the store can be nearly exactly identified once the locations of the gondolas 24 are identified. Retail planograms 19 may be stored in the system server 18.
With continued reference to FIG. 2, in some embodiments, it is desirable to determine the exact location (i.e., within a few inches) of the gondolas using VLC technology. In an exemplary application, a VLC sensor 26 is affixed at each of four corners of the gondola 24, and these sensors 26 provide detailed location data, preferably in the form of x and y coordinates relative to a boundary area defined by the store walls. In some embodiments, the origin or (0,0) point for the x and y coordinates may be defined by one of the building corners, e.g., the far left corner of the building from the store entrance. Pre-stored planogram information may be accessed to determine product locations based on the detected corners of the gondola 24. In an alternative embodiment, a single VLC sensor 26 may be used and location data may be extrapolated. For example, by using a specialized capture application/program that allows for the input of an aisle number, and prompting the user to collect location data, a single device can be used to capture the respective corners of each gondola. This collection process could be further refined so that along with capturing the aisle number, where only one location scan would be necessary, say at the front of the aisle, given that scan angle is also captured, gondola lengths are also known from system data. As a consequence, by knowing the angle and length of the gondola, the system can systemically calculate the location of products on the gondola.
Embodiments of the disclosed technology may be implemented in virtually any type of indoor location or establishment (e.g., a large retail store) that has a number of lighting sources (e.g., lamps or overhead lighting). In certain embodiments, each user, e.g., customer, within the establishment has his or her own mobile device 14 that can be either their own personal smartphone, tablet device, or other handheld electronic device, or an establishment-owned portable device (e.g., a tablet computing device that may be attached to a shopping cart). For example, customers may each carry their own mobile device with them as they travel around a store shopping.
Certain embodiments of the disclosed technology include highly accurate indoor location tracking technology using VLC location signal messages. In terms of physical properties such as range and directivity, VLC characteristics are favorable in terms of delivering indoor location based content with very high accuracy (e.g., within a few inches or less). Such location information can be used for or in connection with discovering a number of useful parameters such as user dwell-times and shopping direction. Communication with a mobile device over a wireless technology other than VLC may be achieved by tagging VLC location-related information to messages.
In certain embodiments, each VLC source may transmit a unique ID announcing its fixed location. A customer's mobile device can be equipped with a VLC receiver such as a photo-diode or photo-sensor array. VLC-enabled light sources may be placed throughout the store and, as the customer moves about the store, the VLC-enabled mobile device may receive one or more location signals that may serve to identify a location of the user's mobile device.
Certain embodiments include the delivery of content to a user that is immediately relevant to the user, e.g., content that translates typically to items that are within the user's and, thus, his or her mobile device's immediate proximity. Such content may be delivered to the user's mobile device as the user walks by specific items in a store or to display appropriate customer-specific content on fixed digital signage screens within the store as he or she walks up to or near each one, for example. VLC location precision can be controlled by deploying an appropriate number of sources and being highly directional in order to deliver high accuracy location information. In this context, the system server 18 can deliver content with regard to items within the customer's immediate proximity based on the location of the gondola 24 relative to the customer and the nearby products determined from the planogram data 19. That is, the system server 18 utilizes the customer location in combination with the locations of the gondolas 24 and the planogram data 19 to identify products within the customer's immediate proximity.
In certain embodiments, it is possible to know the location of user mobile devices and also to communicate with them using an appropriate wireless technology, e.g., WiFi. To enable this, a special packet can be constructed that combines location-related information gathered via VLC technology with the unique address/identifier of the mobile device. For example, location based content may be enabled from the infrastructure or other mobile devices to be delivered over WiFi, in which case the mobile device can tag its WiFi MAC address or local IP address along with the location information gathered via VLC technology. This may enable other devices/infrastructure to know the mobile device location and communicate with the mobile device using an appropriate wireless technology, thus complementing the VLC location tracking capability with the communications capability of virtually any other wireless technology.
Certain implementations may include guiding the customer inside the store to particular item or service. For example, the user's mobile device can act as an indoor global positioning system (GPS) to help guide the user to a specific section or to a specific product in a grocery store.
With the system and methods according to the preferred embodiments, retail product locations can be accurately identified based on gondola locations detected using VLC technology and pre-stored planogram data. The VLC technology is also applicable to mobile devices such as user mobile phones, shopping cart mounted devices, and the like. The system is thus capable of driving content to users based on their location within an establishment.
While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

## Claims

1. A retail merchandising system comprising:
a plurality of gondolas positioned in a retail space;
a plurality of visible light communication (VLC) sources positioned in the retail space;
at least one VLC sensor disposed at a fixed location relative to each of the plurality of gondolas, the plurality of VLC sources and the at least one VLC sensor being configured to cooperatively identify a location of the gondolas in the retail space; and
a system server communicating with the VLC sources and the VLC sensors, wherein the system server is programmed to process data received from the VLC sensors to identify the location of the gondolas and a scan angle by the at least one VLC sensor, wherein each of the gondolas defines at least one aisle, wherein the system server stores a planogram for each aisle and a length of each aisle, and wherein the system server is programmed to identify a product location of a specific product in the retail space based on the length of the gondolas, the scan angle, and the planograms.

2. A retail merchandising system according to claim 1, wherein the VLC sources comprise overhead lights in the retail space.

3. A retail merchandising system according to claim 1, comprising four VLC sensors respectively positioned at four corners of each of the plurality of gondolas.

4. A retail merchandising system according to claim 1, wherein a customer mobile device is configured to receive signals from the VLC sources, wherein the system server is programmed to determine a location of the customer mobile device and to communicate with the customer mobile device.

5. A retail merchandising system according to claim 4, wherein the system server is programmed to identify product information based on the location of the customer mobile device and the planograms, the system server communicating the product information to the customer mobile device.

6. A retail merchandising system according to claim 5, wherein the product information comprises a product discount or special offer.

7. A system comprising:
a plurality of gondolas positioned in a retail space, the plurality of gondolas aligned in rows and defining shopping aisles between them;
a plurality of visible light communication (VLC) sources positioned in the retail space;
a VLC sensor disposed at each of four corners of each of the plurality of gondolas, the plurality of VLC sources and the VLC sensors being configured to cooperatively identify a location of the gondolas in the retail space; and
a system server communicating with the VLC sources and the VLC sensors, the system server storing planograms of the products placed in the shopping aisles, wherein the system server is configured to identify locations of the products in the retail space placed in the shopping aisles based on the locations of the gondolas and the planograms.

8. A system according to claim 7, wherein a customer mobile device is configured to receive signals from the VLC sources, wherein the system server is programmed to determine a location of the customer mobile device and to communicate with the customer mobile device.

9. A system according to claim 8, wherein the system server is programmed to identify product information based on the location of the customer mobile device and the planograms, the system server communicating the product information to the customer mobile device.