Interactive display case

An interactive display case having a first frame, a plurality of storage areas within the first frame, a second frame, and processing circuitry. The processing circuitry is configured to detect an object passing through the interior of the second frame, identify an area within the interior of the second frame in which the object passes, where the area corresponding to one of the storage areas, and generate interaction data corresponding to the identified area.

BACKGROUND

In stores, numerous products are displayed on shelves, in glass cases, on peg boards, etc. Consumers typically enter a retail store and browse the selection of products shown on the display cases. Some products include their own packaging having additional information about the products, but even that information is limited to the size of the product package. Further, this information may not be fully up to date as it was created before distribution of the product.

SUMMARY OF THE INVENTION

An interactive display case having a first frame, a plurality of storage areas within the first frame, a second frame, and processing circuitry. The processing circuitry is configured to detect an object passing through the interior of the second frame, identify an area within the interior of the second frame in which the object passes, where the area corresponding to one of the storage areas, and generate interaction data corresponding to the identified area.

Further described is a storage system, a multi-touch sensing frame and processing circuitry to execute special purpose software. The multi-touch sensing frame detects when a hand passes through and outputs coordinates for the hand's location. These coordinates are processed by the circuitry with respect to a digital representation of the storage system layout. Through a process of iteration over all storage areas, the processing circuitry determines and outputs interaction data based on the coordinate data and digital representation, as well as the time that the interaction took place.

DETAILED DESCRIPTION

FIGS. 1A, 1B, and 1Cillustrate an interactive display case100, or display case100, according to one example. The display case100includes a frame101, storage units or storage areas112allocated within the frame101, a display device114and a sensing frame109.

The frame101can be any type of shelving system, product display case, hanging product display case, temperature controlled display case, and any other type of container that can store and display products for consumers to view as would be understood by one of ordinary skill in the art. The storage areas112can be distributed equally within the frame101of the display case100or may be sized differently according to a planogram layout of products within the display case100.

The frame101includes a top panel102, a bottom panel104, a first side panel106and a second side panel107. The frame101also includes a plurality of vertical panels108secured to the top panel102and bottom panel104, and a plurality of horizontal panels110disposed between the vertical panels108and/or side panels106,107and secured to the vertical panels108and/or side panels106,107. The top panel102, bottom panel104, side panels106,107, horizontal panels110, and vertical panels108combine to form a plurality of storage areas112. In one example, the storage areas112can be designed to store one or more products such as clothing or accessories. In some examples, the frame101may include a rear wall103(seeFIG. 16which is a rear view of the display case100) to enclose the back of the plurality of storage areas112in order to prevent products from falling out of the rear of the frame or to present a pleasing background behind the displayed products. In some aspects described herein, such as inFIG. 2C, the rear wall may be the display device114.

The horizontal panels110can be secured to the vertical panels108and/or side panels106,107using any method known in the art including using nails, screws, brackets, pins, adhesive, slot and grooves, and so forth. The horizontal panels110can be placed at any vertical height along the vertical panels108and/or side panels106,107to create larger or smaller storage areas112or to create storage areas112of varying size within a single frame101. In other aspects, the frame101may consist of only horizontal panels110that are connected to a rear wall. The number of horizontal panels110can be increased to create more storage areas112or decreased to create fewer storage areas112.

Alternatively, the frame101can be a hanging product display case. The hanging product display case may not have horizontal panels110or vertical panels110disposed between the top panel102, bottom panel104, and side panels106,107. Instead, the hanging product display case may include peg board and hooks to hang products on. Alternatively, the frame101can include a combination of horizontal and vertical panels for product storage and a peg board or other structures for hanging products.

The display device114is an electronic display unit connected to processing circuitry, such as that of a computer, which controls the display device114. The display device114is preferably a touch-sensing display unit as would be understood by one of ordinary skill in the art.

Alternatively, the frame101can include a single storage area112formed by the inner surfaces of the top panel102, bottom panel104, and side panels106,107or multiple unenclosed storage areas112. The one or more storage areas112may include pegs or hooks used to hang products on an inner surface of the top panel104and/or side panels106,107, shelves connected to the rear wall of the frame101and/or the enclosed storage areas illustrated inFIG. 1A. Therefore, various types of storage areas112are contemplated and can be arranged in a variety of different combinations.

For example,FIG. 1Cillustrates an interactive display case100having a variety of different storage areas. In this example, the frame101does not include any enclosed storage areas as illustrated inFIG. 1Abut rather includes shelved storage areas and pegs with hooks for holding various products. Therefore, the term storage area112represents a particular location or area within the frame101that stores a certain product. Thus, in this example, the frame101includes three storage areas112that extend within X, Y and Z directions within the frame101.

FIG. 1Dillustrates the sensing frame109according to one example. The sensing frame can be applied to the interactive display case100and be of varying size such as with interactive display cases200,300described further herein. The sensing frame109can be attached to a front portion of the frame101but behind the outermost front portion of the frame101thereby allowing the sensing frame109to remain hidden to the user. Alternatively, the sensing frame could be affixed on the outermost front portion of the frame101. The sensing frame109includes an inner perimeter116, an outer perimeter115, a front surface118, and a rear surface (not shown). The inner perimeter116corresponds to the interior of the sensing frame109. The sensing frame109includes one or more sensors that allow the sensing frame109to detect a finger, hand or object passing through the plane of the sensing frame109into one of the storage areas112or contacting the display device114. The sensor can be any kind of sensor including, but not limited to, IR, sonar, laser, passive IR, microwave, ultrasonic, vibration, image sensors, and so forth.

In one example, the sensing frame109is an IR sensing frame such as the “TouchFrame” produced by U-Touch USA Inc™. For this type of touch panel, infrared technology consists of infrared light emitting diodes (LEDs) and light sensors that are placed on the perimeter of the sensing frame109. LEDs transmit beams of light that run parallel to an assigned light sensor to create a light grid. Any object that disrupts the light or reduces the light such as a finger or stylus will register as a touch and the sensors will distinguish coordinates within the sensing frame109at which the object passed within the inner perimeter116of the sensing frame109. Processing circuitry of the sensing frame109or a connecting computer can then process this information as described further herein to acquired data of the interaction and alter the content displayed on the display device114.

The outer perimeter115of the sensing frame109can be sized to correspond to the outer periphery of the frame101in order to give the overall device an integrated appearance. However, in some examples, the outer perimeter115of the sensing frame109can be larger or smaller than the outer periphery of the frame101. If outer perimeter115of the sensing frame109is larger than the outer periphery of the frame101, then the inner perimeter116of the sensing frame109is able to detect an object touching the front surface of the top panel102, bottom panel104, or side panels106,107of the frame101. Conversely, if the outer perimeter115of the sensing frame109is smaller or within than the outer of the frame101, then objects touching portions of the frame101outside of the periphery of the sensing frame109will not be detected by the sensing frame109. These portions of the frame101can be used to display additional products that are not included in the planogram layout or these portions can be used to store additional versions of products included in the planogram such as products of different colors, sizes, materials, etc. Therefore, the size of the sensing frame109can vary based on objectives for a particular interactive display case, based on reuse between frames and as a way to save on cost.

In certain aspects, the sensing frame109is affixed to periphery of the frame101such that the entire front surface area of the plurality of storage areas112is within the inner perimeter115of the sensing frame109. Therefore, in one example, the outer115and inner perimeters116of the sensing frame109match the outer and inner perimeter formed by the front edges of the top102, bottom104, and side panels106,107of the frame101so that the sensing frame109is flush with the outer and inner edge of the frame101and an object passing into any of the storage areas112can be detected.

Therefore, the sensing frame109includes a zone of detection (not shown) where the sensing frame109sensors are designed to detect movement within the zone of detection. This zone of detection corresponds to an area covered by the inner perimeter116of the sensing frame109. The zone of detection is technically a three dimensional zone, but the third dimension (thickness or depth) can be very small. Thus, the zone of detection can be substantially a two-dimensional plane within the inner perimeter116of the sensing frame109.

As discussed herein, if the sensing frame109detects an interruption of light from the LEDs caused by an object within the zone of detection of the sensing frame109, processing circuitry can detect the location within the inner perimeter116based on the sensor information and identify coordinates of this interaction. The sensing frame109can also detect and locate multiple objects passing through the zone of detection at the same time.

FIGS. 1A and 1Bshow the display device114located at the center of the frame101, but the display device114can be located anywhere on the frame101via rearrangement of the panels and thus a display device114of any size can be used in the invention.

FIG. 1Bshows the display device114abutting against the surfaces of the surrounding horizontal panels110and vertical panels108in order to maximize the storage space available on the frame101. In some aspects, there can be a gap between one or more outer edges of the display device114and the surrounding horizontal panels110and vertical panels108in order to vent and cool the display device114. Alternatively, the display device114can be left out of the interactive display case100entirely and an additional storage area112can be utilized within this space. In the case where the display device114is left out of the display case100, the display device114could be attached separately from the interactive display case100to perform the functions herein or could be left out of the system entirely. In either situation, the display case100will continue to function as described herein with respect to identifying interactions and storing data corresponding to the interactions.

Additionally,FIG. 1Ashows that the display device114is slightly set back from the front surfaces of the surrounding vertical panels108and horizontal panels110. This allows the sensing frame109to detect a hand, finger, or object moving past the plane of the sensing frame109and toward the display device114so that this interaction can be processed as described further herein. Preferably, the set back is large enough for the sensing frame109to detect that an object has moved entirely through the zone of detection, yet small enough that contact with the display device114is a practical certainty once the finger, hand, or object has moved through the sensing frame's zone of detection.

This set-back configuration allows the processing circuitry to detect when a user is about to touch the display device114. Detecting this event can trigger the processing circuitry can turn on the display device's114touch capabilities, wake the display device114from a screen saver or sleep mode, or cause the display device114to show touch-selection options to the user. The event detection can also increase the response time of the display device114by pre-emptively waking from sleep mode or some other power-saving mode. Further, data statistics can be saved that indicate frequency of usage of the touch screen and other data related to the touch interactions with the display device114. Similarly, display device114can send information with respect to specific touch interactions to the processing circuitry for data analysis and storage.

FIGS. 2A, 2B, and 2Cillustrate a second interactive display case200, or display case200, according to one example. The interactive display case200includes a frame201, sensing frame209, and display device214. Further, the interactive display case200includes temperature control unit216, such as a cooler having vents as would be understood by one of ordinary skill in the art, configured to maintain a selected temperature of the interactive display case200. Further, the interactive display case200may include a closeable front door (not shown) that seals the interactive display case200to maintain temperatures within the interactive display case200.

The frame201includes a top panel202, bottom panel204, first side panel106, and second side panel207which form the outer periphery of the frame. Not shown inFIGS. 2A and 2Bbut illustrated inFIG. 2Cis a horizontal panel210. Horizontal panels210are similar to the horizontal panels110described above. The side panels206,207include a plurality of holes211arranged in a vertical pattern and the holes211are designed to receive shelf mounting hardware such as nails, screws, pegs, brackets, etc. The horizontal panels210are designed to be mounted to the holes211using the shelf mounting hardware. Any number of panels210can be used in the interactive display case200and the horizontal panels210can be placed at any height to create a plurality of storage areas212.

As seen inFIGS. 2A, 2B and 2C, the display device214is mounted to the rear side of the frame201with the displaying surface of the display device214visible through the front of the frame201. This configuration allows products P3, P4to be placed on horizontal panels210with the display device214visible behind the products P3, P4.FIG. 2Cillustrates an example of products P3, P4placed on horizontal panel210in front of the display device214. In this example, the display device214displays content C related to the products P3, P4in the display case200. The processing circuitry can control the display device214to display products based on what is available within the interactive product display201and/or based on interactions detected by the sensing frame209.

Therefore, like with the interactive display case100, the display case200includes a sensing frame209configured to detect a finger, hand, or object passing through the sensing frame into a storage area212of the frame201. Thus, the sensing frame209is also configured to detect the location of any object passing through the frame. The sensing frame209can include any of the features described above and like description is omitted.

FIG. 3shows a third interactive display case300, or display case300, according to one example. Interactive display case300is similar to interactive display case100except that interactive display case300illustrates a larger size interactive display case having a different arrangement of storage areas312and display device314. All other components of the interactive display case300are substantially the same as in the interactive display case100described above. The individual elements of interactive display case300are not described, but all reference numbers refer to similar components described above with respect toFIG. 1and therefore like description is omitted.

InFIG. 3, it should be noted that the display device314is flush with the front most portion of the panels308,310. This provides a more integrated look and feel to provide an advantageous presentation to potential customers. It can also make the interactive display case300easier to construct.

As noted herein, each of interactive display cases100,200, and300is connected to or includes processing circuitry of computer architecture configured to detect interaction with the interactive display cases100,200,300via the sensing frame109,209,309and control the display device114,214,314based on the interaction. Moreover, processing circuitry configured to perform features described herein may be implemented in multiple circuit units (e.g., chips), or the features may be combined in circuitry on a single chipset, as shown onFIG. 4.

FIG. 4shows a schematic diagram of a data processing system400, according to certain examples, for controlling the interactive product display cases100,200,300as further described herein. The data processing system is an example of a computer in which code or instructions implementing the processes of the illustrative embodiments may be located.

InFIG. 4, data processing system400employs a hub architecture including a north bridge and memory controller hub (NB/MCH)425and a south bridge and input/output (I/O) controller hub (SB/ICH)420. The central processing unit (CPU)430is connected to NB/MCH425. The NB/MCH425also connects to the memory445via a memory bus, and connects to the graphics processor450via an accelerated graphics port (AGP). The NB/MCH425also connects to the SB/ICH420via an internal bus (e.g., a unified media interface or a direct media interface). The CPU Processing unit430may contain one or more processors and even may be implemented using one or more heterogeneous processor systems.

For example,FIG. 5shows one implementation of CPU530. In one implementation, the instruction register538retrieves instructions from the fast memory540. At least part of these instructions are fetched from the instruction register538by the control logic536and interpreted according to the instruction set architecture of the CPU430. Part of the instructions can also be directed to the register532. In one implementation the instructions are decoded according to a hardwired method, and in another implementation the instructions are decoded according a microprogram that translates instructions into sets of CPU configuration signals that are applied sequentially over multiple clock pulses. After fetching and decoding the instructions, the instructions are executed using the arithmetic logic unit (ALU)534that loads values from the register532and performs logical and mathematical operations on the loaded values according to the instructions. The results from these operations can be feedback into the register and/or stored in the fast memory540. According to certain implementations, the instruction set architecture of the CPU430can use a reduced instruction set architecture, a complex instruction set architecture, a vector processor architecture, a very large instruction word architecture. Furthermore, the CPU430can be based on the Von Neuman model or the Harvard model. The CPU530can be a digital signal processor, an FPGA, an ASIC, a PLA, a PLD, or a CPLD. Further, the CPU430can be an x86 processor by Intel or by AMD; an ARM processor, a Power architecture processor by, e.g., IBM; a SPARC architecture processor by Sun Microsystems or by Oracle; or other known CPU architecture.

Referring again toFIG. 4, the data processing system400can include that the SB/ICH420is coupled through a system bus to an I/O Bus, a read only memory (ROM) Y56, universal serial bus (USB) port464, a flash binary input/output system (BIOS)468, and a graphics controller458. PCI/PCIe devices can also be coupled to SB/ICH YYY through a PCI bus462.

The PCI devices may include, for example, Ethernet adapters, add-in cards, and PC cards for notebook computers. The Hard disk drive460and CD-ROM466can use, for example, an integrated drive electronics (IDE) or serial advanced technology attachment (SATA) interface. In one implementation the I/O bus can include a super I/O (SIO) device.

Further, the hard disk drive (HDD)460and optical drive466can also be coupled to the SB/ICH420through a system bus. In one implementation, a keyboard470, a mouse472, a parallel port478, and a serial port476can be connected to the system bust through the I/O bus. Other peripherals and devices that can be connected to the SB/ICH420using a mass storage controller such as SATA or PATA, an Ethernet port, an ISA bus, a LPC bridge, SMBus, a DMA controller, and an Audio Codec.

FIG. 6shows an example of cloud computing, having various devices interconnected to each other via a network and cloud infrastructures. For example, a smart phone614connecting to a mobile network service620through a satellite connection652can connect to the interactive display case100via the mobile network services620and the fixed terminal616connected to or included in the interactive display case100. Similarly,FIG. 6shows a PDS612and a cellular phone614connected to the mobile network service620through a wireless access point654, such as a femto cell or Wi-Fi network. Further,FIG. 6shows the data processing system400connected to the mobile network service620through a wireless channel using a base station656, such as an Edge, 3G, 4G, or LTE Network, for example. Various other permutations of communications between the types of devices and the mobile network service620are also possible, as would be understood to one of ordinary skill in the art. The various types of devices, such as the cellular phone614, tablet computer616, or a desktop computer, can also access the network640and the cloud630through a fixed/wired connection, such as through a USB connection to a desktop or laptop computer or workstation that is connected to the network640via a network controller, such as an Intel Ethernet PRO network interface card from Intel Corporation of America, for interfacing with a network.

Signals from the wireless interfaces (e.g., the base station656, the wireless access point654, and the satellite connection652) are transmitted to and from the mobile network service620, such as an EnodeB and radio network controller, UMTS, or HSDPA/HSUPA. Requests from mobile users and their corresponding information as well as information being sent to users is transmitted to central processors622that are connected to servers624providing mobile network services, for example. Further, mobile network operators can provide services to the various types of devices. For example, these services can include authentication, authorization, and accounting based on home agent and subscribers' data stored in databases626, for example. The subscribers' requests can be delivered to the cloud630through a network640.

As can be appreciated, the network640can be a public network, such as the Internet, or a private network such as an LAN or WAN network, or any combination thereof and can also include PSTN or ISDN sub-networks. The network640can also be a wired network, such as an Ethernet network, or can be a wireless network such as a cellular network including EDGE, 3G and 4G wireless cellular systems. The wireless network can also be Wi-Fi, Bluetooth, or any other wireless form of a communication that is known.

The various types of devices can each connect via the network640to the cloud630, receive inputs from the cloud630and transmit data to the cloud630. In the cloud630, a cloud controller636processes a request to provide users with corresponding cloud services. These cloud services are provided using concepts of utility computing, virtualization, and service-oriented architecture. For example, data from the system400such as statistical data with respect to user interactions with the interactive display case100,200,300can be sent via the network640to the cloud630for storage in data storage638, processing by the data center634and later retrieval. Data from the cloud630can be accessed by the system400based on user interaction and pushed to user devices610,612, and614.

The cloud630can be accessed via a user interface such as a secure gateway632. The secure gateway632can, for example, provide security policy enforcement points placed between cloud service consumers and cloud service providers to interject enterprise security policies as the cloud-based resources are accessed. Further, the secure gateway632can consolidate multiple types of security policy enforcement, including, for example, authentication, single sign-on, authorization, security token mapping, encryption, tokenization, logging, alerting, and API control. The cloud630can provide, to users, computational resources using a system of virtualization, wherein processing and memory requirements can be dynamically allocated and dispersed among a combination of processors and memories such that the provisioning of computational resources is hidden from the users and making the provisioning appear seamless as though performed on a single machine. Thus, a virtual machine is created that dynamically allocates resources and is therefore more efficient at utilizing available resources. A system of virtualization using virtual machines creates an appearance of using a single seamless computer even though multiple computational resources and memories can be utilized according increases or decreases in demand. The virtual machines can be achieved using a provisioning tool640that prepares and equips the cloud-based resources such as a processing center634and data storage638to provide services to the users of the cloud630. The processing center634can be a computer cluster, a data center, a main frame computer, or a server farm. The processing center634and data storage638can also be collocated.

FIG. 7illustrates a flow chart detailing functionality of the interactive display cases100,200,300according to one example. For simplicity sake, a description ofFIG. 7will be with respect to the interactive display case100but a similar description would apply for interactive display cases200and300. At step S700, the processing circuitry or CPU430of the system400generates a planogram layout of products that will be stored or placed in the storage areas112of the interactive display case100. This planogram maps products within the interactive display case100to various coordinates within the interior perimeter116of the sensing frame109. These coordinates correspond to the various storage areas112of the frame101. This planogram layout is then saved into the memory of the system400and/or cloud630for later retrieval and analysis by the system400. The planogram layout can be generated/updated at the system400itself or remotely via network640. Thus, updated planogram layouts may be received locally at the system400or remotely via cloud630. The planogram could also be generated based on inputs received by the system400via the sensing frame109. As such, a user could interact with each storage area112within the frame101for which products are stored and for each interaction the sensing frame109could detect corresponding coordinates. These coordinates by themselves or with a multiplier can then be used by the system400to generate the planogram layout of the frame101having the detected storage areas112. Alternatively, a user could trace the perimeter of each storage area112by using their finger and having the system400identify this perimeter and update the planogram based on data from the sensing frame109.

At step S702, the sensing frame109detects whether or not there is an interaction of an object with the sensing frame109. In other words, the sensors of the sensing frame109determine whether or not an object has passed through an interior perimeter of the sensing frame109. If no interaction is detected at step S702, the system400will take no action other than to continue to poll for future interactions. If an interaction is detected at step S702, the process proceeds to step S704to determine if more than one object is detected for the interaction.

If only one object is detected (i.e. the sensors of the sensing frame109only detect the interruption of the LEDs at one location within the inner perimeter109), the system400proceeds to step S706to match the location at which the object was detected to the planogram layout. In this case, at step S708, the system400analyzes the coordinates of the detected object within the inner perimeter116based on the sensor readings and maps this location to the planogram layout to identify which product a user may be interested in within a specific storage area112. It is possible that the coordinates of the detected object can overlap with more than one storage area112. In this case, the system400can identify which storage area112the user intended based on one or more factors. The factors can include a determination of which area contains the largest portion of the object passing through the interior of the sensing frame109,209,309. Other factors can include past interactions of the user stored on the cloud630or within a predetermined period of time of interaction as well as information as to whether the storage area112contains a product or not. Using one or more of these factors, the processing circuitry identifies a single storage area112corresponding to the object interaction. Alternatively, the system400may detect multiple storage areas112for further processing. Also, at this time, the system400records the time of interaction along with the identified storage area(s)112and product(s) corresponding to the storage area(s)112.

Once the system400identifies this information and based on the number of storage areas112identified, the system400can cause the display device114to display the product on the display device114which represents the location of the interaction within the inner perimeter116of the sensing frame109and corresponds to the planogram coordinate mapping of the storage areas112stored in memory. Thus, at step S710, the system400causes the display device114to display product information relating to the product the user was interested in via pointing to the product through the sensing frame109or actually interacting with the product by passing their hand or another object through the sensing frame109. If the product is no longer available in the storage area112as noted by the system400via an updated planogram mapping and/or a weighting sensor located in the storage area, the system400may provide information to the user about products relating to a product that was previously displayed in the particular storage area112of interest. Further, if the interaction is very brief and less than a predetermined period of time as detected by the sensors109, the system400can determine not to display any information on the display device114with respect to the detected location and planogram-mapped storage area112.

It is worth noting that the planogram layout can map products to the plurality of storage areas112and that this mapping is based on coordinates within the frame101of the interactive display case100. Thus, in the case where the display case100,200,300has products hanging on pegs and/or singular shelves within the frame such as inFIG. 1C, the planogram layout can map those areas the same as previously discussed herein to a particular set of coordinates or area within the sensing frame109. In other words, the storage area112can be an area in which a product is hanging from a peg or hook such that the storage area112represents the area within the frame101in which a plurality of coordinates of that area are mapped to the planogram to represent the location of one or more products. Further, the planogram can be updated in real-time based on interactions with the display case100. For example, products detected as being taken out of the frame101can be used to generate inventory data. Further, products being placed back into the frame can be identified to generate the data described below or to identify if they are placed in a different spot. This could be done by using RFID tags on the clothing to track these exchanges and/or using weight sensors within the frame101in conjunction with the system400.

At step S712, the system400generates data and time information of the interaction and records the date and time of the interaction in memory of the system400and/or memory in the cloud630. For example, the amount of interactions with particular storage areas112and thus particular products can be saved to memory to provide statistical data to retailers. Data with respect to how long the interaction took place can also be saved to provide information as to customer interest levels. Further, information about products that are interacted with and sensed by the sensing frame109can cause the system400to provide the customer with information relating to these products in addition to visual information via the display device114. For example, the system400can push this information to user devices610,612,614via the network640and mobile network services620. Alternatively, the user may interact with the display device114via touch, voice or any other method to seek information about the product or related products. Examples of such data are included inFIGS. 12 and 13. The data can also include interactions with the display device114. All of this data can be saved locally at the system400or transmitted by the system400to the cloud630via network640for remote storage at data storage638and analysis by processing center634.

Further, it should be noted here that if the interactive display case100,200,300does not include a display device114,214,314, the above-noted processing is the same except that step S710is omitted. Also, it should be noted that Steps S710and S712can be reversed such that interaction data can be generated and stored before anything is displayed on the display device.

Referring back to step S704, if more than one object is detected passing through the sensing frame109, the system similarly proceeds at step S708to map the detected coordinates of the interaction within the inner perimeter116of the sensing frame109to the mapped planogram to identify a plurality of products that the user may be interested in which are located in correspondingly located storage areas112. The system400then at step S710causes at least one of these objects to be displayed on the display device114. In one example, the system400may cause both products to be display on the display device114. However, this can vary based on a variety of factors. For example, the system400may identify that one interaction with the frame101only lasted for a minimum predetermined period of time such that the system400will ignore this interaction. Alternatively, the system400may know that the product in a particular storage area112is no longer there based on an updated planogram mapping and/or a weighting sensor built into the storage areas112. In this instance, the system400would not cause this particular object to be displayed. Further, the system400may display both products but display one with more prominence based on historical information with respect to a specific user. This information can be stored on the system400or cloud630based on previous interactions by the user. The user can be identified by the system400polling user devices610,612and614via the network630and mobile network services620.

FIG. 8provides an example of an interaction of a user with the interactive display case100according to one example. In this example, the user has passed his hand H within the inner perimeter116of the sensing frame109to touch a product P1. The sensors of the sensing frame109detect this interaction and provide the system400with coordinates of the interaction. The system400processes these coordinates and maps them to a corresponding storage area112based on the planogram mapping. Based on this interaction, the system400then causes the display device to change the current display to display content C1related to the product P1. In this case, the user interacted with a box having information related to a particular meal. Therefore, the user merely by having an interaction with the box can discover additional information about the product via the display device114. For instance, the display device114can identify the price, contents and other advertising material with respect to the produce P1. The display device114could also show the interior materials within the box thereby preventing the user from having to open the box and providing retailers and distributors with enhanced product security and durability. If the user then moved his hand H to another storage area112and passed his hand H through the interior perimeter116of the sensing frame109, the system400would then process the detected coordinates, map them to the mapped planogram and cause the display device to display different information with respect to the newly selected product.

Further, if a second object is detected by the sensing frame109while a first content is being displayed on the display device114the system400can control the display device114to continue showing the first content and queue the content related to the second product; stop showing the first content and show only the content related to the second product; continue showing the first content and show the second content in split screen or a separate window; and/or depending on which product is touched, the system400can disregard detection of the second object and not cause any additional content to be displayed. The owner can specify any of these actions using the planogram layout software discussed further below.

Additionally, the interactive display case100can include a sensor (not shown) configured to detect when a consumer is present in the area in front of the interactive display case100,200,300. If the sensor detects that a consumer is no longer in front of the interactive display case100,200,300, the processing circuitry can control the display device114,214,314to return to a stand-by screen. Further, by including a sensor configured to detect when a consumer is present in the area in front of the interactive display case100,200,300, accidental product touching caused by wind, shopping carts, or other objects can be detected and will not cause product content to be displayed on the display device114,214,314. For example, if no consumer is present in front of the display device114,214,314and stray shopping cart bumps into a product on the interactive display case100,200,300, the processing circuitry will ignore the sensor's object detection and not display product content.

FIG. 9shows one interface to planogram software according to one example. The software may be executed by the system400and provide the user with an interface with respect to planogram generation. This screen shows access to a list of all the designs45that have been uploaded by a client currently logged in. The user may upload a new planogram to the system or may perform other actions46on the uploaded planogram, such as deleting a planogram or viewing its analytics and/or redesigning the layout of the planogram with respect to different interactive display cases.

FIG. 10shows another interface to the planogram software according to one example. The screen shows data associated with a given planogram and allows the user to edit it. Specifically, it shows the planogram name52, the name of the layout file53and the name of style file54. It also allows the user to edit any number of parameters or fields55in the given planogram layout. Once changes are made, the user may save50or duplicate51the planogram layout. This information can then be displayed on the display device114when a user interacts with a storage area114having the product related to the specific parameters.

FIG. 11shows a third interface to the planogram layout software according to one example. This screen allows the logged-in user to see all the in-store display units by store location63. It also enables the user to create a new store location60and to perform actions upon that store display61. One major feature of this screen is that it allows the user to assign a given planogram layout64to a specific store. The user may also group stores together and then assign the group a given planogram layout all at once. Once this assignment is made, the in-store display will automatically download and switch over to the new planogram layout.

FIG. 12shows a fourth interface to the planogram layout software according to one example. This screen displays the monitoring system. It allows a logged-in user to view all data associated with a given interactive display case. In particular, one may access the analytics71for an interactive display case. The user may also assign the planogram layout for the interactive display case72. The screen also shows the current state of the interactive display case, including the state of the software and the timing of various system events. The screen also allows the user to see live video74from a sensor in the display device so they can view the current state of the interactive display case. The user may also save70any changes they make to the display settings on this screen. The above-noted information may be stored on the system400or can be accessed on the cloud630via the network640.

FIG. 13shows a fifth interface to the planogram layout software according to one example. This screen displays the analytics data associated with a given interactive display case. The user may select a planogram layout80and then choose a store81where that planogram layout is active. They may also choose to view the results of a given planogram layout across multiple stores. The user may set the timing82for the duration of analytics data that they would like to view. Upon making the choices above, the logged-in user will be presented with a graph83or other visualizations showing analytics data, including data about how often a given product is touched and how often a given button is touched. The user may also export84this data for viewing in and processing by another software application.

FIGS. 14-34illustrate the interactive display cases100,200,300with products P1, P2, P3, etc. and content C1, C2, C3, etc. related to the products displayed on the display devices114,214,314. For example,FIGS. 14 and 15illustrate the interactive display case100in which two products P1and P2are located in storage areas112but product P1has been interacted with and is thus displayed as content C1on display device114. This is similar toFIGS. 21 and 22showing products P3and P4but product P3being displayed as content C on display device214based on product interaction with product P3.FIGS. 28 and 29similarly illustrate products P5and P6with the display device314displaying product P6as content C6based on interaction with product P6.FIGS. 14-34also illustrate various views of each interactive display case from the front, back, bottom, top and sides all of which have been described herein and thus further description is omitted.

The combination of features described above provides a more advanced interactive display case which is not inhibited by requiring image-capture sensors, a clear line of sight to the products, or any other deficiency in the prior art. Further, the interactive display cases having the sensing frame provide an integrated unit that is cheaper to manufacture, easier to assemble and takes less retail space. This makes it cheaper for owners to implement the interactive display case in stores while also making it easier for retailers to accept the setup. Further, the sleek look and design of the interactive display cases naturally attracts customers who want to interact with the display case and learn more about potential product. This leads to additional sales and brand recognition. Further, the statistical data affords companies and retailers with highly coveted user data so that future products, planogram layouts and product distribution can be specifically targeted to increase sales. This data was not easily obtainable in the past as it was difficult to capture in-store interactions with products. Receipt data may provide some insight as to likes and dislikes but this does not fully capture all shopping information based on what products users may have interacted with but not purchased. This additional data can be combined with purchase data to generate useful metrics and target data for consumers.

Exemplary implementations include:A. A display case comprising:a first frame;a plurality of storage areas within the first frame;a second frame; andprocessing circuitry configured todetect an object passing through the interior of the second frame,identify an area within the interior of the second frame in which the object passes, the area corresponding to one of the storage areas, andgenerate interaction data corresponding to the identified area.B. The display case of Claim A, wherein the frame further includes:a top panel,a bottom panel opposed to the top panel,a first side panel secured to the top panel and bottom panel,a second side panel, opposed to the first side panel, and secured to the top panel and bottom panel,at least one horizontal panel, andat least one vertical panel,wherein the top panel, bottom panel, side panels, at least one horizontal panel, and at least one vertical panel combine to form the plurality of storage areas therebetween.C. The display case of Claim A, wherein at least one of the plurality of storage areas extend along a width of the frame.D. The display case of Claim A, whereinthe second frame includes sensors configured to detect an interaction within the interior of the second frame, andthe processing circuitry detects the object passing through the interior of the second frame and identifies the area based on data from the sensors.E. The display case of Claim A, further comprising:memory configured to store layout information corresponding to the plurality of storage areas,wherein the processing circuitry generates the interaction data as a function of layout information corresponding to the identified area.F. The display case of Claim E, further comprising:an interface,wherein the processing circuitry receives updated layout information via the interface.G. The interactive display case of Claim F, wherein the interface is a network interface.H. The display case of Claim A, wherein the processing circuitry is further configured to transmit the interaction data to an external device.I. The display case of Claim A, wherein the processing circuitry is further configured to transmit the interaction data to an external device.J. The interactive display case of Claim A, further comprising:a display device affixed to the first frame,wherein the processing circuitry controls the display device in response to the detection of the object passing through the interior of the second frame.K. The display case of Claim J, further comprising:memory configured to store layout information corresponding to the plurality of storage areas,wherein the processing circuitry is further configured to control the display device to display content based on layout information corresponding to the identified area.L. The display case of Claim J, wherein the display device is located at a rear side of the frame such that content displayed on the display device is viewed through at least one of the storage areas.M. The display case of Claim E, wherein the layout information includes information identifying at least one of the dimensions of each storage area, an object stored within each storage area, and object data of each product.N. The display case of Claim A, wherein a size of the inner perimeter of the second frame is the same size as the inner perimeter of the first frame.O. The display case of Claim A, wherein the second frame is affixed to the first frame.P. The display case of Claim A, further comprising:memory,wherein the processing circuitry is configured to store the interaction data in the memory each time an object is detected as passing through the interior of the second frame.Q. The display case of claim O, wherein the processing circuitry only stores the interaction data if the detected object passing through the interior of the second frame is detected for a predetermined period of time.R. A method comprising:detecting, via processing circuitry, an object passing through the interior of a first frame of an interactive display case,identifying, via the processing circuitry, an area within the interior of the first frame in which the object passes, the area corresponding to one of a plurality of storage areas within a second frame of the interactive display case, andgenerating, via the processing circuitry, interaction data corresponding to the identified area.S. A non-transitory computer-readable medium having stored thereon computer-readable instructions which when executed by a computer cause the computer to perform a method comprising:detecting an object passing through the interior of a first frame of an interactive display case,identifying an area within the interior of the first frame in which the object passes, the area corresponding to one of a plurality of storage areas within a second frame of the interactive display case, andgenerating interaction data corresponding to the identified area.