Data reduction for generating heat maps

Techniques of collecting and displaying data include mapping user interaction data having multiple components (or, dimensions) to a plurality of buckets representing a set of values of each of the components. When a user causes a computer to generate user interaction data by interacting with an object on an electronic display, the computer performs a mapping of the many components of the user interaction data to a plurality of buckets. Each bucket represents a set of values of the user interaction data. The number of buckets is far smaller than the number of possible data points. Accordingly, rather than individual, multidimensional data points being transmitted to another computer that compiles the user interaction data into heat maps, a relatively small number of bucket identifiers are transmitted. In this way, the analysis of the user interaction data requires minimal resources and can take place in real time.

TECHNICAL FIELD

This description relates to the generation of heat maps in real-time, data-intensive environments.

BACKGROUND

Some applications that provide advertisements on electronic displays are configured to collect user behavior data with regard to the advertisements. For example, an advertisement on an electronic device may display an image of an object. Conventional data collection applications may track certain types of user interactions such as a user rotating the object or translating the object on a display of the electronic device.

SUMMARY

In one general aspect, a method can include receiving, by processing circuitry of a first computer, target object data representing a target object displayed on a display. The method can also include receiving, by the processing circuitry, user interaction data, each user interaction datum of the user interaction data representing a value of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on the target object with which a user interacted at an instant of time. The method can further include performing, by the processing circuitry, a mapping operation to map the user interaction data to a plurality of buckets, each of the plurality of buckets representing a respective set of values of the user interaction parameter and having a respective bucket identifier. The method can further include sending, by the processing circuitry, the bucket identifier to a second computer configured to generate a heat map overlaid on a copy of the target object, the heat map being based on frequencies of bucket identifiers received by the second computer over a specified period of time.

In another aspect, a computer program product can comprise a non-transitory storage medium, the computer program product including code that, when executed by processing circuitry of a first computer, causes the processing circuitry to perform a method, the method comprising receiving target object data representing a target object displayed on a display; receiving user interaction data, each user interaction datum representing a value of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on the target object with which a user interacted at an instant of time; performing a mapping operation to map the user interaction data to a plurality of buckets, each of the plurality of buckets representing a respective combination of intervals of the plurality of components of the user interaction parameter and having a respective bucket identifier; and sending the bucket identifier to a second computer configured to generate a heat map juxtaposed on a copy of the target object, the heat map being based on frequencies of bucket identifiers received by the second computer over a specified period of time.

In another aspect, an electronic apparatus can comprise memory; and controlling circuitry coupled to the memory, the controlling circuitry being configured to receive target object data representing a target object displayed on a display; receive user interaction data, each user interaction datum of the user interaction data representing a value of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on the target object with which a user interacted at an instant of time; perform a mapping operation to map the user interaction data to a plurality of buckets, each of the plurality of buckets representing a respective set of values of the user interaction parameter and having a respective bucket identifier; and send the bucket identifier to a second computer configured to generate a heat map overlaid on a copy of the target object, the heat map being based on frequencies of bucket identifiers received by the second computer over a specified period of time.

In another general aspect, a method can include receiving, by processing circuitry of a computer, a plurality of bucket identifiers, each of the plurality of bucket identifiers corresponding to a respective set of values of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on a target object with which a user interacted at an instant of time, coordinates of a position of a camera configured to image the target object, and angular coordinates representing an orientation of a camera configured to image the target object. The method can also include performing, by the processing circuitry, a mapping operation to map each of the plurality of bucket identifiers to respective values of the user interaction parameter. The method can further include generating, by the processing circuitry, a heat map on a display device, the heat map based on the values of the user interaction parameter.

In another aspect, a computer program product can comprise a non-transitive storage medium, the computer program product including code that, when executed by processing circuitry of a computer, causes the processing circuitry to perform a method, the method comprising receiving a plurality of bucket identifiers, each of the plurality of bucket identifiers corresponding to a respective set of values of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on a target object with which a user interacted at an instant of time, coordinates of a position of a camera configured to image the target object, and angular coordinates representing an orientation of a camera configured to image the target object; performing a mapping operation to map each of the plurality of bucket identifiers to respective values of the user interaction parameter; and generating a heat map on a display device, the heat map based on the values of the user interaction parameter.

In another aspect, an electronic apparatus can comprise memory; and controlling circuitry coupled to the memory, the controlling circuitry being configured to receive a plurality of bucket identifiers, each of the plurality of bucket identifiers corresponding to a respective set of values of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on a target object with which a user interacted at an instant of time, coordinates of a position of a camera configured to image the target object, and angular coordinates representing an orientation of a camera configured to image the target object; perform a mapping operation to map each of the plurality of bucket identifiers to respective values of the user interaction parameter; and generate a heat map on a display device, the heat map based on the values of the user interaction parameter.

DETAILED DESCRIPTION

In accordance with the implementations described herein, improved techniques of collecting and displaying data in real time include mapping user interaction data having multiple components (or, dimensions) to a plurality of buckets representing a combination of intervals of each of the components. When a user causes a computer to generate user interaction data by interacting with an object on an electronic display, the computer performs a mapping of the many components of the user interaction data to a plurality of buckets. Each bucket represents a combination of intervals of components of the user interaction data. The number of buckets is far smaller than the number of possible data points. Accordingly, rather than individual, multidimensional data points being transmitted to another computer that compiles the user interaction data into heat maps, a relatively small number of bucket identifiers are transmitted. In this way, the analysis of the user interaction data requires minimal resources and can take place in real time.

For example, a user observing a three-dimensional target object representing a car on a display may be more interested in the portion of the car corresponding to the hood than in other parts. When the user interacts with this target object, the user may click on the portion of the target object corresponding to the hood more often than on other portions of the target object. The user may also orient the target object to get a different perspective of the hood. Further, the user may change a scale of the target object to focus on various details of the hood (e.g., the shape, an ornament). Between position, orientation, and scale, there are seven components to the user interaction data. Moreover, in some implementations, the user can also change perspective, or from what direction the target object is viewed, in the form of a camera. The camera may be described as having a position relative to the target object, an orientation, and a field of view (FOV). Accordingly, in this case there are 14 components to the user interaction data and thus the user interaction data is 14-dimensional. Nevertheless, this high-dimensional data may be organized into a few hundred or a few thousand discrete buckets. Accordingly, rather than send an enormous amount of raw user interaction data, the improved techniques allow for each datum to be represented by a bucket identifier that identifies a best-fit bucket for that user interaction datum.

Upon receipt of the bucket identifiers that best fit the user interaction data, an advertising computer performs an approximate inverse map from the bucket identifier to a point on the target object and a perspective. The advertising computer then juxtaposes a heat map of the mapped points for each perspective to a heat map, with each color representing a frequency of that point. In some implementations, the heat map can vary with perspective. In this way, an advertiser who produced the target object can get detailed information about which parts of the target object were of most interest to users.

The term bucket can refer to at least a set of values of a multi-dimensional parameter defining the user interaction data. In some implementations, when a multidimensional space of all or at least a portion of possible parameter values lies in a volume of that multidimensional space, a bucket can refer to a subvolume of the multidimensional space of such parameter values. In some implementations, the plurality of buckets used can correspond to a small (e.g., a very small) portion of the volume in multidimensional space. Nevertheless, the user interaction data may mostly or entirely occupy that small portion of the volume. In some implementations, the user interaction data may be divided into ranges, or intervals, of parameter values. In such implementations, each bucket may correspond to a combination of intervals, or ranges of the parameter values.

FIG.1is a diagram that illustrates an example electronic environment100in which the above-described improved techniques may be implemented. As shown, inFIG.1, the example electronic environment100includes a user computer120.

The user computer120is configured to collect user interaction data and map that user interaction data to discrete buckets. In some embodiments, one or more of the components of the user computer120can be, or can include processors (e.g., processing units124) configured to process instructions stored in the memory126. Examples of such instructions as depicted inFIG.1include a target object acquisition manager130, a user interaction acquisition manager140, a setup manager150, and a mapping manager160. Further, as illustrated inFIG.1, the memory126is configured to store various data, which is described with respect to the respective managers that use such data.

The mapping manager160is configured to map user interaction data142to respective bucket identifiers156to produce mapped bucket data162. The mapping manager160includes a quantization manager162. The quantization manager162is configured to generate a fit metric that indicates a goodness of fit between a user interaction datum142and a bucket identified by a bucket identifier156and representing a combination of intervals of the components of the user interaction parameter. In some implementations, the metric is a mean square error. In some implementations, the metric is a mean absolute error. In some implementations, the metric is a minimax value.

The setup manager150is configured to generate bucket data152representing the buckets into which the values of the user interaction parameter, represented by the user interaction data142, are sorted. In some implementations, the setup manager150is configured to generate the bucket data152by establishing ranges, or bounds, for each component of the user interaction parameter, dividing each component into set of values (e.g., intervals or combinations of intervals) based on the ranges, and combining a respective of some or all of the components to produce user parameter values154. In some implementations, the setup manager150establishes intervals by generating a bounding volume about the target object. In some implementations, the setup manager150establishes set of values of the user parameter by defining ranges of triplets of Euler angles at each position of the camera (e.g., on the unit sphere). In some implementations, the set of values are generated according to a random process (e.g., an output of a random number generator). In some implementations, the set of values are generated according to a systematic process (e.g., Latin hypercubes).

The user parameter values154that correspond to respective bucket identifiers156do not necessarily include all possible combinations of intervals of all of the components of the user interaction parameter. In this way, the number of buckets may be held to a relatively small number, e.g., 100, 200, 500, 1000, 10000, and so on. The buckets are selected so as to provide a good approximation of the raw user interaction data142in order that heat maps of the user interaction data142based on the bucket identifiers156are a good representation of how the user interacts with the target object.

The target object acquisition manager130is configured to acquire target object data132associated with a target object (not shown inFIG.1) from various sources. For example, in some implementations, the target object is a three-dimensional object represented on a two-dimensional display of a display device. A source of such a target object may be another computer (e.g., a web server hosting a website associated with an advertising campaign or a game) connected to the user computer120over a network. In such implementations, the target object may be displayed in a browser window displayed on a display device180. In some implementations, a source of the target object data132is a local disk drive (e.g., a flash drive, a disk drive, and the like).

The target object data132represents the target object as displayed on an electronic display. In some implementations, the target object data132includes polygons and/or polyhedra arranged to form a three-dimensional object. In some implementations, the target object takes the form of a point cloud. In some implementations, the target object data132is in a compressed format using schemes such as entropy encoding, run-length the like. In some implementations, when the user computer120is used to process a virtual reality (VR) or augmented reality (AR) environment, the target object data132is formatted for use in the VR or AR environment, respectively.

For example, a VR environment is a software construct in which a user may interact with computer-generated, three-dimensional objects over a 360-degree, computer-generated visual field. An AR environment is a software construct in which a user may interact with computer-generated objects that are overlaid with real objects in the visual field of the user. In VR, the target object data132may then be a three-dimensional, computer-generated object in a VR environment. In AR, the target object data132may then be a three-dimensional, computer-generated object or a real object in an AR environment. In a VR system, the display180may take the form of a head-mounted display (HMD). In an AR system, the display180may take the form of transparent or semitransparent goggles.

The user interaction acquisition manager140is configured to acquire user interaction data142from an input/output (I/O) device used by a user. For example, when the user is interacting with the target object represented by the target object data132, the user may click a mouse on various points on the target object as displayed on a display device. Using the mouse, the user may also move the position and/or orientation of the target object as displayed on the display device by dragging a cursor over the target object using the mouse. In some implementations, when the target object data is formatted for use in a VR or AR environment and the user computer120is used to process the VR or AR environment, the I/O device takes the form of a VR or AR controller.

The user interaction acquisition manager140is configured to receive, in response to each mouse click, VR or AR movement or other I/O event, user interaction data142. For example, the user interaction data may represent a state of a digital environment as displayed on a display device (e.g., a monitor, a head-mounted device in a VR system, a transparent, head-mounted display in an AR system). The state is represented as a user interaction parameter having multiple components. Each component of the user interaction parameter can represent a coordinate of a point on the target object, an orientation of the target object with respect to a coordinate system defined in the space of the display device, a scale of the target object within the space of the display device, components of a camera orientation from which the target object is viewed, and so on. In response to an I/O event, the user computer120receives a value of the user interaction parameter with the coordinate of the point on the target object being the point at which the cursor appears on the target object when the user initiates the I/O event (e.g., clicks a mouse).

In some implementations, the user interaction manager140is configured to receive the user interaction data142, representing new values of the user interaction parameter, at regular time intervals. For example, when the target object data132is acquired from a web server, the website hosted on the web server may provide instructions (e.g., via a browser script) to the computer120to collect user interaction data132at each specified period of time, e.g., every 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1.0 seconds, and the like.

The user interaction data142represents values of the user interaction parameter described above. The user interaction data142contains multiple components. As shown inFIG.1, the user interaction data142includes object position data143, object orientation data144, object scale data145, camera position data146, camera orientation data147, and camera field of view (FOV) data148. In some implementations, the user interaction data142may include other components such as coordinates of an occluding object that occludes the target object from the camera. In some implementations, the user interaction data142includes an occluding percentage of the target object that the occluding object occludes.

The object position data143represents points on the target object at which the user interacted with the target object as described above (e.g., via mouse clicks). In some implementations, the object position data143includes values of three coordinates (x, y, z) in a Cartesian coordinate system defined with respect to an origin in the space of the display device. In some implementations, the coordinates are defined in a different coordinate system (e.g., a cylindrical coordinate system, a spherical coordinate system, a prolate spheroidal coordinate system, an oblate spheroidal coordinate system, and so on). In some implementations, when the target object is two-dimensional, the object position data143includes values of two coordinates. In some implementations, the object position data143includes three additional coordinates corresponding to a translation of the object with respect to an initial position of a center of the object with respect to the origin of the coordinate system.

The object orientation data144represents an orientation of the object with respect to coordinate axes of the coordinate system in which the object position data143are defined. In some implementations, the object orientation data144includes a triplet of Euler angles (φ, θ, ψ) with respect to the coordinate axes. In some implementations, the object orientation data144includes a triplet of direction cosines. In some implementations, the object orientation data144includes polar and azimuth angles in a spherical coordinate system.

The object scale data145represents an overall size of the target object as displayed on the display device with respect to an initial size of the target object. In some implementations, the object scale data145includes a scalar quantity so that the change in size of the target object is the same in all directions. In some implementations, the object scale data145has multiple components, corresponding to a situation in which the change in size of the target object is different in different directions.

The camera position data146represents a position with respect to a coordinate system of a camera by which the image of the object s presented on the display device, and in some implementations within a browser window. The camera itself is a simulation of an actual camera through which the user sees the target object from a particular perspective. In some implementations, the camera position data146includes values of three coordinates (x, y, z) in a Cartesian coordinate system defined with respect to an origin. In some implementations, the coordinates are defined in a different coordinate system (e.g., a cylindrical coordinate system, a spherical coordinate system, a prolate spheroidal coordinate system, an oblate spheroidal coordinate system, and so on). In some implementations, the camera position data146includes three additional coordinates corresponding to a translation of the object with respect to an initial position of a center of the object with respect to the origin of the coordinate system. In some implementations, the camera is at a fixed distance with respect to a point on the target object (or an origin of the coordinate system). In such an implementation, the camera position data146includes two coordinates representing a position on a unit sphere.

The camera orientation data147represents an orientation of the camera as described above with respect to a local coordinate system. In some implementations, the local coordinate system has an origin at the point represented by the camera position data146. In some implementations, the camera orientation data147includes a triplet of Euler angles (φ, θ, ψ) with respect to the local coordinate axes. In some implementations, the camera orientation data147includes a triplet of direction cosines. In some implementations, the camera orientation data147includes polar and azimuth angles in a spherical coordinate system.

The camera FOV data148represents an angular extent over which the camera defined above captures an image. For example, a camera with a small FOV may need to be at a large distance from the target object to capture the extent of the target object. A camera with a large FOV, in contrast, may be at a small distance from the target object to capture the extent of the target object. In some implementations, the camera FOV data148includes a single angle (e.g., in degrees or radians). In some implementations, the camera FOV data148includes two angles, each angle corresponding to a respective axial direction. (For example, the FOV is the sagittal direction may be different than the FOV in the tangential direction.)

The user computer120includes a network interface122, one or more processing units124, memory126, and a display interface128. The network interface122includes, for example, Ethernet adaptors, Token Ring adaptors, and the like, for converting electronic and/or optical signals to electronic form for use by the user computer120. The set of processing units124include one or more processing chips and/or assemblies. The memory126includes both volatile memory (e.g., RAM) and non-volatile memory, such as one or more ROMs, disk drives, solid state drives, and the like. The set of processing units124and the memory126together form control circuitry, which is configured and arranged to carry out various methods and functions as described herein.

In some implementations, the memory126can be any type of memory such as a random-access memory, a disk drive memory, flash memory, and/or so forth. In some implementations, the memory126can be implemented as more than one memory component (e.g., more than one RAM component or disk drive memory) associated with the components of the user computer120. In some implementations, the memory126can be a database memory. In some implementations, the memory126can be, or can include, a non-local memory. For example, the memory126can be, or can include, a memory shared by multiple devices (not shown). In some implementations, the memory126can be associated with a server device (not shown) within a network and configured to serve the components of the user computer120.

The components (e.g., modules, processing units124) of the user computer120can be configured to operate based on one or more platforms (e.g., one or more similar or different platforms) that can include one or more types of hardware, software, firmware, operating systems, runtime libraries, and/or so forth. In some implementations, the components of the user computer120can be configured to operate within a cluster of devices (e.g., a server farm). In such an implementation, the functionality and processing of the components of the user computer120can be distributed to several devices of the cluster of devices.

The components of the user computer120can be, or can include, any type of hardware and/or software configured to process attributes. In some implementations, one or more portions of the components shown in the components of the user computer120inFIG.1can be, or can include, a hardware-based module (e.g., a digital signal processor (DSP), a field programmable gate array (FPGA), a memory), a firmware module, and/or a software-based module (e.g., a module of computer code, a set of computer-readable instructions that can be executed at a computer). For example, in some implementations, one or more portions of the components of the user computer120can be, or can include, a software module configured for execution by at least one processor (not shown). In some implementations, the functionality of the components can be included in different modules and/or different components than those shown inFIG.1.

Although not shown, in some implementations, the components of the user computer120(or portions thereof) can be configured to operate within, for example, a data center (e.g., a cloud computing environment), a computer system, one or more server/host devices, and/or so forth. In some implementations, the components of the user computer120(or portions thereof) can be configured to operate within a network. Thus, the components of the user computer120(or portions thereof) can be configured to function within various types of network environments that can include one or more devices and/or one or more server devices. For example, the network can be, or can include, a local area network (LAN), a wide area network (WAN), and/or so forth. The network can be, or can include, a wireless network and/or wireless network implemented using, for example, gateway devices, bridges, switches, and/or so forth. The network can include one or more segments and/or can have portions based on various protocols such as Internet Protocol (IP) and/or a proprietary protocol. The network can include at least a portion of the Internet.

In some embodiments, one or more of the components of the user computer120can be, or can include, processors configured to process instructions stored in a memory. For example, the target object acquisition manager130(and/or a portion thereof), the user interaction application manager140(and/or a portion thereof), the setup manager150(and/or a portion thereof), and the mapping manager160can be a combination of a processor and a memory configured to execute instructions related to a process to implement one or more functions.

FIG.2is a diagram that illustrates an example electronic environment200in which the above-described improved techniques may be implemented. As shown, inFIG.2, the example electronic environment200includes a user computer220.

The user computer220is configured to receive bucket identifier data and generate heat maps based on the bucket identifier data. In some embodiments, one or more of the components of the user computer120can be, or can include processors (e.g., processing units224) configured to process instructions stored in the memory226. Examples of such instructions as depicted inFIG.2include a bucket identifier acquisition manager230, a mapping acquisition manager240, and a heat map manager250. Further, as illustrated inFIG.1, the memory226is configured to store various data, which is described with respect to the respective managers that use such data.

The mapping manager240is configured to map the bucket identifier data232to approximate, or mapped, user interaction data242. In some implementations, the mapping process performed by the mapping manager240may be performed by a lookup table. In some implementations, when the bucket identifier data232includes additional information about the raw data (e.g., subinterval information), then the mapping manager240may produce the mapped user interaction data242via additional means (e.g., interpolation techniques).

The heat map manager250is configured to produce heat map data252which, upon rendering by the display interface228, generates a heat map on a display device. In some implementations, the colors of the heat map represent a frequency of interactions (e.g., clicks) with points on the target object as expressed though the bucket identifier data232over a specified amount of time (e.g., 1 minute, 10 minutes, 1 hour, 2 hours, 6 hours, 12 hours, 1 day, 2 days, 1 week, and so on). In some implementations, the heat map data252includes target object data254. In such implementations, the heat map manager250is further configured to juxtapose the generated heat map onto the target object as displayed on the display device. In some implementations, the heat map manager is further configured to generate controls by which a user may vary the heat map according to the components of the mapped user identification data242corresponding to camera positions and orientations.

The bucket identifier acquisition manager230is configured to acquire bucket identifier data232from the user computer120. For example, if the user computer120collects user interaction data142and maps that data142to bucket identifiers156to produce the mapped bucket data164via a browser script, then the browser script may send the mapped bucket data162to the user computer220as the bucket identifier data232. The user computer220is configured to enable, for example, the automatic selection of a particular data set (e.g., an advertisement) for recommendation to the advertiser for a particular region of the object depending on the heat and a size of the region.

The user computer220includes a network interface222, one or more processing units224, memory226, and a display interface228. The network interface222includes, for example, Ethernet adaptors, Token Ring adaptors, and the like, for converting electronic and/or optical signals to electronic form for use by the user computer220. The set of processing units224include one or more processing chips and/or assemblies. The memory226includes both volatile memory (e.g., RAM) and non-volatile memory, such as one or more ROMs, disk drives, solid state drives, and the like. The set of processing units224and the memory226together form control circuitry, which is configured and arranged to carry out various methods and functions as described herein.

In some implementations, the memory226can be any type of memory such as a random-access memory, a disk drive memory, flash memory, and/or so forth. In some implementations, the memory226can be implemented as more than one memory component (e.g., more than one RAM component or disk drive memory) associated with the components of the user computer220. In some implementations, the memory226can be a database memory. In some implementations, the memory226can be, or can include, a non-local memory. For example, the memory226can be, or can include, a memory shared by multiple devices (not shown). In some implementations, the memory226can be associated with a server device (not shown) within a network and configured to serve the components of the user computer220.

The components (e.g., modules, processing units224) of the user computer220can be configured to operate based on one or more platforms (e.g., one or more similar or different platforms) that can include one or more types of hardware, software, firmware, operating systems, runtime libraries, and/or so forth. In some implementations, the components of the user computer220can be configured to operate within a cluster of devices (e.g., a server farm). In such an implementation, the functionality and processing of the components of the user computer220can be distributed to several devices of the cluster of devices.

The components of the user computer220can be, or can include, any type of hardware and/or software configured to process attributes. In some implementations, one or more portions of the components shown in the components of the user computer220inFIG.2can be, or can include, a hardware-based module (e.g., a digital signal processor (DSP), a field programmable gate array (FPGA), a memory), a firmware module, and/or a software-based module (e.g., a module of computer code, a set of computer-readable instructions that can be executed at a computer). For example, in some implementations, one or more portions of the components of the user computer220can be, or can include, a software module configured for execution by at least one processor (not shown). In some implementations, the functionality of the components can be included in different modules and/or different components than those shown inFIG.2.

Although not shown, in some implementations, the components of the user computer220(or portions thereof) can be configured to operate within, for example, a data center (e.g., a cloud computing environment), a computer system, one or more server/host devices, and/or so forth. In some implementations, the components of the user computer220(or portions thereof) can be configured to operate within a network. Thus, the components of the user computer220(or portions thereof) can be configured to function within various types of network environments that can include one or more devices and/or one or more server devices. For example, the network can be, or can include, a local area network (LAN), a wide area network (WAN), and/or so forth. The network can be, or can include, a wireless network and/or wireless network implemented using, for example, gateway devices, bridges, switches, and/or so forth. The network can include one or more segments and/or can have portions based on various protocols such as Internet Protocol (IP) and/or a proprietary protocol. The network can include at least a portion of the Internet.

In some embodiments, one or more of the components of the user computer220can be, or can include, processors configured to process instructions stored in a memory. For example, the bucket identifier acquisition manager230(and/or a portion thereof), the mapping manager240(and/or a portion thereof), and the heat map manager250(and/or a portion thereof) can be a combination of a processor and a memory configured to execute instructions related to a process to implement one or more functions.

FIG.3is a diagram that illustrates an example environment300involving a target object310and a camera340observing the target object310. As illustrated inFIG.3, the target object310takes the form of a car. The target object310is placed at the origin of a Cartesian coordinate system with axes (x, y, z). The target object310is oriented at an angle with respect to an initial orientation, e.g., along the y-axis; this angle is illustrated through an axis370of the target object. The target object310is also sized within the coordinate system according to a scale corresponding to a length along the axis370.

The camera340is situated on a surface of a sphere330, within a local Cartesian coordinate system with axes (X, Y, Z) such that a radial line350from the origin of the coordinate system with axes (x, y, z) intersects the surface of the sphere330at the origin of the local coordinate system. The camera340is oriented at an angle with respect to the local coordinate system, and that orientation is illustrated through an axis360of the camera with respect to the radial line350. The camera340has a FOV that represents an angular extent through which the camera may receive light. (The light source is assumed to be at infinity.)

FIG.4is a diagram that illustrates an example setup operation in an environment400in which samples of angle and position of the camera are taken to produce the buckets. As shown inFIG.4, there are four samples of camera position about the sphere430:440(A),440(B),440(C), and440(D). At each of the four positions, there are two camera orientations sampled (e.g., A1and A2for position440(A), and so on). Because the cameras are distributed about the sphere430, it may be assumed that the FOVs for the cameras is fixed as the camera traverses to the various positions440(A-D) on the sphere430. In some implementations in which a higher fidelity is needed, there may be more samples than the four positions and two angles per position shown inFIG.4. At the center of the sphere330lies the target object.

In this case, each of the sampled orientations at each position A1, A2, B1, B2, . . . , D1, D2may correspond to a respective bucket. That is, in this simple case, each bucket is simply a combination of an orientation and a position of a camera. In some implementations, and as shown inFIG.4, the cameras at the positions440(A-D) are also displaced from the origins of their respective local coordinate systems by respective displacement vectors470(A-D). In some implementations, the setup operation determines each displacement by a movement of the target object such that the target object appears to be at its initial position from the camera's perspective. In some implementations, the setup operation determines each displacement by verifying that the FOV of the camera is within a specified tolerance (e.g., 10%, 5%, 1%, and so on) of the FOV of the camera in an initial state.

Once the buckets have been produced as a result of the setup operation, the user computer120(FIG.1) is then ready to perform a quantization operation to map raw user interaction data to the buckets. In this stage, the quantization manager162translates the target object and the cameras back to an initial state. Then, for each user interaction datum, the quantization manager162finds the bucket that provides a best fit to that datum as described above. The identifier of that bucket is then sent to the user computer220for the generation of a heat map.

FIG.5Ais a diagram that illustrates a display500including an example heat map510and controls530that indicate respective camera orientations. As shown inFIG.5A, the heat map510is overlaid on a target object, which in this case is a car. The various hatch patterns in the heat map510represent colors, which in turn represent frequencies of user interactions (e.g., mouse clicks). In the example shown inFIG.5A, the number of buckets is relatively small so that there are large areas on the target object having the same color.

As shown inFIG.5A, the hood520of the car is colored differently than the other portions of the car. In this case, it may be assumed that the user had the most interactions with the hood520than with the other portions. An advertiser viewing this heat map may then assume that the user had more interest in the hood520than other portions of the car.

The controls530correspond to Euler angles that represent the orientation of a camera providing a particular viewing perspective on the car. That is, if the advertiser moves the controls to different angles, then the heat map510may change colors. In this way, the advertiser may understand how the user's interaction changes as the perspective changes.

FIG.5Bis a diagram that illustrates a display550including an example heat map560and controls580that indicate respective camera orientations. Here, the controls580are set to a different position, implying a different set of Euler angles for the camera. Here, the heat map560is different than the heat map510in that the colors are more uniform in the heat map560, even on the hood570. In fact, the only colors that are different are on the grille580. This may imply that the portion of the car of most interest to the user changes with perspective.

FIG.6is a flow chart that illustrates an example method600of mapping user interaction data to discrete buckets. The method600may be performed by software constructs described in connection withFIG.1, which reside in memory126of the user computer120and are run by the set of processing units124.

At602, the target object acquisition manager130receives target object data132representing a target object displayed on a display.

At604, the user interaction acquisition manager140receives user interaction data142. Each user interaction datum represents a value of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on the target object with which a user interacted at an instant of time.

At606, the mapping manager160performs a mapping operation to map the user interaction data140to a plurality of buckets, each of the plurality of buckets representing a respective set of values of the user interaction parameter and having a respective bucket identifier156.

At608, the user computer120sends the bucket identifier156to a second computer220configured to generate a heat map overlaid on a copy of the target object, the heat map being based on frequencies of bucket identifiers156received by the second computer220over a specified period of time.

FIG.7is a flow chart that illustrates an example method700of generating heat maps from discrete buckets. The method700may be performed by software constructs described in connection withFIG.2, which reside in memory226of the user computer220and are run by the set of processing units224.

At702, the bucket identifier acquisition manager230receives a plurality of bucket identifiers232. Each of the plurality of bucket identifiers232corresponds to a respective set of values of a user interaction parameter having a plurality of components, the plurality of components including coordinates of a position of a point on a target object with which a user interacted at an instant of time, coordinates of a position of a camera configured to image the target object, and angular coordinates representing an orientation of a camera configured to image the target object.

At704, the mapping manager240performs a mapping operation to map each of the plurality of bucket identifiers to respective values of the user interaction parameter.

At706, the heat map manager250generates a heat map based on the values of the user interaction parameter on a display device.

FIG.8illustrates an example of a generic computer device800and a generic mobile computer device850, which may be used with the techniques described here.

Computing device800includes a processor802, memory804, a storage device806, a high-speed interface808connecting to memory804and high-speed expansion ports810, and a low speed interface812connecting to low speed bus814and storage device806. Each of the components802,804,806,808,810, and812, are interconnected using various busses, and may be mounted on a common motherboard or in other manners as appropriate. The processor802can process instructions for execution within the computing device800, including instructions stored in the memory804or on the storage device806to display graphical information for a GUI on an external input/output device, such as display816coupled to high speed interface808. In other implementations, multiple processors and/or multiple buses may be used, as appropriate, along with multiple memories and types of memory. Also, multiple computing devices800may be connected, with each device providing portions of the necessary operations (e.g., as a server bank, a group of blade servers, or a multi-processor system).

The memory804stores information within the computing device800. In one implementation, the memory804is a volatile memory unit or units. In another implementation, the memory804is a non-volatile memory unit or units. The memory804may also be another form of computer-readable medium, such as a magnetic or optical disk.

The high speed controller808manages bandwidth-intensive operations for the computing device800, while the low speed controller812manages lower bandwidth-intensive operations. Such allocation of functions is exemplary only. In one implementation, the high-speed controller808is coupled to memory804, display816(e.g., through a graphics processor or accelerator), and to high-speed expansion ports810, which may accept various expansion cards (not shown). In the implementation, low-speed controller812is coupled to storage device806and low-speed expansion port814. The low-speed expansion port, which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) may be coupled to one or more input/output devices, such as a keyboard, a pointing device, a scanner, or a networking device such as a switch or router, e.g., through a network adapter.

The computing device800may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a standard server820, or multiple times in a group of such servers. It may also be implemented as part of a rack server system824. In addition, it may be implemented in a personal computer such as a laptop computer822. Alternatively, components from computing device800may be combined with other components in a mobile device (not shown), such as device850. Each of such devices may contain one or more of computing device800,850, and an entire system may be made up of multiple computing devices800,850communicating with each other.

Computing device850includes a processor852, memory864, an input/output device such as a display854, a communication interface866, and a transceiver868, among other components. The device850may also be provided with a storage device, such as a microdrive or other device, to provide additional storage. Each of the components850,852,864,854,866, and868, are interconnected using various buses, and several of the components may be mounted on a common motherboard or in other manners as appropriate.

The processor852can execute instructions within the computing device850, including instructions stored in the memory864. The processor may be implemented as a chipset of chips that include separate and multiple analog and digital processors. The processor may provide, for example, for coordination of the other components of the device850, such as control of user interfaces, applications run by device850, and wireless communication by device850.

Processor852may communicate with a user through control interface858and display interface856coupled to a display854. The display854may be, for example, a TFT LCD (Thin-Film-Transistor Liquid Crystal Display) or an OLED (Organic Light Emitting Diode) display, or other appropriate display technology. The display interface856may comprise appropriate circuitry for driving the display854to present graphical and other information to a user. The control interface858may receive commands from a user and convert them for submission to the processor852. In addition, an external interface862may be provided in communication with processor852, so as to enable near area communication of device850with other devices. External interface862may provide, for example, for wired communication in some implementations, or for wireless communication in other implementations, and multiple interfaces may also be used.

Device850may also communicate audibly using audio codec860, which may receive spoken information from a user and convert it to usable digital information. Audio codec860may likewise generate audible sound for a user, such as through a speaker, e.g., in a handset of device850. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.) and may also include sound generated by applications operating on device850.

The computing device850may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a cellular telephone480. It may also be implemented as part of a smart phone882, personal digital assistant, or other similar mobile device.