Abstract:
Disclosed is a system and method to navigate high-dimensional data in order to enhance the analytical capabilities of a data consumer. The technology disclosed can use a stereoscopic 3D viewer with a smartphone, a pair of 3D glasses with desktop, or a projected 3D image on a table. The solution provides a novel and accessible way of navigating high-dimensional data that has been organized into groups of two or three dimensions. Navigation is possible in all 3 dimensions (x, y, z) to explore the full potential of underlying data and elicit powerful insights to be acted on through informed decisions.

Description:
FIELD OF THE TECHNOLOGY DISCLOSED 
       [0001]    The technology disclosed relates generally to interaction with three-dimensional (3D) data, and in particular to providing a system and method to navigate 3D data on mobile and desktop platforms. 
       BACKGROUND 
       [0002]    The subject matter discussed in this section should not be assumed to be prior art merely as a result of its mention in this section. Similarly, a problem mentioned in this section or associated with the subject matter provided as background should not be assumed to have been previously recognized in the prior art. The subject matter in this section merely represents different approaches, which in and of themselves may also correspond to implementations of the claimed technology. 
         [0003]    Multidimensional data representations can be very useful in conveying information to a data consumer. But high-dimensional data sets can be difficult to comprehend. A visualization of the data can help with communication of the embedded information, and can be realized through visual representations such as statistical graphics, plots, information graphics, tables, and charts. Data visualization can be defined as the communication of abstract data through interactive visual interfaces, which can be used to present and explore the data. Data represented in two dimensions is relatively easy to consume and explore. Data represented in three dimensions, especially as represented on a two dimensional surface such as a computer display, adds a level of complexity to consumption and exploration. Data in four or more dimensions can be vastly more difficult to understand and manipulate. The technology disclosed describes a plurality of hand gestures that facilitate how a data consumer can traverse high-dimensional data sets constructed by a data source. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0004]    The included drawings are for illustrative purposes and serve only to provide examples of structures and process operations for one or more implementations of this disclosure. These drawings in no way limit any changes in form and detail that can be made by one skilled in the art without departing from the spirit and scope of this disclosure. A more complete understanding of the subject matter can be derived by referring to the detailed description and claims when considered in conjunction with the following figures, wherein like reference numbers refer to similar elements throughout the figures. 
           [0005]      FIG. 1A  illustrates a system for capturing image data according to an implementation of the technology disclosed. 
           [0006]      FIG. 1B  is a simplified block diagram of a gesture-recognition system implementing an image analysis apparatus according to an implementation of the technology disclosed. 
           [0007]      FIGS. 2A-2B  illustrate a gesture to point and dive to drill into a 3 dimensional representation of data. 
           [0008]      FIGS. 3A-3D  illustrate a gesture to grab and pluck a flag on a 3 dimensional representation of data. 
           [0009]      FIGS. 4A-4C  illustrate a gesture to de-clutter a display of a 3 dimensional representation of data. 
           [0010]      FIG. 5  illustrates flags representing different events of interest within a 3 dimensional representation. 
           [0011]      FIG. 6A  illustrates on example of a point and dive menu. 
           [0012]      FIG. 6B  illustrates one example of an outcome of a dive gesture by representative. 
           [0013]      FIG. 7  illustrates one example of an outcome of a grab and pluck gesture. 
           [0014]      FIG. 8  illustrates one example of an outcome of a de-clutter gesture. 
       
    
    
     DETAILED DESCRIPTION 
       [0015]    The following detailed description is made with reference to the figures. Sample implementations are described to illustrate the technology disclosed, not to limit its scope, which is defined by the claims. Those of ordinary skill in the art will recognize a variety of equivalent variations on the description that follows. 
         [0016]    High-dimensional data sets are common in many fields such as healthcare, information technology, and ecology. For example, data on the health status of patients can include dimensions such as blood analysis over time, genetic background, surgical history, diseases, and pharmacology. The data can be linked so that a viewer can traverse the data based on interest. For example, a viewer might begin a review of a patient&#39;s information with their blood analyses, and then choose to review disease information to find an association. 
         [0017]    With information technology, high-dimensional data can include planning for hardware and software implementations, utilization of existing systems, and operational support. Operational support can include a call center, with call tracking for hardware failures, hacking incidents, and natural disasters, where each of these categories has its own list of subsets. The technology disclosed can assist with the traversal of a high-dimensional data set such as one generated by a Salesforce Analytics Cloud using a device such as a stereoscopic 3d viewer with a smartphone, a pair of 3D glasses with a desktop, Oculus Rift, or Google Cardboard. Navigation is possible in all 3 dimensions (x,y,z) of a 3D representation of data, as well as forward and backward through a high-dimensional data set. The technology disclosed can include visual feedback as well as haptic feedback through special purpose gloves such as GloveOne. 
         [0018]    The technology disclosed comprises three gestures: point and dive to drill into a data set, grab and pluck to initiate a 3D visualization change, and de-clutter to focus the visualization on two of three dimensions on a display. The point and dive gesture allows a viewer to choose a data point within a virtualized 3D representation, and invoke a menu identifying a plurality of options. The grab and pluck gesture allows a viewer to pick a data point from a plurality of data points, and expose details about the data point. The de-clutter gesture allows a viewer to simplify a 3D representation of data to a 2D representation. 
         [0019]    As used herein, a given signal, event or value is “based on” a predecessor signal, event or value of the predecessor signal, event or value influenced by the given signal, event or value. If there is an intervening processing element, step or time period, the given signal, event or value can still be “based on” the predecessor signal, event or value. If the intervening processing element or step combines more than one signal, event or value, the signal output of the processing element or step is considered “based on” each of the signal, event or value inputs. If the given signal, event or value is the same as the predecessor signal, event or value, this is merely a degenerate case in which the given signal, event or value is still considered to be “based on” the predecessor signal, event or value. “Responsiveness” or “dependency” of a given signal, event or value upon another signal, event or value is defined similarly. 
         [0020]    As used herein, the “identification” of an item of information does not necessarily require the direct specification of that item of information. Information can be “identified” in a field by simply referring to the actual information through one or more layers of indirection, or by identifying one or more items of different information which are together sufficient to determine the actual item of information. In addition, the term “specify” is used herein to mean the same as “identify.” 
         [0021]    Referring first to  FIG. 1A , which illustrates an exemplary sensory analysis system  100 A including any number of cameras such as cameras  102 ,  104  coupled to a sensory-analysis system  106 . Cameras  102 ,  104  can be any type of camera, including cameras sensitive across the visible spectrum or, more typically, with enhanced sensitivity to a confined wavelength band (e.g., the infrared (IR) or ultraviolet bands); more generally, the term “camera” herein refers to any device (or combination of devices) capable of capturing an image of an object and representing that image in the form of digital data. While illustrated using an example of a two camera implementation, other implementations are readily achievable using different numbers of cameras or non-camera light sensitive image sensors or combinations thereof. For example, line sensors or line cameras rather than conventional devices that capture a two-dimensional (2D) image can be employed. The term “light” is used generally to connote any electromagnetic radiation, which may or may not be within the visible spectrum, and may be broadband (e.g., white light) or narrowband (e.g., a single wavelength or narrow band of wavelengths). 
         [0022]    Cameras  102 ,  104  are preferably capable of capturing video images (i.e., successive image frames at a constant rate of at least 15 frames per second); although no particular frame rate is required. The capabilities of cameras  102 ,  104  are not critical to the technology disclosed, and the cameras can vary as to frame rate, image resolution (e.g., pixels per image), color or intensity resolution (e.g., number of bits of intensity data per pixel), focal length of lenses, depth of field, etc. In general, for a particular application, any cameras capable of focusing on objects within a spatial volume of interest can be used. For instance, to capture motion of the hand of an otherwise stationary person, the volume of interest can be defined as a cube approximately one meter on a side. 
         [0023]    In some implementations, the illustrated system  100 A includes one or more sources  108 ,  110 , which can be disposed to either side of cameras  102 ,  104 , and are controlled by sensory-analysis system  106 . In one implementation, the sources  108 ,  110  are light sources. For example, the light sources can be infrared light sources, e.g., infrared light-emitting diodes (LEDs), and cameras  102 ,  104  can be sensitive to infrared light. Use of infrared light can allow the sensory analysis system  100 A to operate under a broad range of lighting conditions and can avoid various inconveniences or distractions that may be associated with directing visible light into the region where the person is moving. However, a particular wavelength or region of the electromagnetic spectrum can be required. In one implementation, filters  120 ,  122  are placed in front of cameras  102 ,  104  to filter out visible light so that only infrared light is registered in the images captured by cameras  102 ,  104 . In another implementation, the sources  108 ,  110  are sonic sources providing sonic energy appropriate to one or more sonic sensors (not shown in  FIG. 1A  for clarity sake) used in conjunction with, or instead of, cameras  102 ,  104 . The sonic sources transmit sound waves to the user; the user either blocks (or “sonic shadowing”) or alters the sound waves (or “sonic deflections”) that impinge upon her. Such sonic shadows and/or deflections can also be used to detect the user&#39;s gestures and/or provide presence information and/or distance information using ranging techniques known in the art. In some implementations, the sound waves are, for example, ultrasound, that is not audible to humans. 
         [0024]    It should be stressed that the arrangement shown in  FIG. 1A  is representative and not limiting. For example, lasers or other light sources can be used instead of LEDs. In implementations that include laser(s), additional optics (e.g., a lens or diffuser) may be employed to widen the laser beam (and make its field of view similar to that of the cameras). Useful arrangements can also include short- and wide-angle illuminators for different ranges. Light sources are typically diffuse rather than specular point sources; for example, packaged LEDs with light-spreading encapsulation are suitable. 
         [0025]    In operation, light sources  108 ,  110  are arranged to illuminate a region of interest  112  that includes a control object portion  114  that can optionally hold a tool or other object of interest and cameras  102 ,  104  are oriented toward the region  112  to capture video images of the hands  114 .  FIG. 1A  depicts two hands together in one implementation, in other implementations, it can include any gesture such as a de-clutter gesture, a point gesture, a point and grab gesture, or any other gesture. In some implementations, the operation of light sources  108 ,  110  and cameras  102 ,  104  is controlled by the sensory-analysis system  106 , which can be, e.g., a computer system, control logic implemented in hardware and/or software or combinations thereof. Based on the captured images, sensory-analysis system  106  determines the position and/or motion of object  114 . 
         [0026]      FIG. 1B  is a simplified block diagram of a computer system  100 B, implementing sensory-analysis system  106  (also referred to as an image analyzer) according to an implementation of the technology disclosed. Sensory-analysis system  106  can include or consist of any device or device component that is capable of capturing and processing image data. In some implementations, computer system  100 B includes a processor  132 , memory  134 , a sensor interface  136 , a display  138  (or other presentation mechanism(s), e.g. holographic projection systems, wearable googles or other head mounted displays (HMDs), heads up displays (HUDs), other visual presentation mechanisms or combinations thereof, speakers  139 , a keyboard  140 , and a mouse  141 . Memory  134  can be used to store instructions to be executed by processor  132  as well as input and/or output data associated with execution of the instructions. In particular, memory  134  contains instructions, conceptually illustrated as a group of modules described in greater detail below, that control the operation of processor  132  and its interaction with the other hardware components. An operating system directs the execution of low-level, basic system functions such as memory allocation, file management and operation of mass storage devices. The operating system may be or include a variety of operating systems such as Microsoft WINDOWS operating system, the Unix operating system, the Linux operating system, the Xenix operating system, the IBM AIX operating system, the Hewlett Packard UX operating system, the Novell NETWARE operating system, the Sun Microsystems SOLARIS operating system, the OS/2 operating system, the BeOS operating system, the MAC OS operating system, the APACHE operating system, an OPENACTION operating system, iOS, Android or other mobile operating systems, or another operating system platform. 
         [0027]    The computing environment can also include other removable/non-removable, volatile/nonvolatile computer storage media. For example, a hard disk drive can read or write to non-removable, nonvolatile magnetic media. A magnetic disk drive can read from or write to a removable, nonvolatile magnetic disk, and an optical disk drive can read from or write to a removable, nonvolatile optical disk such as a CD-ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The storage media are typically connected to the system bus through a removable or non-removable memory interface. 
         [0028]    Processor  132  can be a general-purpose microprocessor, but depending on implementation can alternatively be a microcontroller, peripheral integrated circuit element, a CSIC (customer-specific integrated circuit), an ASIC (application-specific integrated circuit), a logic circuit, a digital signal processor, a programmable logic device such as an FPGA (field-programmable gate array), a PLD (programmable logic device), a PLA (programmable logic array), an RFID processor, smart chip, or any other device or arrangement of devices that is capable of implementing the actions of the processes of the technology disclosed. 
         [0029]    Sensor interface  136  can include hardware and/or software that enables communication between computer system  100 B and cameras such as cameras  102 ,  104  shown in  FIG. 1A , as well as associated light sources such as light sources  108 ,  110  of  FIG. 1A . Thus, for example, sensor interface  136  can include one or more data ports  146 ,  148  to which cameras can be connected, as well as hardware and/or software signal processors to modify data signals received from the cameras (e.g., to reduce noise or reformat data) prior to providing the signals as inputs to a motion-capture (“mocap”) program  144  executing on processor  132 . In some implementations, sensor interface  136  can also transmit signals to the cameras, e.g., to activate or deactivate the cameras, to control camera settings (frame rate, image quality, sensitivity, etc.), or the like. Such signals can be transmitted, e.g., in response to control signals from processor  132 , which can in turn be generated in response to user input or other detected events. 
         [0030]    Sensor interface  136  can also include controllers  147 ,  149 , to which light sources (e.g., light sources  108 ,  110 ) can be connected. In some implementations, controllers  147 ,  149  provide operating current to the light sources, e.g., in response to instructions from processor  132  executing mocap program  144 . In other implementations, the light sources can draw operating current from an external power supply, and controllers  147 ,  149  can generate control signals for the light sources, e.g., instructing the light sources to be turned on or off or changing the brightness. In some implementations, a single controller can be used to control multiple light sources. 
         [0031]    Instructions defining mocap program  144  are stored in memory  134 , and these instructions, when executed, perform motion-capture analysis on images supplied from cameras connected to sensor interface  136 . In one implementation, mocap program  144  includes various modules, such as an object detection module  152 , an object analysis module  154 , and a gesture-recognition module  156 . Object detection module  152  can analyze images (e.g., images captured via sensor interface  136 ) to detect edges of an object therein and/or other information about the object&#39;s location. Object analysis module  154  can analyze the object information provided by object detection module  152  to determine the 3D position and/or motion of the object (e.g., a user&#39;s hand). Examples of operations that can be implemented in code modules of mocap program  144  are described below. Memory  134  can also include other information and/or code modules used by mocap program  144  such as an application platform  166  that allows a user to interact with the mocap program  144  using different applications like application  1  (App 1 ), application  2  (App 2 ), and application N (AppN). 
         [0032]    Display  138 , speakers  139 , keyboard  140 , and mouse  141  can be used to facilitate user interaction with computer system  100 B. In some implementations, results of gesture capture using sensor interface  136  and mocap program  144  can be interpreted as user input. For example, a user can perform hand gestures that are analyzed using mocap program  144 , and the results of this analysis can be interpreted as an instruction to some other program executing on processor  132  (e.g., a web browser, word processor, or other application). Thus, by way of illustration, a user might use upward or downward swiping gestures to “scroll” a webpage currently displayed on display  138 , to use rotating gestures to increase or decrease the volume of audio output from speakers  139 , and so on. 
         [0033]    It will be appreciated that computer system  100 B is illustrative and that variations and modifications are possible. Computer systems can be implemented in a variety of form factors, including server systems, desktop systems, laptop systems, tablets, smart phones or personal digital assistants, wearable devices, e.g., goggles, head mounted displays (HMDs), wrist computers, and so on. A particular implementation can include other functionality not described herein, e.g., wired and/or wireless network interfaces, media playing and/or recording capability, etc. In some implementations, one or more cameras can be built into the computer or other device into which the sensor is imbedded rather than being supplied as separate components. Further, an image analyzer can be implemented using only a subset of computer system components (e.g., as a processor executing program code, an ASIC, or a fixed-function digital signal processor, with suitable I/O interfaces to receive image data and output analysis results). 
         [0034]    While computer system  100 B is described herein with reference to particular blocks, it is to be understood that the blocks are defined for convenience of description and are not intended to imply a particular physical arrangement of component parts. Further, the blocks need not correspond to physically distinct components. To the extent that physically distinct components are used, connections between components (e.g., for data communication) can be wired and/or wireless as desired. 
         [0035]    With reference to  FIGS. 1A and 1B , the user performs a gesture that is captured by the cameras  102 ,  104  as a series of temporally sequential images. In other implementations, cameras  102 ,  104  can capture any observable pose or portion of a user. For instance, if a user walks into the field of view near the cameras  102 ,  104 , cameras  102 ,  104  can capture not only the whole body of the user, but the positions of arms and legs relative to the person&#39;s core or trunk. These are analyzed by a gesture-recognition module  156 , which can be implemented as another module of the mocap  144 . Gesture-recognition module  156  provides input to an electronic device, allowing a user to remotely control the electronic device and/or manipulate virtual objects, such as prototypes/models, blocks, spheres, or other shapes, buttons, levers, or other controls, in a virtual environment displayed on display  138 . The user can perform the gesture using any part of her body, such as a finger, a hand, or an arm. As part of gesture recognition or independently, the sensory-analysis system  106  can determine the shapes and positions of the user&#39;s hand in 3D space and in real time. As a result, the sensory-analysis system  106  can not only recognize gestures for purposes of providing input to the electronic device, but can also capture the position and shape of the user&#39;s hand in consecutive video images in order to characterize the hand gesture in 3D space and reproduce it on the display screen  138 . 
         [0036]    In one implementation, the gesture-recognition module  156  compares the detected gesture to a library of gestures electronically stored as records in a database, which is implemented in the sensory-analysis system  106 , the electronic device, or on an external storage system. (As used herein, the term “electronically stored” includes storage in volatile or non-volatile storage, the latter including disks, Flash memory, etc., and extends to any computationally addressable storage media (including, for example, optical storage).) For example, gestures can be stored as vectors, i.e., mathematically specified spatial trajectories, and the gesture record can have a field specifying the relevant part of the user&#39;s body making the gesture; thus, similar trajectories executed by a user&#39;s hand and head can be stored in the database as different gestures so that an application can interpret them differently. 
       Point and Dive Gesture 
       [0037]    The gesture recognition system  100 B can be used to recognize the gestures described by the technology disclosed to navigate through, and take action on 3D data visualizations. In one implementation,  FIG. 2A  and  FIG. 2B , collectively referred to as  FIG. 2 , illustrate a gesture to point and dive into a 3 dimensional representation of data. 
         [0038]    The so-called point and dive gesture selects a particular data point from a 3D presentation and causes display of more information about the selected data point, in a context of other data that may not have been present in the first 3D presentation, as explained below in the context of  FIGS. 5-6 . This accomplishes a selection and drill-down. As shown in  FIG. 2B , a menu can offer multiple drill down options, if more than one is available. In the example of the gesture illustrated in  FIG. 2 , a stereoscopic display of 3D data  201  is rendered on a display. The 3D data can be a group of data from within a high-dimensional data set. The 3D data  201  can be an entry point into the high-dimensional data set, can be the last three dimensions of the high-dimensional dataset, or somewhere in between. The high-dimensional data set can be predefined by an operator, or can be generated by an algorithm, with the results of the gestures of the technology disclosed predefined and codified within the data set. In this example, the 3D data  201  comprises multiple data points. A data point  215  will be the target of the point and dive gesture of this example. 
         [0039]    The point and dive gesture begins with an index finger  225  of a user pointing at a data point  215 . The sensory analysis system  100 A recognizes that the user is pointing an index finger at the data point  215 . The gesture recognition system  100 B responds by identifying the data point  215  selected. In this example, a circle  220  is rendered around the data point  215  by the gesture recognition system  100 B. In other implementations, other techniques for identifying the selection can be used such as variations in color, variations in shading, or other visual cues. Once the desired data point  215  has been identified, the palms of the user&#39;s right and left hands are brought together, with fingers pointing toward the selected data point  215 . In one implementation the fingers are below a horizontal plane. In another implementation, the fingers are below a plane between the hands together and the display. The system then renders a predefined menu that is rendered onto the display as an acknowledgement of the gesture, the menu being a list of views or actions to be taken on the underlying data within the high-dimensional data structure. If there is one item in the menu, the system can automatically chose that item. If there are two or more menu options that can be chosen by the user, the user can point to her selection on the menu with an index finger. 
       Grab and Pluck to Select a Flagged Point Gesture 
       [0040]    The grab and pluck gesture is directed to a selectable feature, such as a flag, in the 3D data display.  FIGS. 3A-3D , collectively referred to as  FIG. 3 , illustrate a gesture to grab and pluck a flag displayed on a 3 dimensional representation of data. In this example, a stereoscopic display of 3D data  301  is rendered on a display. The 3D data can be a group of data from within a high-dimensional data set. The 3D data  301  can be an entry point into the high-dimensional data set, can be the last three dimensions of the high-dimensional dataset, or somewhere in between. The high-dimensional data set can be predefined by an operator, or can be generated by an algorithm, with the results of the gestures of the technology disclosed predefined and codified within the data set. In this example, the 3D data  301  comprises multiple data points. A data point  311  is the target of the grab and pluck gesture of this example. In some implementations, a data point can be a virtual object generated via computer graphics. Such a virtual object can take any shape or form and mimic real-world objects like a flag, a scissor, a pin, a ball, a notebook, a sticky slip. etc. 
         [0041]    In one implementation, the grab and pluck gesture begins with an open hand  321  of a user reaching toward a data point  311 . The sensory analysis system  100 A recognizes that the user is reaching toward the data point  311 . The gesture recognition system  100 B responds by identifying the data point  311  selected. In this example, a circle  320  is rendered around the data point  311  by the gesture recognition system  100 B. In other implementations, other techniques for identifying the selection can be used such as variations in color, variations in shading, or other visual cues. In another implementation, the grab and pluck gesture begins with a pointing gesture that causes selection of a particular data point (like data point  311 ). 
         [0042]    Once the data point of interest has been selected, the user begins to close the fingers  327  of the open hand in on each other. In one implementation, a visual cue is rendered on the display indicating the step of the gesture, whereas in another implementation, no visual cue is rendered. The sensory analysis system  100 A recognizes the grab gesture when a thumb and one or more fingers of the reaching hand touch, or when the hand is closed into a first  331 . To complete the grab and pluck gesture, the user can begin moving the closed hand away from the selected object  337 . This initiates a visualization change, the change being dependent on the flag that was grabbed. An example of a result of the grab and pluck gesture is illustrated in  FIG. 7  described below. 
       De-Clutter Gesture 
       [0043]    The de-clutter gesture applies to a 3D display with labeled and unlabeled data points, and allow the user to remove the non-labelled points from the 3D display, leaving a simpler display of the labelled points. In one implementation,  FIGS. 4A-4C , collectively referred to as  FIG. 4 , illustrate a gesture to de-clutter a 3 dimensional representation of data. In this example, a stereoscopic display of 3D data  401  is rendered on a display. The de-clutter gesture, also referred to as a part, uses two hands. A user first places the backs of her left and right hands together while facing the 3D display.  FIG. 4A  illustrates a user placing the backs of her left and right hands together  421 , with fingers toward the 3D data display  401 . The sensory analysis system  100 A recognizes that the user is holding the backs of her hands together  421 . The user then begins moving her hands away from each other  425  as illustrated in  FIG. 4B . Once the hands have reached a configurable distance from each other  429 , as illustrated in  FIG. 4C , the sensory analysis system  100 A recognizes the completion of the de-clutter gesture, and the action de-clutters the screen to focus on the labelled data points of interest, which in this example are flags  423 . The 3D data can be a group of data from within a high-dimensional data set. The 3D data  401  can be an entry point into the high-dimensional data set, can be the last three dimensions of the high-dimensional dataset, or somewhere in between. The high-dimensional data set can be predefined by an operator, or can be generated by an algorithm, with the results of the gestures of the technology disclosed predefined and codified within the data set. In this example, the 3D data  401  comprises multiple data points, such as data point  423 . An example of a result of a de-clutter gesture is illustrated in  FIG. 8  described below. 
       Example 3D Display of Higher Dimensionality Data 
       [0044]    In one implementation of a high-dimensional data set that can be used to illustrate the three gestures disclosed, a high-dimensional data set is created that summarizes operational support statistic. Operation support can include a call center, with call tracking for hardware failures, hacking incidents, and natural disasters, where each of these categories has its own list of subsets. These subsets can include the following:
       Hardware failures
           Router   Switch   Power source   Server   Cabling   
           Hacking incidents
           Distributed Denial of Service (DDOS)   Social Engineering   Phishing   Man in the middle   
           Natural disasters
           Lightning   Earthquake   Tsunami   Hurricane   
               
 
         [0061]    These operational support issues are illustrated in  FIG. 5 . In this example, Flag A  515  could be a hardware failure such as a bad switch, where the problem had a low number of cases  563 , and a low resolution time  567  so that the network availability was not seriously impacted, which results in a high customer satisfaction  505  score. 
         [0062]    Flag B  527  could be a natural disaster such as a tsunami warning that caused support staff to leave the facility, with a low number of cases  563 , a high resolution time  567 , but a high customer satisfaction score  505  due to a perceived execution of a good process during a natural disaster. 
         [0063]    Flag C  525  could be a phishing scam (hack), where there are a medium number of cases  563 , a medium resolution time  567 , but a low customer satisfaction score  505 , as it could be assumed by the customers that phishing scams are annoying at any level. 
         [0064]    Flag D  535  could be lighting struck data center 4 times. This example would show a large number of cases  563 , with high resolution times  567  due to multiple effects on power. This example still shows high customer satisfaction  505  due to an understanding that there&#39;s a serious natural disaster. 
         [0065]    Flag E  523  could be a low impact social engineering hack such as a virus hoax that results in a large number of cases  563  that are quickly resolved, but that aggravate customers so that they leave relatively low customer satisfaction scores. 
         [0066]      FIG. 6A  illustrates a menu  611  which is the result of the point and dive gesture. In this example, a user selects to dive into a deeper layer within the high dimensional data that is organized by representative. 
       Point and Dive Example 
       [0067]    As illustrated in  FIG. 2 , a point and dive gesture is carried out with Flag D  535  of  FIG. 5  as a target. In this example, a circle  625  is drawn around the selected flag  535 . In another example, some other indication of selection can occur, such as the color of the flag can change. Also in this example, a menu  611  pops up showing a list of options, which include showing associated data by representative, by data center, or over time.  FIG. 6B  illustrates the effect of the viewer choosing “By Representative” from the menu  611 , which drills down into a 3D representation of resolution times  645  and satisfaction ratings  681  by representative  699 . In this example, the 3D representation illustrates that representative A  655  has the highest resolution times  645  for his cases, and the lowest overall satisfaction ratings  681 . In one example, the volume identified as A  655  can be a volume of calls, included as a 4 th  dimension in the figure. In this example, representative B  665  has a lower volume of calls, which allows him a lower overall resolution time  645 , and a higher overall satisfaction rating  681 . Representative C has a very low volume of calls, with a consistently low resolution time, and a wide range of satisfaction scores. This could indicate that representative C  675  is new. 
       Grab and Pluck Example 
       [0068]      FIG. 7  illustrates a result of a grab and pluck gesture. In this example, a viewer reaches toward flag D  535  on  FIG. 5  as illustrated by  FIG. 3 . In this example, The lightning severity of the 4 lightning strikes  715  show a reduced severity and a fewer number of cases  721  over historical time  729 . 
       De-Clutter 
       [0069]      FIG. 8  illustrates one example of an outcome of a de-clutter gesture. In this example, performing a de-clutter gesture on  FIG. 5 , as illustrated in  FIG. 4 , reduces the representation from three dimensions (customer satisfaction  505 , number of cases  563 , and resolution time  567 ) to two dimensions (customer satisfaction  505  and number of cases  563 ). In another example, the two remaining dimensions can be customer satisfaction  505  and resolution time  567 . 
       3D Data Display Generation 
       [0070]    The 3D data display can be generated using a variety of techniques, e.g. holographic projection systems, wearable goggles or other head mounted displays (HMDs), heads up displays (HUDs). In one implementation, the 3D data is projected onto a conference room table for a meeting so it can be explored like an architect&#39;s building model. In such an implementation, attendees can view the 3D data using a head mounted display like Oculus Rift™ or wearable goggles like Google Glass™. 
       Voice Commands 
       [0071]    In other implementations, voice commands can be used in conjunction with the gestures discussed above to manipulate the 3D data display. In one implementation, a voice command can precede or follow a hand gesture like a point gesture, or a point and dive gesture or a grab and pluck gesture or a de-clutter gesture. In some implementations, a voice command issued to change an existing mode and share content. For instance, if there multiple modes to a 3D data display, such as an explore mode, a filter mode, an exit mode or an annotate mode, a voice command can cause transition from one mode to another or from a mode generated by a gesture to a new mode generated by the voice command. In other implementations, a voice command can perform data manipulations such a grouping or sorting data based on one or more parameters or criteria. In a further implementation, a voice command can be used to share content across an online social network or between users in an intra-organization network. Examples of such networks include Facebook™, Twitter™, YouTube™, Chatter™, and the likes. 
         [0072]    In yet another implementation, voice commands can be used to verbally issue natural language processing (NLP) queries such as “who are my top 10 sales representative who sold the most last quarter in the North America region?” Such a verbal NLP query is responded by generating resulting visualizations, without requiring a user to employ one or more touch commands that usually require issuing multiple sub-commands such as grouping, sorting, listing, etc. 
       Haptic Commands 
       [0073]    In one implementation, the technology disclosed utilizes haptic feedback to allow interaction with the 3D data display. In such an implementation, a haptic projector is used that is receptive of different haptic properties of the virtual 3D objects (e.g. flag, pin, or any other data point), including surface texture and relative elevation. The haptic projector communicates different haptic properties of the 3D objects through vibration frequencies of varying magnitudes that apply pressure on a specialized device worn by a user, e.g. a haptic-enabled glove or feeler. Such a specialized device simulates tactile sensations with application of mechanical force on the user&#39;s hand. Thus, in one anomaly detection implementation, the haptic-enabled glove detects a data point on the 3D data display that is a certain standard deviation away from a moving average. The haptic-enabled glove translates the peak of the anomalous data point into corresponding pressure applied on a user&#39;s hand. In some implementations, such sensory information like pressure or vibrations are communicated to the user when the user&#39;s hand traverses the anomalous data point on the 3D data display. 
         [0074]    In yet other implementations, a degree of pressure applied on the user&#39;s hand via the haptic-enabled glove is responsive to the degree of deviation of the anomalous data point such that greater the peak of the anomalous data point, higher the applied pressure. In other implementations, the degree of pressure applied on the user&#39;s hand via the haptic-enabled glove is responsive to the magnitude of a value of data point. 
         [0075]    In a further implementation, detection of different data points is distinguished by applying pressure or other sensory information on different portions of a user&#39;s hand. For instance, a first type of flag causes vibration being applied on an index finger of a user&#39;s hand, and a second type of flag causes vibration being applied on a thumb of the user&#39;s hand. 
       Some Particular Implementations 
       [0076]    In one implementation, described is a method of supporting navigation through three-dimensional (3D) data presented stereoscopically to a viewer. The method includes causing stereoscopic display of three-dimensional (3D) data to a viewer and receiving gesture data from a 3D sensor that is monitoring a 3D sensory space, the gesture data indicating a user performing a point and dive gesture sequence. The gesture sequence observed in the 3D sensory space includes an index finger pointing to a point on a surface of the 3D data display, followed by convergence of right and left hand palms. The method further causes updating of the 3D data display, based on recognition of the pointing to the surface, to graphically depict selection of data responsive to the pointing, updating of the 3D data display, based on recognition of the convergence of right and left hand palms, to include a menu and updating of the 3D data display, based on recognition of a pointing to an item on the menu, to graphically depict a selection among the menu choices. 
         [0077]    This method and other implementations of the technology disclosed can include one or more of the following features and/or features described in connection with additional methods disclosed. In the interest of conciseness, the combinations of features disclosed in this application are not individually enumerated and are not repeated with each base set of features. The reader will understand how features identified in this section can readily be combined with sets of base features identified as implementations in previous sections of the application. 
         [0078]    In one implementation, the convergence of right and left hand palms further includes fingers pointing towards the 3D data display below a horizon. In another implementation, the pointing to the item on the menu includes using an index finger. 
         [0079]    The method further includes receiving gesture data from the 3D sensor specifying detection of a dive gesture, wherein the received gesture data includes a signal to drill down into data selected by the pointing and causing updating of the 3D data display to graphically depict drilling down into the selected data. 
         [0080]    The method also includes causing updating of the 3D data display to graphically depict a menu in response to the drilling down and causing updating of the 3D data display to graphically select a menu item from the menu in response to a pointing gesture performed after the drilling down. 
         [0081]    Other implementations may include a computer implemented system to perform any of the methods described above, the system including a processor, memory coupled to the processor, and computer instructions loaded into the memory. Yet another implementation may include a tangible non-transitory computer readable storage medium impressed with computer program instructions that cause a computer to implement any of the methods described above. The tangible computer readable storage medium does not include transitory signals. 
         [0082]    In another implementation, described is a method of supporting navigation through three-dimensional (3D) data presented stereoscopically to a viewer. The method includes causing stereoscopic display of three-dimensional (3D) data that includes selectable flags and receiving gesture data from a 3D sensor that is monitoring a 3D sensory space, the gesture data indicating a gesture sequence of a user plucking one of the selectable flags. The gesture sequence includes one or more fingers pointing at one of the selectable flags to select at least one flag, followed by one or more fingertips of a hand directed to plucking the selected flag, which is in turn followed by a hand or two or more fingers of the hand closing on and plucking the selected flag. The method further includes updating of the 3D data display, based on recognition of the finger pointing, to graphically depict selectable flags responsive to the finger pointing, updating of the 3D data display, based on recognition of the fingertips of the hand directed to plucking, to graphically identify the selected flag and updating of the 3D data display, based on recognition of the hand or two or more fingers of the hand closing on and plucking the selected flag, to graphically depict plucking of the selected flag. 
         [0083]    This method and other implementations of the technology disclosed can include one or more of the following features and/or features described in connection with additional methods disclosed. In the interest of conciseness, the combinations of features disclosed in this application are not individually enumerated and are not repeated with each base set of features. The reader will understand how features identified in this section can readily be combined with sets of base features identified as implementations in previous sections of the application. 
         [0084]    The method also includes causing updating of the 3D data display with a change in visualization, the change dependent on the flag plucked. 
         [0085]    Other implementations may include a computer implemented system to perform any of the methods described above, the system including a processor, memory coupled to the processor, and computer instructions loaded into the memory. Yet another implementation may include a tangible non-transitory computer readable storage medium impressed with computer program instructions that cause a computer to implement any of the methods described above. The tangible computer readable storage medium does not include transitory signals. 
         [0086]    In a further implementation, described is a method of supporting navigation through three-dimensional (3D) data presented stereoscopically to a viewer. The method includes causing stereoscopic display of three-dimensional (3D) data that includes a plurality of data points graphically arranged along three axes of the 3D data display and receiving gesture data from a 3D sensor that is monitoring a 3D sensory space, the gesture data indicating a de-clutter gesture sequence performed by a user. The de-clutter gesture sequence includes backs of right and left hands of the user initially together and followed by, backs of the hands moving apart. The method further includes updating of the 3D data display, based on recognition of the de-clutter gesture, to graphically transition, from the plurality of data points along the three axes, to a set of points selected from the plurality and arranged along two axes of the 3D data display. The graphical transition causes updating of the 3D data display to rearrange the set of points from respective initial positions along the three axes to respective final positions along the two axes. 
         [0087]    This method and other implementations of the technology disclosed can include one or more of the following features and/or features described in connection with additional methods disclosed. In the interest of conciseness, the combinations of features disclosed in this application are not individually enumerated and are not repeated with each base set of features. The reader will understand how features identified in this section can readily be combined with sets of base features identified as implementations in previous sections of the application. 
         [0088]    Other implementations may include a computer implemented system to perform any of the methods described above, the system including a processor, memory coupled to the processor, and computer instructions loaded into the memory. Yet another implementation may include a tangible non-transitory computer readable storage medium impressed with computer program instructions that cause a computer to implement any of the methods described above. The tangible computer readable storage medium does not include transitory signals.