Abstract:
Apparatus and methods are disclosed for inputting and rendering haptic data. Wherein, a haptel generates a signal in response to subjecting the haptel to a stimulus.

Description:
FIELD OF THE INVENTION  
         [0001]    The present invention relates to the field of haptels and methods for inputting and rendering haptic data.  
         BACKGROUND OF THE INVENTION  
         [0002]    When living beings are not within arms reach of each other, communication is limited to non-touch forms. Telephones provide audio communication over great distances, to assist the sense of hearing. Television and computer monitors have been developed to provide data in the form of a visual display. Examples of these prior art communication devices are shown in FIG. 1. FIG. 1 depicts prior art audio data transmission via telephone communication and visual data transmission and display on a computer monitor. With reference to FIG. 1, person  2  uses telephone  2   a  to communicate over signal path  10  with person  4  via telephone  4   a . In a similar manner person  6  uses computer  6   a  to communicate over signal path  10  with person  8 , via computer  8   a . Computer  6   a  and  8   a  could be any type of prior art device that displays alphanumeric or graphic data. These prior art communication devices do not provide touch based (haptic) data input and output.  
           [0003]    When living beings are proximate to each other, other forms of communication, beyond speaking, are employed. In particular, living beings communicate with their sense of touch. Physical contact, caressing, holding, squeezing, contact-examination are some of the forms of communication that living beings routinely employ when proximate to each other. FIG. 2 displays some of the touch-based forms of communication intended by a haptel. With reference to FIG. 2, touch  20  is indicated with two people. Holding  22  is indicated with one person&#39;s hand on another. Examination  24  involves touch-based contact as shown in FIG. 2.  
           [0004]    A child&#39;s toy, “a set of nails,” is a device that records the imprint of a user&#39;s hand or other object that is pressed against it. This device does not provide electrical signals that can be used to reproduce the imprint on a second device, nor does this device provide the ability to configure itself based on an external input.  
           [0005]    A prior art rendering device that allows a blind person to read brail is a binary device that can be electronically driven. What the prior art does not provide is real-time haptic data input and output that can be used to create virtual touch and telepresence of living beings or objects that are not in direct contact with each other. What is needed are haptic input output devices so that haptic data can be transmitted and rendered.  
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0006]    The present invention is illustrated by way of example and is not limited in the figures of the accompanying drawings, in which like references indicate similar elements.  
         [0007]    [0007]FIG. 1 depicts prior art audio data transmission via telephone communication and visual data transmission and display on a computer monitor.  
         [0008]    [0008]FIG. 2 displays some of the other forms of communication intended by haptels.  
         [0009]    [0009]FIG. 3 displays the input and output functions of a haptel.  
         [0010]    [0010]FIG. 4 displays a haptel that combines input and output functions into one device.  
         [0011]    [0011]FIG. 5 shows a user feeling the surface of an array of haptels.  
         [0012]    [0012]FIG. 6 depicts virtual real-time touch and tickling of a baby&#39;s foot.  
         [0013]    [0013]FIG. 7 displays an array of haptels configured with amplifiers, analogue to digital converters and a haptel memory buffer.  
         [0014]    [0014]FIG. 8 shows a network of N HRDs.  
     
    
     DETAILED DESCRIPTION  
       [0015]    A haptel and haptic rendering device (HRD) are disclosed, which allow a user to virtually feel the texture of an environment or virtually touch another person&#39;s hand that lives on the other side of the continent. Haptel refers to a single haptic element. An HRD comprises one or more haptels, which will provide the user with the ability to feel a surface, object or another user. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that these details need not be used to practice the present invention. In other circumstances, well-known structures, materials, circuits, processes and interfaces have not been shown or described in detail so that the present invention is not unnecessarily obscured.  
         [0016]    A haptel may be used for both inputting and outputting haptic data. Haptic data may be any data, which defines the ontology of an object. Some examples of haptic data are coordinates that define spatial position, velocity, temperature, force, and pressure. Indirect forms of haptic data may be emotions, such as joy, or anger.  
         [0017]    In one embodiment of the present invention, input and output functions of a haptel may be performed in separate devices. With reference to FIG. 3, a first user might have access to input haptel  30  and output haptel  32 , while at another location a second user might have access to input haptel  34  and output haptel  36 . The two users would be separated from each other, while the haptels were connected by signal path  10 . User  1  would apply stimulus  30   a  to haptel element  30   b  such that signal  30   c  would be generated by input haptel  30 . Signal  30   c  could travel through signal path  10  and be received and displayed on output haptel  36 . Signal  30   c  might cause output haptel  36  to generate stimulus  36   a  resulting in signal  30   c  being rendered on haptel element  36   b . In a similar manner, although not shown on FIG. 3, is the concurrent ability for user  2  to generate a signal with input haptel  34  that would be rendered or displayed on output haptel  32 , which could be read by user  1 .  
         [0018]    For the purposes of illustration, haptel element  30   b  and  36   b , in FIG. 3, are depicted as pins, which may move up and down in frame  30   d  and  36   d , respectively. Many alternative mechanisms may be employed according to the present invention to serve as a haptel. For example, a piston may be moved up and down relative to a cylinder due to the expansion and contraction of a material contained within the cylinder. The material contained within the cylinder may be a fluid, a gel, a crystal, or any material that exhibits a change in volume due to an applied stimulus. For example, when using a material that exhibits a volume change in response to an applied electric field, a piston is move a distance proportional to the amount of current applied.  
         [0019]    Another way in which the haptel could be actuated is through the use of hydraulics to move each haptel element. Alternatively, another method is to create a magnetic current for the haptel by running a wire around a region of the haptel to create a coil and move the haptel element by charging the coil. Yet another way of actuating the haptel element could be through the use of small motors. Many configurations of drive mechanisms are possible for the haptel element. The distance that the haptel element may travel is a function of a particular design and is not limited by the present invention. Distances on the order of four to eight centimeters are contemplated for certain applications, however, much larger or smaller distances might be used depending on the values of the haptic data that the user wished to display.  
         [0020]    Temperature might be displayed on the haptic element by the use of thermoelectric heating or cooling devices to display the temperature of a surface. While the haptic element has been depicted as a pin, in FIG. 3, the present invention is not so limited. Haptic elements may be configured as desired according to the data the user wishes to display. In some instances the haptic element may be configured as a pad, which is sensitive to pressure. The haptel may be configured in many embodiments without departing from the spirit of the present invention.  
         [0021]    In another embodiment, of the present invention, the haptel may be configured to provide both input and output functions within a single device. With reference to FIG. 4, input/output (I/O) haptel  40  is connected via signal path  10  with I/O haptel  42 . An I/O haptel combines the ability to both display haptic data and input haptic data within a given device. By way of illustration, haptic data in the form of force is indicated by the length of the arrows used in FIG. 4; input force  40   a  is larger than output force  42   a.    
         [0022]    User  1  pushes on I/O haptel  40 , applying input force  40   a  to haptel element  40   b . Signal  40   c  is generated in response to input force  40   a . Signal  40   c  arrives at I/O haptel  42 , by way of signal path  10 . At I/O haptel  42 , force  40   a  is reproduced in response to signal  40   c  and is imparted to haptel element  42   b.    
         [0023]    Similarly user  2  pushes on I/O haptel  42  by applying force  42   a  to haptel element  42   b . Signal  42   c  is generated in response to input force  42   a . Signal  42   c  arrives at I/O haptel  40  by way of signal path  10 . At I/O haptel  40 , force  42   a  is reproduced in response to signal  42   c  and is imparted to haptel element  40   b.    
         [0024]    In real time, user  1  pushes against force  42   a . Force  42   a  is displayed on I/O haptel  40  while being simultaneously generated by user  2  with I/O haptel  42 . Thus, user  1  experiences the virtual “push” of user  2  on I/O haptel  40 . Since force  40   a  has been arbitrarily chosen to be larger than force  42   a , user  1  will be able to overcome the push of user  2 , thereby moving haptel element  40   b  down in the direction indicated by input force  40   a.    
         [0025]    The corresponding display of haptic data will occur on I/O haptel  42 . User  2  will feel the virtual “push” manifested by input force  40   a  as input force  40   a  is displayed on I/O haptel  42 . Force  42   a  imparted by user  2  to haptel element  42   b  is smaller than force  40   a  displayed on I/O haptel  42 , therefore user 2  will be overcome by input force  40   a  as haptel element  42   b  is moved up in the direction indicated by input force  40   a  on I/O haptel  42 .  
         [0026]    In another embodiment, of the present invention, a group of haptels may be placed together to create an array of haptels which define a surface or a geometric shape. With reference to FIG. 5, a user is shown feeling the surface of an array of haptels. User&#39;s hand  54  is shown reading the haptic data displayed on array  50 . A user can see and feel the surface of array  50 . The surface of a haptic array can display any form of haptic data desired. The configuration of the array of haptels may take on any desired two or three-dimensional shape.  
         [0027]    For example, a haptel array could be configured as a ball that a user would squeeze or a glove into which a user would insert his hand that the haptel array would then squeeze, in this way users could virtually hold hands. Many configurations of a haptel array are possible; those that are mentioned in this detailed description are but a few and are not to be construed as limitations on the configurations that are possible.  
         [0028]    The previous discussion, directed to FIG. 4, concerned an I/O haptel configured to read and display force. However I/O haptels may be configured as required to read and display other forms of haptic data. For example, an array of haptels forming a surface could change relative to the dance of a virus in a scanning electron microscope or the discrete gray scale values in an image. Haptel elements  56  could be positioned to different levels to symbolize bold or italic text from a source of alpha numeric or graphic data, such as a web page, document, or spreadsheet. Communication between users of haptels provides a form of telepresence between the users that has not been possible with prior art communication devices.  
         [0029]    An example of communicating telepresence is displayed in FIG. 6. With reference to FIG. 6 a real-time virtual ability to tickle a baby&#39;s foot is demonstrated. Haptel array  66  and haptel array  62  could be configured as separate input and output devices, as shown in FIG. 3, or combined I/O devices, as shown in FIG. 4. Grandmother&#39;s hand  64  inputs haptic data into haptel array  66 , which is communicated to haptel array  62  via signal path  10 . Baby  60  places her foot on haptel array  62  and can virtually “feel” grandmother&#39;s hand  64  tickle her foot as haptic data is displayed onto haptel array  62 .  
         [0030]    Signal path  10  may be any type of information transmission system configured to transmit and receive data. For example, haptic data may be sent over the Internet, or a wide area network to a user&#39;s home via a personal computer (PC). The PC unpacks the data and updates the haptel array to reflect the new information. The amount of data for a full haptel array update is approximately equivalent to an amount of data required to render a gray scale image with the same number of pixels as haptels within the haptel array. Haptels may be configured for use with the pointing device used with a PC, such as a mouse or may be configured as a separate I/O device, which only accepts haptic data. Additionally, haptels may be configured for use with cell phones or other information transmission apparatus.  
         [0031]    The signal path for a haptel or haptel array may be configured according to various embodiments depending on whether the haptel is an analogue or digital device or a combination of analogue and digital design sub-sections. The present invention is not limited by the embodiment chosen for the signal path. One preferred embodiment for the signal path of an array of  25  analogue I/O haptels is shown FIG. 7. The convention established to describe a signal (signal  40   c  FIG. 4) generated by a user inputting a force (force  40   a  FIG. 4), to a haptel, will be maintained in the discussion of FIG. 7. The signal arising from the user&#39;s input force will be termed the “input signal” and the signal that results in haptic data being rendered to the haptel will be termed the “output signal,” thus the use of the terms input and output define whether haptic data is being input into the haptel or being output onto the haptel.  
         [0032]    With reference to FIG. 7, input signal path  72  directs the  25  haptel input signals, from haptel array  70 , into amplifiers  700  through  725 . The signal from amplifier  700  passes into analogue-to-digital converter  726  and then into haptel memory buffer  74 . The signal for each individual haptel is directed similarly. Haptel memory buffer  74  allows haptic data to be transmitted by transmitter/receiver  78  onto signal path  10 .  
         [0033]    Output haptic data, coming in on signal path  10  enters into haptel memory buffer  74  and is converted to an analogue signal by digital-to-analogue converters  776  through  800 . The output signals, from the digital-to-analogue converters are amplified by amplifiers  751  through  775 . The output signals traverse output signal path  76  into I/O haptel array  70 , where the output signals are displayed on I/O haptel array  70 .  
         [0034]    Haptel memory buffer  74  may be divided into input and output portions when needed to handle the needs of both forms of data transfer. Haptic data input and output may be implemented in a way that provides a real-time telepresence as previously discussed by continuously updating the haptel.  
         [0035]    In another embodiment, of the present invention, one HRD may send haptic data to a plurality of HRDs. FIG. 8 shows a network of N HRDs. With reference to FIG. 8, HRD  82  is connected with HRD  84 , HRD  86 , up to a general number N of HRDs, HRD  88 , via signal path  10 . The HRDs shown in FIG. 8 allow haptic data, input on one HRD, to be output on the other HRDs. For example, haptic data could be input on HRD  82  and be output on HRD  84 ,  86 , up to general number N of HRDs, HRD  88 .  
         [0036]    Other uses for haptels are envisioned. For example, the haptel could be used as an input/output device for computer games. A computer game may include doors that are activated by buttons. Haptels could be used to actuate the doors, allowing the user to push the haptel and in so doing operate the button that works in cooperation with the computer game. Another use may be in the field of computer-aided design (CAD).  
         [0037]    A CAD designer would be able to see the 3-D representation of an object rendered on a suitable haptel display. The haptel could render the 3-D geometry of an object the designer had created with a computer graphics program and as the object rotated on the computer screen, the object rendered on the haptel array could rotate as well.  
         [0038]    Alternatively, the haptel array could be used to read the shape of the object pressed against it. The CAD designer previously discussed could use data input into the haptel in this manner.  
         [0039]    In the foregoing specification, the invention has been described with reference to specific embodiment thereof. It will be, however, evident that various modifications and changes may be made thereto without departing from the broader scope and spirit of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than restrictive sense.