Abstract:
An apparatus providing a three dimensional tactile sense on a display of an electronic device. The apparatus comprises two layers. The bottom layer is a set of channels that form a matrix along x and y axes. The top layer comprises a matrix of small transparent columns. When the user interface provides the sensation of a three dimensional surface, the corresponding x and y coordinates that are mapped to the three dimensional surface are inflated. The change in volume forces a subset of columns upward in the direction orthogonal to the plane of the screen.

Description:
CROSS REFERENCE TO RELATED APPLICATION 
       [0001]    This application is a Continuation-in-Part Application of pending U.S. patent application Ser. No. 14/180,587 filed on Feb. 14, 2014. 
     
    
     FIELD OF THE INVENTION 
       [0002]    The present invention relates generally to user interfaces of electronic devices, and more particularly to providing a three dimensional tactile sense on a display of an electronic device. 
       BACKGROUND 
       [0003]    Touch screens have become pervasive in modern electronic devices. One reason for the growing popularity is the ability for the software to generate virtual controls, such as push buttons, menu icons, and sliders. Rather than creating costly physical buttons that may wear out, hardware manufacturers can create virtual buttons on the touch screens. Therefore, interfaces of electronic devices include many virtual rather than physical buttons. These virtual buttons are found on electronic devices as diverse as smart phones and dashboards in automobiles. A user interacts with computer-generated virtual buttons on a flat screen, on which the virtual buttons have no actual presence in the third dimension. The virtual buttons have length and width, but no actual depth. 
         [0004]    User-interface designers often use shading to indicate the shadow of a virtual button that is tappable. The user learns to interact with the virtual buttons and panels. If the user interface is internally consistent, the location of each of the virtual push buttons is consistent and the user can tap the spot without having to look directly for its exact location. At this point, the body&#39;s proprioceptive sensation, such as the position of the hand using a mouse or the position of the finger tapping a push button on a smart phone, is so well learned that the user avoids looking at the target or consciously positioning the cursor. Once this has happened, the user is said to have developed a feel for the user interface. 
         [0005]    Touch screens have an advantage that they can act as both a display showing the user interface and a control allowing the user interface to be manipulated. Prior to touch screens, a display was a non-interactive monitor and a control was an input device such as a keyboard. A disadvantage of the touch screens is that their surfaces are perfectly flat and they furnish no tactile feedback. The traditional physical controls, such as a piano keyboard or the different shapes of the physical knobs of a car radio, offer the sensation of a three dimensional surface through user&#39;s touch. The user&#39;s fingers sense when they are touching the three-dimensional volume control and the tuning knob, or pressing a key on the keyboard. For example, without a traditional keyboard, the user must use their eyes—they will not be able to use their sense of touch on a flat screen, and as a result, they must redirect their attention from the road or from the music sheet while they use their eyes to scan the surface of the radio or keyboard. The absence of tactile feedback makes the user spend more time looking at the controls rather than focusing on their main task, such as driving the car or reading the music sheet. 
       SUMMARY 
       [0006]    Embodiments of the present invention provide an apparatus providing a three dimensional tactile sense on a display of an electronic device. The apparatus comprises a first layer atop a plane of the touch screen. The first layer comprises a grid of first tubular channels and second tubular channels. The first tubular channels are substantially orthogonal to the second tubular channels. The apparatus further comprises a second layer atop the first layer, and the second layer comprises solid columns. The solid columns are positioned at intersections of the first tubular channels and the second tubular channels. Respective ones of the first tubular channels and respective ones of the second tubular channels are capable of increasing dimensions in a direction substantially orthogonal to the plane. When at least one subset of the first tubular channels and at least one subset of the second tubular channels increase the dimensions in the direction substantially orthogonal to the plane, at least one subset of the solid columns is raised in a direction substantially orthogonal to the plane so as to provide the three dimensional tactile sense on the display. 
     
    
     
       BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 
         [0007]      FIG. 1  shows a diagram illustrating layers of an apparatus for physical presence of virtual buttons on a touch screen of an electronic device, in accordance with one embodiment of the present invention. 
           [0008]      FIG. 2  show a diagram illustrating a grid of m×n overlapping channels in a layer atop a touch screen of an electronic device, in accordance with one embodiment of the present invention. 
           [0009]      FIG. 3  shows a diagram illustrating a cross section of a raised area shown in  FIG. 2 , in accordance with one embodiment of the present invention. 
           [0010]      FIG. 4  shows a diagram illustrating layers of an apparatus for providing the three dimensional tactile sense on a conventional screen of an electronic device, in accordance with one embodiment of the present invention. 
       
    
    
     DETAILED DESCRIPTION 
       [0011]    The present invention is described in detail in the following embodiments with reference to the figures. The foregoing description of various embodiments of the present invention has been presented for purposes of illustration and description. It is neither intended to be exhaustive nor to limit the invention to the precise form disclosed. Many modifications and variations are possible. Such modifications and variations that may be apparent to a person skilled in the art of the invention are intended to be included within the scope of the invention as defined by the accompanying claims. 
         [0012]    It is to be understood that the disclosed embodiments are merely illustrative of the claimed structures and methods that may be embodied in various forms. In addition, each of the examples given in connection with the various embodiments is intended to be illustrative, and not restrictive. Further, the figures are not necessarily to scale, some features may be exaggerated to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the methods and structures of the present disclosure. 
         [0013]    An approach disclosed in embodiments of the present invention provides an apparatus whereby the surface of a display screen becomes raised in order to produce a sensation of touch as the finger moves across the surface. The central idea is a touch screen panel composed of thousands of transparent rectangles that rise and fall to give a physical dimension to the user interface objects. The physical layer underneath the rectangular plastic matrixes is controlled by software. 
         [0014]    Using an example of a console in an automobile, the touch screen console may show different modes: the radio, the GPS, the thermostat, etc. When the radio mode is activated, a touch screen layout with volume control, radio station preset, seek, and scan buttons may appear. These buttons will be raised to represent the controls encountered during the radio mode. When the user switches to the GPS mode, the touch screen will change to the three-dimensional controls needed for navigation, including zoom in and out on the map, select favorite locations, etc. The plastic matrix composing the surface would raise up giving depth to the zoom in and out controls. If the console switches to the thermostat, then the surface will reset to the new set of virtual buttons such as the fan switch and the thermostat knob. When power is turned off, all physical buttons on the touch screen panel will disappear and the console becomes flat. The matrixes of raise-able transparent plastic rectangles snap back to form a flat surface. 
         [0015]    The present invention presents a method to correct the touch screen&#39;s shortcoming and the method allows the surface of the screen to dynamically rise or fall. The area of the screen where the tuning knob is drawn has a raised surface that can be detected by the user&#39;s finger. For example, consider an 8″×8″ touch screen in an automobile. On the left side of the screen is a virtual button drawn by the software, and the virtual button represents the control for the volume of music. If the volume button is 1″×1″, then the touch screen will have a raised surface that is 1″×1″×¼″ under the rendered button. Now that there is a section of the screen that is raised one fourth of an inch above the rest of the screen, the user can slide their finger across the touch screen to locate the button more easily. 
         [0016]    Naturally, the more raised the screen, the easier it is for the user to feel the difference with their fingers. The more the raised area is shaped like the control (e.g., round raised surface for circular controls on the touch screen), the easier the user can identify the type of control. Ultimately, the raised surface of the touch screen will mimic the original physical object—an actual keyboard made of plastic with raised surfaces representing the keys. On a touch screen, the English QWERTY keyboard will have  26  raised surfaces to represent the  26  letters of the alphabet. The Enter button will be twice as long, giving the user a larger surface area to touch. The surface of the touch screen has now transformed from a perfectly smooth and flat surface to that of a raised surface that completely matches the original. 
         [0017]    Embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In all drawings, a Cartesian coordinate system is used to indicate three-dimensional directions (X-direction, Y-direction, and Z-direction). 
         [0018]      FIG. 1  shows a diagram illustrating layers of apparatus  100  for physical presence of virtual buttons on a touch screen of an electronic device, in accordance with one embodiment of the present invention. Apparatus  100  comprises layer  101  which is an electronic device, layer  102  which is a touch screen of the electronic device, and layer  103  which is atop the touch screen. Layer  103  includes, in the X-Y plane, a grid of m×n matrixes or channels which are filled with a fluid and are controlled by the software in layer  101 . When one or more selected subsets of the matrixes or the channels are forced up along the +Z direction, one or more areas are raised in the +Z direction.  FIG. 1  shows raised area  104 . Layer  101 , or the electronic device, is a smartphone, a radio set, a GPS set, a thermostat, or any electronic device which has a touch screen display. 
         [0019]      FIG. 2  shows a diagram illustrating a grid of m×n overlapping channels in layer  103  atop a touch screen (layer  102 ) of electronic device  100 , in accordance with one embodiment of the present invention. In an example of layer  103 , m channels  202  and n channels  201  form a m×n grid on the top (the X-Y plane) of substrate  200 . Channels  202  and channels  201  form a grid with a resolution of m×n. For example, the grid can be overlapping channels  202  and  201  with a resolution of 800×600. A transparent fluid, such as water, air, and oil, can be pushed through channels  202  and  201 . When the transparent fluid is pushed through channels  202  and  201 , the selected subset of columns (which are atop of channels  202  and  201 ) are forced up, giving the raised physical pushbuttons. As an example,  FIG. 2  shows raised area  204 . Area  204  is raised up when the transparent fluid is pushed into some channels of channels  202  and  201 , In this example, channels A, B, C of channels  202  (denoted by numerals  202 - 1 ,  202 - 2 , and  202 - 3 , respectively) are raised; channel  1 ,  2 , and  3  of channels  201  (denoted by numerals  201 - 1 ,  201 - 2 , and  201 - 3 , respectively) are raised. 
         [0020]      FIG. 3  shows a diagram illustrating a cross section of raised area  204  shown in  FIG. 2 , in accordance with one embodiment of the present invention.  FIG. 3(A)  shows the cross section of raised area  204  under the condition where channels  202 - 1 ,  202 - 2 ,  202 - 3 ,  201 - 1 ,  201 - 2 , and  201 - 3  are not inflated. In the sectional drawing presented in  FIG. 3 , cross sections in the transverse direction of channels  202 - 1 ,  202 - 2 , and  202 - 3  are shown, and a cross section in the axial direction of channel  201 - 1  is shown.  FIG. 3  shows an example of layer  103  shown in  FIG. 1 . 
         [0021]    Referring to  FIG. 3 , columns  301  are at intersections between channels  202  (e.g.,  202 - 1 ,  202 - 2 , and  202 - 3  shown in  FIG. 3 ) and channels  301  (e.g.,  201 - 1  shown in  FIG. 3 ). Columns  301  may be rectangular, cylindrical, or other shape known to be used to make a column. Columns  301  are plastic or glass columns, or any other transparent material. Channels  202  (e.g.,  202 - 1 ,  202 - 2 , and  202 - 3  shown in  FIG. 3 ) and channels  201  (e.g.,  201 - 1  shown in  FIG. 3 ) are flexible tubing that swells when the transparent fluid is pumped into the channels, and deflates when the pumps for the channels are turned off. As the channels swell, they push columns  301  upward in the Z-direction. The flexible channels that swell with the transparent fluid are controlled by pumps surrounding substrate  200  that raises columns  301 . There are many other ways of pushing columns  301  up using heating a fluid, such as with a thermometer, electronics and magnets with solenoids, etc. As shown in  FIG. 3(A) , when the transparent fluid, such as water, air, and oil, is not filled in channels  202 - 1 ,  202 - 2 ,  202 - 3 ,  201 - 1 ,  201 - 2 , and  201 - 3 , the channels are deflated; therefore, columns  301  are not pushed up in the Z-direction. As shown in  FIG. 3(B) , when the transparent fluid, such as water, air, and oil, is filled in channels  202 - 1 ,  202 - 2 ,  202 - 3 ,  201 - 1 ,  201 - 2 , and  201 - 3 , the channels are inflated; as a result of inflation of the channels, columns  301  are pushed up in the Z-direction. The rising of columns  301  forms raised area  204  shown in  FIG. 2 . 
         [0022]    The selection of the transparent fluid in the matrixes or channels is driven by many factors, such as the nature of the activation, the economic factors, and ecological factors. For example, pumps are more expensive than a single heat source for making the transparent fluid increase in volume. If the transparent fluid is water or oil, then the mechanism that pushes the liquid can be controlled by m and n (e.g., 800 and 600) switches at the X-Y plane shown in the figures. If the resolution of layer  103  is 800×600, 1400 switches are needed; this number of switches is very economical. Compared to electronic valves and transistors, physical valves are prone to failure but they are cheaper. In an example of using wax (as used in modern thermometers), the material expands when heated. A heat source can be positioned either at every point on the grid (e.g., 240,000) or along the X and Y axis (e.g., 1400) if the expansion can be tuned well enough for the union of the temperatures to force columns up. The heat source can be something as cheap as a modern LED (light emitting diode) or piezoelectric sparks generated by bending crystals known to have a piezoelectric property, such as quartz crystals. 
         [0023]      FIG. 4  shows a diagram illustrating layers of apparatus  400  for providing the three dimensional tactile sense on a conventional screen of an electronic device, in accordance with one embodiment of the present invention. Apparatus  400  comprises layer  401  which is an electronic device, layer  402  which is a conventional screen of the electronic device, and layer  403  which is atop the conventional screen. Layer  403  includes a grid of m×n overlapping channels shown in  FIG. 2 ; in the X-Y plane, the grid of m×n channels are filled with a fluid and are controlled by the software in layer  401 . When one or more selected the channels are forced up along the Z direction, one or more areas are raised in the Z direction.  FIG. 4  shows raised area  404 . Layer  401 , or the electronic device, is a smartphone, a radio set, a GPS set, a thermostat, or any electronic device which has a conventional display (rather than a touch display shown in  FIG. 1 ). In  FIG. 4 , a conventional computer monitor is shown as an example. The application of apparatus may be used to provide sensation of a three dimensional surface, for the purpose of allowing a user to better sense an object shown the conventional display by augmenting the visual sense with a tactile sense. 
         [0024]    Layer  402  (or the conventional display) may be oriented in a vertical plane (as shown in  FIG. 4 ) as is more common with conventional displays, or may be oriented in a horizontal plane. In the case where Layer  402  (or the conventional display) is oriented in a vertical plane, the deflation described in previous paragraphs with reference to  FIG. 3  may not be effective due to a gravity effect; therefore, additional parts, such as conventional springs or a conventional magnetic method of returning the columns (shown in  FIG. 3 ) to unexpanded positions, are required. 
         [0025]    Having described preferred embodiments of a tunable semiconductor device (which are intended to be illustrative and not limiting), it is noted that modifications and variations may be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments disclosed which are within the scope of the invention as outlined by the appended claims.