Method and system for tactile display

A system and method for a touch display system. The a touch display system includes: a flat touch display assembly including a matrix of flat Braille pixels, wherein each flat Braille pixel is operable to be placed in one of two states. A heating source is selectively connected to each flat Braille pixel. A cooling source selectively connected to each flat Braille pixel. The flat Braille pixels are configured to represent images to touch by selective heating and cooling thereof. In one embodiment, the above described display can be used in combination with software that automatically converts text to Braille which is displayed using the flat touch display assembly.

FIELD

Embodiments according to the present invention generally relate to touch systems, in particular to Braille systems for the vision impaired.

BACKGROUND

Braille is the language of visually impaired readers whose vision is impaired to the extent that they cannot read printed material. Reading Braille relies on the sense of touch, where reading is done by running a finger over a combination of characters.

A typical Braille character is comprised of six raised pins or bumps in a Braille cell grid having three rows high and two columns wide. Different combinations of the six pins represent different characters. In other applications, a Braille cell may be comprised of 8 or more Braille dots arranged in a grid four or more rows high and two columns wide.

Refreshable Braille Displays (“RBDs”) are devices that allow visually impaired readers to review work or read material, which an enabled reader can do on a computer screen. RBDs range in terms of the number of characters presented on one line, but most standard displays can present in the range of from 40 to 80 cell characters at a time.

Unfortunately, many visually impaired people are forced to use the traditional audio device method to review work or read material due to the scarce supply and high cost of RBDs. This problem stems from the fact that the Braille displays currently available are very expensive to produce and maintain. These devices typically utilize a dedicated actuator for each raised character dot in a cell grid. These actuators expand when an electric potential is applied to them, producing a change in the mechanism leading to a protruding bump. Due to the complexity and intricacy of the actuators and the RBDs, repairs are expensive and inconvenient because they require the user to relinquish their unit for the duration of the repair. Because moving, mechanical parts are used, these displays receive routine maintenance and require periodic repair.

Improvements in such devices producing refreshable Braille text for tactile reading by the blind and visually impaired could broaden accessibility of computer services such as electronic books, e-mail and other network access, and general computer use to the blind. Improvements in cost and reliability would facilitate more widespread use of RBDs.

SUMMARY

Embodiments of the present invention are directed to a method and system for tactile image display. In one embodiment, a touch display system includes: a flat touch display assembly including a matrix of flat Braille pixels, wherein each flat Braille pixel is operable to be placed in one of two states; a heating source selectively connected to each flat Braille pixel; and a cooling source selectively connected to each flat Braille pixel. In one embodiment, the above described display can be used in combination with software that automatically converts text to Braille which is displayed using the tactile refreshable display.

In other embodiments the flat touch display system includes a number of Braille cells, wherein each Braille cell includes a number of the flat Braille pixels. In some embodiments the flat touch display assembly is a touch image display, and the matrix of flat Braille pixels is disposed to represent images to touch.

In other embodiments, the heating source is configured to represent Braille text by selectively heating a number of the flat Braille pixels. In some embodiments, the cooling source is configured to represent the absence of Braille text by selectively cooling a number of the flat Braille pixels.

In some embodiments, the flat touch display system includes a number of the flat Braille pixels, wherein the number of the flat Braille pixels is configured to represent images to touch by selective heating and cooling thereof. In some embodiments, the flat touch display system includes a heat conducting material configured to selectively connect the heating source and the cooling source to the matrix of flat Braille pixels.

In another embodiment, a system includes a smooth tactile display including a pattern of smooth pixels; wherein each smooth pixel includes a heating and cooling device; and an insulator surrounding each smooth pixel.

In some embodiments, the system includes a number of cells, wherein each cell includes a number of the smooth pixels. In some embodiments, the heating and cooling device of each smooth pixel is a solid-state active heat pump.

In other embodiments, the smooth pixels are configured to represent Braille text by selective heating. In some embodiments, the smooth pixels are configured to represent the absence of Braille text by selective cooling. In some embodiments, the pattern of smooth pixels is configured to display tactile images by selective heating and cooling. In some embodiments, the heating and cooling device is a Peltier element.

In another embodiment, a method includes heating a first plurality of flat Braille pixels in a flat tactile display; and cooling a second plurality of flat Braille pixels in the flat tactile display; wherein the heating and cooling forms a smooth tactile image to touch.

In other system embodiments, the forming the smooth tactile image includes forming Braille text. In some embodiments, the forming the smooth tactile image includes forming a tactile image of a visual representation.

In some system embodiments, the heating and the cooling includes heating and cooling the pluralities of flat Braille pixels using a thermoelectric heat pump. In some embodiments, the heating the first number of Braille pixels includes heating a first plurality of Peltier elements. In some embodiments, the cooling the second number of Braille pixels includes cooling a second number of Peltier elements.

These and other objects and advantages of the various embodiments of the present invention will be recognized by those of ordinary skill in the art after reading the following detailed description of the embodiments that are illustrated in the various drawing figures.

DETAILED DESCRIPTION

The drawings showing embodiments of the system are semi-diagrammatic and not to scale and, particularly, some of the dimensions are for the clarity of presentation and are shown exaggerated in the drawing Figures. Also, where multiple embodiments are disclosed and described having some features in common, for clarity and ease of illustration, description, and comprehension thereof, like features one to another will ordinarily be described with like reference numerals.

FIG. 1is a diagram of a point heating and cooling device100, according to an embodiment of the present invention. The point heating and cooling device100may be used to convert visual information into touch information. For example, a number of point heating and cooling devices may be arranged to represent Braille characters in a tactile display. Hot areas of the tactile display would represent Braille characters, and cold areas of the tactile display would represent the absence of Braille characters. Visually impaired people would read the display through tactile recognition of the Braille hot areas, e.g. via touch.

In an embodiment, a pixel102is connected to a heat source104and a cooling source106. A heat conductor108rapidly transfers heat to the pixel102from the heat source104. In addition, the heat conductor108rapidly transfers heat from the pixel102to the cooling source106. In an embodiment, the heat conductor108is metallic, for example copper, or a metallic or non-metallic super heat conductor, for example carbon nanotubes.

In an embodiment, a control gate110and an insulator112control the transfer of heat to and from the pixel102. The insulator112thermally isolates the pixel102, the heat source104, the cooling source106, and the heat conductor108. The control gate110selectively prevents or allows heat to transfer between the pixel102and the heat source104or the cooling source106.

FIG. 2Ais a magnified diagram of the control gate110allowing heating of the pixel102(FIG. 1). The control gate110includes a first control202and a second control204. The first control202, for example a switch, is turned on, allowing heat to transfer from the heat source104(FIG. 1) to the pixel102(FIG. 1). The second control204, for example a switch, is turned off, preventing heat from transferring from the pixel102(FIG. 1) to the cooling source106(FIG. 1). The insulator112thermally isolates the first control202and the second control204.

FIG. 2Bis a magnified diagram of the control gate110allowing cooling of the pixel102(FIG. 1). The first control202is turned off, preventing heat from transferring from the heat source104(FIG. 1) to the pixel102(FIG. 1). The second control204is turned on, allowing heat to transfer from the pixel102(FIG. 1) to the cooling source106(FIG. 1). The insulator112thermally isolates the first control202and the second control204.

FIG. 3is a diagram of an exemplary eight point Braille heating and cooling device300, according to an embodiment of the present invention. The eight point Braille heating and cooling device300includes a number of pixels302connected to a heat source304and a cooling source306. A heat conductor308rapidly transfers heat to the pixels302from the heat source304. In addition, the heat conductor308rapidly transfers heat from the pixels302to the cooling source306.

In an embodiment, control gates310and an insulator312selectively control the transfer of heat to and from the pixels302. The insulator thermally isolates the pixels302, the heat source304, the cooling source306, and the heat conductor308. The control gates310selectively prevent or allow heat to transfer between the pixels302and the heat source304or the cooling source306.

Therefore, the eight point Braille heating and cooling device300can simultaneously heat, for example, a first group of pixels314and cool a second group of pixels316. Braille characters are formed in the Braille cell by selectively heating pixels corresponding to Braille dot characters. “Non-heated” pixels are cooled, thus improving the contrast and tactile readability of the Braille character. In alternate embodiments, an exemplary six dot Braille heating and cooling device could display Braille characters by heating and cooling a six dot array or selectively heating and cooling six dots within the eight dot array. In addition, in alternate embodiments, the amount of heating and cooling of the pixels can be adjusted by a user.

FIG. 4is a diagram of an exemplary eight point Braille heating and cooling device400, according to an embodiment of the present invention. The eight point Braille heating and cooling device400includes a number of pixels402. The pixels402are solid-state active heat pumps, for example Peltier elements. Wires408electrically connect the pixels402to power control units410. Thus, the pixels402actively heat or cool in response to electrical input from the power control units410. An insulator412thermally isolates the pixels402.

Therefore, the eight point Braille heating and cooling device400can simultaneously heat, for example, a first group of pixels414and cool a second group of pixels416. Braille characters are formed in the Braille cell by selectively heating pixels corresponding to Braille dot characters. Non-heated pixels are cooled, thus improving the contrast and tactile readability of the Braille character. In alternate embodiments, a six dot Braille heating and cooling device could display Braille characters by heating and cooling a six dot array or selectively heating and cooling six dots within the eight dot array.

FIG. 5is a plan view of a portion of a flat Braille text display500, according to an embodiment of the present invention. The flat Braille text display500is a one line, six dot code tactile display. Thus, groups of six pixels502are arranged into cells530. Each cell530may display one six dot Braille character. However, in alternate embodiments the flat Braille text display500may display any number of dot codes, for example a Braille eight dot code.

As described above, pixels502display Braille characters by heating and cooling. The flat Braille text display500may receive text to display from a variety of sources. For example, a computer, an optical character recognition device, downloadable content, etc.

As a visually impaired individual's hands move along the display, Braille characters displayed in the cells530are read by the hands, either left to right or right to left. When the hands reach the end of the flat Braille text display500, the flat Braille text display500displays a new line of Braille text by heating and cooling a different combination of pixels502within the cells530.

In an embodiment, the flat Braille text display500displays new Braille text immediately or shortly after the hands have passed over and read a Braille character, and before the hands have reached the end of the flat Braille text display500. In an embodiment, a user may select the how quickly or under what circumstances the flat Braille text display500displays new text.

FIG. 6is a plan view of a portion of a multi-line flat Braille text display600, according to an embodiment of the present invention. The multi-line flat Braille text display600is two line, six dot code tactile display. However, in alternate embodiments the multi-line flat Braille text display600may display any number of dot codes, for example a Braille eight dot code. In addition, the multi-line flat Braille text display600may have any number of display lines.

As described above, a visually impaired individual's hands move along the display, reading Braille characters. When the hands reach the end of a line or begin a new line of the multi-line flat Braille text display600, the multi-line flat Braille text display600displays a new line of Braille text by heating and cooling a different combination of pixels602in the line just read. In an embodiment, the pixels602do not form a set pattern of cells530(FIG. 5). Instead any combination of pixels602may form Braille characters.

In an embodiment, the multi-line flat Braille text display600displays new Braille text immediately or shortly after the hands have read a Braille character, and before the hands have reached the end of a line of the multi-line flat Braille text display600. In an embodiment, a user may select the how quickly or under what circumstances the multi-line flat Braille text display600displays new text.

In some embodiments, a user can read a line of the multi-line flat Braille text display600faster than the multi-line flat Braille text display600can refresh the line with new text by heating and cooling. In this case, the multi-line flat Braille text display600provides feedback to the user, indicating that the refresh has completed. For example, in an embodiment an audio signal and/or a tactile signal indicates that the refresh has completed. The tactile signal can be a designated location on the multi-line flat Braille text display600, indicating by point heating or cooling that the refresh has completed. The tactile signal can alternate between hot and cold each time, so that the user can easily tell the difference between refreshes. In an embodiment, the designated location for the tactile signal can also be used as a place for the user to configure the temperature of the hot and cold points.

FIG. 7is a graphical depiction of a portion of a flat tactile display700, according to a matrix embodiment of the present invention. The flat tactile display700is a 14 by 13 matrix of flat pixels702. However, in alternate embodiments flat tactile display700may be any sized matrix of flat pixels702.

The pixels702heat and cool, displaying Braille characters as described above. In addition, the flat tactile display700may also display tactile images. For example, the flat tactile display700may display a tactile pattern of pixels702in the shape of a dog, an airplane, a photograph, a computer display screen, etc. Instead of only reading lines of text, a visually impaired individual's hands750read the entire flat tactile display700, containing images, text, images and text, moving images, etc. For example, the flat tactile display700may be connected to a computer and form a tactile representation of the visual computer screen, thus enabling the visually impaired to navigate the internet.

FIG. 8is a graphical depiction of a portion of a flat tactile display800, according to a matrix embodiment of the present invention. The flat tactile display800is a higher resolution 28 by 26 matrix of pixels than the 14 by 13 matrix previously described.

As previously described, the pixels802heat and cool, displaying Braille characters and/or images. As the resolution increases the pixels802may get smaller, the level of detail increases, and the amount of information that can be displayed increases. However, if the pixels802are too small, a single pixel may be unreadable by a visually impaired individual's hands850. Therefore, in an embodiment multiple pixels802may be used to create a single point of Braille text. For example, an eight dot code might require 32 pixels of the flat tactile display800.

FIG. 9depicts a flowchart900of an exemplary method of thermal tactile display according to an embodiment of the present invention. Although specific steps are disclosed in the flowchart900, such steps are exemplary. That is, embodiments of the present invention are well-suited to performing various other steps or variations of the steps recited in the flowchart900.

In a step902, data is received regarding text and/or images for display in a visual display format. For example, inFIG. 5the flat Braille text display may receive information from a computer, an optical character recognition device, downloadable content from the internet, etc. Thus, the data may include web pages constructed of images and text.

In a step904, the data is converted into a Braille tactile display format. For example, a converter converts text into Braille data format for display on a flat touch display assembly. Thus, the web page image and text information is converted into touch recognizable images and text, e.g. Braille.

In a step906, a first number of flat Braille pixels are heated in a flat tactile display. For example, inFIG. 5a smooth tactile display includes a pattern of smooth pixels. Thus, the flat touch display assembly includes a matrix of flat Braille pixels, wherein each flat Braille pixel is operable to be placed in one of two states.

In an embodiment, the flat touch display assembly is a touch image display, and the matrix of flat Braille pixels is disposed to represent images to touch. In an embodiment, an insulator surrounds each smooth pixel, for exampleFIG. 3. In addition,FIG. 3illustrates a heat conducting material that is configured to selectively connect the heating source and the cooling source to the matrix of flat Braille pixels.

Each smooth pixel includes a heating and cooling device. The heating source is selectively connected to each flat Braille pixel. For example as described inFIG. 4, the heating and cooling device of each smooth pixel may be a solid-state active heat pump, e.g. a Peltier element. The heating source is configured to represent Braille text by selectively heating a plurality of the flat Braille pixels. Thus, the smooth pixels are configured to represent Braille text by selective heating.

In a step908, a second number of flat Braille pixels are cooled in the flat tactile display by a cooling source selectively connected to each flat Braille pixel. For example, inFIG. 5the smooth pixels are configured to represent the absence of Braille text by selective cooling. Thus, the cooling source is configured to represent the absence of Braille text by selectively cooling a number of the flat Braille pixels.

In a step910, the heating and cooling of the flat Braille pixels forms a smooth tactile image. For example, inFIG. 5the touch display system includes a number of Braille cells. Each Braille cell includes a number of the smooth flat Braille pixels. Thus, inFIG. 5the forming a smooth tactile image includes forming Braille text.

In an embodiment, a pattern of smooth pixels is configured to display tactile images by selective heating and cooling. For example, inFIG. 7a number of flat Braille pixels is configured to represent images to touch by selective heating and cooling thereof. Thus, the forming a smooth tactile image includes forming a tactile image of a visual representation. In addition as illustrated inFIG. 7, the heating and cooling of a plurality of flat Braille pixels may be done by a heat pump. For example, Peltier elements may heat a first plurality of Braille pixels, and Peltier elements may cool a second plurality of Braille pixels.

FIG. 10is a schematic overview of a computer implemented tactile display system1000suitable for implementing embodiments of the present invention. A flat tactile display device1002receives text and image information for display, for example from the internet1004. The flat tactile display device1002includes text and image conversion software1006and a thermal tactile display1008.

The text and image conversion software1006converts the text and image information from the internet1004into tactile information, for example converting visual text into Braille text. The thermal tactile display1008uses heaters1010and coolers1012to display the tactile information from the text and image conversion software1006.

FIG. 11is a block diagram of an example of a general purpose computer system1100within which a touch display system in accordance with the present invention can be implemented. In the example ofFIG. 11, the system includes a host central processing unit (CPU)1102coupled to a graphics processing unit (GPU)1104via a bus1106. One or more CPUs as well as one or more GPUs may be used.

Both the CPU1102and the GPU1104are coupled to memory1108. In the example ofFIG. 11, the memory1108may be a shared memory, whereby the memory stores instructions and data for both the CPU1102and the GPU1104. Alternatively, there may be separate memories dedicated to the CPU1102and GPU1104, respectively. The memory1108can also include a video frame buffer for storing pixel data that drives a coupled display1110.

The display1110may be a flat Braille text display, for exampleFIG. 6, and/or a flat tactile display, for exampleFIG. 7. The display1110may also include a visual monitor that can also be used, as for example by a repair technician and/or family members who are not visually impaired.

The system1100also includes a user interface1112that, in one implementation, includes an on-screen cursor control device. The user interface may include a keyboard, a Braille keyboard, a mouse, a joystick, game controller, and/or a touch screen device (a touchpad).

Generally speaking, the system1100includes the basic components of a computer system platform that implements functionality in accordance with embodiments of the present invention. The system1100can be implemented as, for example, any of a number of different types of computer systems (e.g., servers, laptops, desktops, notebooks, and gaming systems), as well as a home entertainment system (e.g., a DVD player) such as a set-top box or digital television, or a portable or handheld electronic device (e.g., a portable phone, personal digital assistant, or handheld gaming device).