Input device using elastic material

A conventional mouse and keyboard poses great load on the user's finger and hands at key operation, and the material used for its surface is rigid. An input device which can reduce the load on the user's finger, and gives soft touch by avoiding abrupt change in downward pressure at key operation. The input device includes elastic material on the surface, a camera to image the back surface of a key when the key is pressed, an image processor which determines finger position from the image, and an output which generates a signal according to the finger position. By using this input device, the user can carry out operations similar to those achieved by a mouse and keyboard for a computer.

CLAIM OF PRIORITY

The present application claims priority from Japanese application JP 2005-257242 filed on Sep. 6, 2005, the content of which is hereby incorporated by reference into this application.

FIELD OF THE INVENTION

The invention relates to an input device having elastic material on its surface.

BACKGROUND OF THE INVENTION

A keyboard is widely used as a basic input device of a computer. Generally, a keyboard includes a key top and an electric switch, and has a stroke which indicates the degree of depression in order to generate “click” feeling at the time of input. A user feels as if the load is reduced at the point when the switch is turned on. This generates “click” feeling and the user can recognize the key is actually input.

However, the shock at the time of pressing a key and prolonged use of a keyboard poses load on the fingers and hands of the user. Recently, many users who use computers in everyday work suffer from tendovaginitis.

SUMMARY OF THE INVENTION

The invention provides a mouse and a keyboard having small stroke and soft touch in order to avoid tendovaginitis. The invention also provides a mouse which can be operated by feet instead of hands.

An input device incorporating a touch panel and elastic material is disclosed in JP 1996-171440 A titled “Electronic Device”, for example. This application discloses an electronics having a structure similar to an infrared touch panel. The surface of the electronics is sealed with an elastic member to avoid dirt.

Unfortunately, in this device, a user cannot replace the elastic member according to his/her preference. Generally, every user has different feelings as to stroke and “click” of the key. A user suffering from tendovaginitis wants to use an input device most comfortable for him, but has to select it from limited options. Furthermore, key operations involving two keys, for example pressing one alphabet key and “Shift key” or “Ctrl key” simultaneously, may frequently be necessary. However this operation cannot be carried out by above input device.

The invention addresses these problems. First, the invention provides an input device which gives less shock on the fingers at keyboard operation, by providing soft material on the surface of the keyboard. This input device will be of great use for those who have difficulty in keyboard operation due to tendovaginitis, for example. Secondly, the invention provides an input device which can be customized according to user's preference, by repeatedly setting or replacing the layout or material of the keyboard.

In order to address the above objects, the input device of the invention includes elastic material covering the part of a key pressed by the user's finger, and a unit to detect a position where the elastic material locally stretches when the user presses down that position on the elastic material.

The input device further includes an imaging unit which images the position pressed by the finger, an image processing unit which determines the position of the finger by analyzing the image, a signal generation unit which generates a signal according to the result of image processing, and a memory which stores correspondence between a finger position and a signal.

The input device further includes a detection unit which detects the pressed position using an infrared touch panel for example, a signal generation unit which generates a signal according to the position information thus obtained, and a memory which stores correspondence between a finger position and a signal.

The elastic material of the key can be replaced as desired. The input device further includes a setting unit by which the user assigns the key as desired, and a memory which stores the key assigned by the user.

The input device further includes a unit to provide a notification by light or sound based on the finger position to inform the user that a signal corresponding to the key input is generated.

The input device further includes a reader which reads tag information such as radio frequency identification (RFID), a memory which stores information associated to the tag, and a unit to retrieve the information to assist the user in replacing the elastic material suitable for specific application.

This structure can reduce the load posed on the user's fingers during keyboard operation.

By replacing the elastic material on the key top according to the user's preference or specific application, the user can have comfortable stroke and click feeling. Furthermore, the part the user's finger touches can be kept clean.

The elastic material on the key top can substantially reduce the switch sound at click and key-down. When the user wants feeling of “click” at pressing, the computer can make an artificial sound. Alternatively, a light source such as a light emitting diode (LED) can be effectively used instead of sound.

Next, exemplary embodiments will be described in detail with reference toFIGS. 1 to 17. Throughout several drawings, same or similar components or arrows will be referred using same or similar reference numerals, and the description thereof will not be repeated. It should be appreciated that the embodiments are described for illustrative purpose only, and the invention is not limited thereto.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

First Embodiment

FIGS. 1 to 10illustrate a first embodiment of the invention.

FIG. 1is a block diagram which illustrates an embodiment of the invention. In the figure,101is an elastic (film) member having a circumference or corners fixed on a frame,102is an imaging device such as a camera installed to image the back surface of elastic member101,103is a user,104is a computer device such as a personal computer,105is an input which acquires an image taken by imaging device102,106is a processor which detects the pressed position by analyzing the image,107is a memory which stores information including setting information,108is an output which generates a signal representing a key event based on the pressed position and setting information, and109is a controller which controls operation of input105, processor106, memory107and output108.

The elastic member may be made by a film comprising silicon rubber, or a fabric of nylon or polyurethane having high elasticity, for example.

The back surface of elastic member101has grid points. The points are separated by equal spacing from each other. The spacing between points can be set as desired according to intended precision. For example, for each key disposed on the top surface of the elastic member, one grid point is sufficient. However, the more points a key has, the more precise identification of the pressed position can be achieved.

When the back surface of elastic member101is imaged by imaging device102to determine the pressed position from the image, a plurality of points can be identified if the elastic member has adequate elasticity, because the elastic member stretches only at points pressed. Therefore, a user can carry out an operation involving two keys, for example, pressing one alphabet key and “Shift key” or “Ctrl key” simultaneously.

In the figure, imaging device102is installed so as to take an image of whole back surface of elastic member101. Alternatively, a plurality of imaging devices can be used to take partial images of the back surface. In this arrangement, the distance between elastic member101and imaging device102can be reduced.

The name of the key is indicated on the top surface of elastic member101(key top) by direct printing or a key label. User103can confirm the key to be input, and make input by pressing the key position on the top surface of elastic member101.

FIG. 2AandFIG. 2Billustrate the back surface of the elastic member of the invention.FIG. 2Aillustrates the surface before the elastic member is pressed with a finger, andFIG. 2Billustrates the surface after the elastic member is pressed. Before pressing, the elastic member is flat without bending so that the grid point position on the back surface of the elastic member is not displaced. When the top surface of the elastic member is pressed by a finger, the elastic member around the pressed position stretches. Some grid points on the back surface seem to be displaced according to the stretch of the elastic member. By comparing the images taken in the conditions illustrated inFIG. 2AandFIG. 2B, point202pressed by user201can be determined based on the direction and amount of the displacement of the points.

The force applied by the user pressing the key can be calculated based on the amount of the displacement of grid points. Depending on the force thus calculated, a signal to be generated can be altered. For example when a scrolling key is pressed, the scroll amount/speed can be adjusted according to the force applied thereto.

FIG. 3AandFIG. 3Billustrate characteristics necessary for the elastic member disposed on the surface of the input device of the invention.FIG. 3Aillustrates an example which uses a fabric having relatively low elasticity, andFIG. 3Billustrates an example which uses a fabric having high elasticity. If the elastic member is too soft and the whole film stretches when user303presses its surface, the pressed position cannot be determined correctly because of much error. Therefore, the elastic member to be used in this invention should have adequate elasticity. Preferably, the member stretches only at the point pressed by the user's finger, as shown inFIG. 3B. Fibers having above characteristics include nylon and polyurethane which are used as a material for stockings or sports wears.

FIG. 4illustrates relationship between the stroke and downward pressure from the beginning to the end of pressing. In the figure, a keyboard comprising mechanical switch401which is widely used in conventional keyboards, and a keyboard comprising an elastic member according to the invention are compared. Pressing begins at point A and ends at point B. In mechanical switch401, load increases gradually as the key is pressed deeply. At certain point, a sound indicating key input is generated and the load decreases. At this time, a user has a “click” feeling generated by change in downward pressure. When the user continues pressing after “click” feeling404, the key is actually input. The user learns that the key is actually input by having “click” feeling. However, abrupt change in downward pressure403causes much load on the finger, and is supposed to be one cause of development and pain of tendovaginitis.

On the other hand when the key has elastic member402, no abrupt change occurred in the downward pressure. The downward pressure increases monotonically with the stroke. Compared to conventional mechanical switch401, the load posed on the finger is remarkably reduced. Also, the time from beginning of pressing and actual input of the key can be adjusted as desired. The load on the finger, which is one cause of the tendovaginitis (or pain thereof), can be significantly reduced.

FIG. 5illustrates a process flow of the method according to the invention. The process includes imaging the back surface of the elastic member when a key is pressed by the user's finger, detecting the pressed position by analyzing the image, and generating a key event corresponding to the pressed position.

The detail of each step is as follows. In Step501, the image is analyzed to determine position coordinates of each grid point. In Step502, it is determined whether any change in position coordinate is made over time at every grid point. When no change is detected, the process returns to Step501to repeat taking and analyzing images. When any change in position coordinate is detected for a grid point, the point is identified by calculating the coordinate value of the position pressed by the user using the change (direction and distance) in Step503. In Step504, the key is identified by retrieving the position coordinate stored in the memory of the computer. Then a key event (signal) corresponding to the pressed position is generated.

FIG. 6illustrates a layout of the top surface of the elastic member according to the invention. Name of a key can be directly printed on the top surface of elastic member601or, the user can attach a label having printed character according to his preferred layout or spacing. Besides ordinary keys, command keys including “Ctrl+” can be provided.

By using rather thick label or applying some bordering after layout, the user can identify the keys at the time of input with his or her finger.

FIG. 7illustrates a process flow to store the key position information in the memory after the keys are assigned to the surface of the elastic member according to the invention.

The key position assigned by the user can be stored by having user press the newly assigned key one-by-one. First, in Step701, an announce screen “Press A key” is displayed to prompt the user input. In Step702, the user presses “A” key, and position of “A” key is input into the computer. This process is repeated for “B” key to “Z” key and other special keys to input position information for all keys. When position information has been input for all keys (Step703), the information is stored in association with each key (Step704).

FIG. 8shows an example to read the key assignment information corresponding to a tag, using a reader for reading RFID tags. For example, after assignment of keys, RFID tag is attached to elastic member801. The key positions on the elastic member are stored in the memory of the computer in association with the attached tag. Elastic member801is attached to vessel804in which imaging device803is installed. RFID tag reader is installed in vessel804. The RFID tag reader reads out tag information when elastic member801is attached to the top surface, and retrieves key assignment corresponding to elastic member801from the memory of computer806, in order to generate a key event in response to user's input.

FIG. 9shows an example to read the key assignment using an imaging device such as a camera and image processing technique. For example, keys902are assigned on elastic member901according to user's preference. After assignment, an image covering whole surface of elastic member901is taken by imaging device903such as a camera. In the figure,904is a computer device such as a personal computer,905is an input which acquires an image from imaging device903,906is a processor which analyzes the image to detect key assignment using character recognition or to identify a key from the pressed position based on the displacement of the grid points,907is a memory which stores key assignment information, and908is a controller which controls operations of input905, processor906, and memory907.

FIG. 10shows an example in which the user can identify keys by tactile impression of the surface of elastic member according to the invention. By using a relatively thick elastic member on each key according to key assignment, the user can recognize the key position by tactile impression of the surface. This configuration helps user's key input.

In the above description, the position where the elastic member is pressed represents a key. Alternatively, the pressed position can be used as a coordinate (or its change over time), and used in an input device such as a touch pad.

Second Embodiment

FIGS. 11 to 13illustrate a second embodiment of the invention.

FIG. 11is a block diagram which illustrates an embodiment of the invention. In the figure,1101is an elastic member having relatively fine mesh,1102is an elastic member having relatively coarse mesh compared with1101,1103is a user,1104is an imaging device such as a camera installed to image the back surface of elastic member1102,1105is a computer device such as a personal computer,1105is an input which acquires an image taken by imaging device1104,1107is a processor which analyzes the image to detect pressed position,1108is a memory which stores information including setting information,1109is an output which generates a signal representing a key event based on the pressed position and setting information, and1110is a controller which controls operations of input1106, controller1107, memory1108, and output1109.

Elastic member1101may be made with a film comprising silicon rubber, or a fabric of nylon or polyurethane having high elasticity, for example.

Elastic member1102may be made with a fabric which has relatively coarse mesh but high elasticity such as a fabric used for stocking.

Elastic member1101is laid on elastic member1102without using adhesive between them.

Imaging device1104is installed so as to take an image covering whole back surface of elastic member1102. Alternatively, a plurality of imaging devices can be installed to take partial images of the back surface. In this arrangement, the distance between elastic member1102and imaging device1104can be reduced.

Name of a key can be directly printed on the top surface of elastic member1101or, the user can attach a label having a printed character. User1103makes an input by pressing the intended key on the top surface of elastic member1101.

FIG. 12AandFIG. 12Billustrate the back surface of the elastic member of the invention.FIG. 12Aillustrates the surface before the elastic member is pressed with a finger, andFIG. 12Billustrates the surface after the elastic member is pressed. Before pressing, the elastic member is flat with no bending, thus the luminance of pixels in the image of the back surface of the elastic member is not changed. When the top surface of the elastic member is pressed by a finger, the member around the pressed position stretches. Elastic members1201and1202come close to each other in response to the downward pressure. Thus, seen from the imaging device (arrow1204), luminance of some positions appears to be changed. By comparing the images taken in the conditions illustrated inFIG. 12AandFIG. 12B, the point pressed by the user1203can be calculated.

Even when user1203presses two positions on elastic members1201simultaneously, they can be identified if the positions are not same. Therefore, a user can carry out an operation involving two keys, for example, pressing one alphabet key and “Shift key” or “Ctrl key” simultaneously.

FIG. 13illustrates a process flow of the operation according to the invention. The process includes steps of pressing the surface of two elastic members shown inFIG. 11, imaging the back surface of the elastic member when pressed by the user's finger, detecting the pressed position by analyzing the image, and generating a key event corresponding to the pressed position.

In Step1301, the image is analyzed to determine luminance of each pixel. In Step1302, the luminance of each pixel is monitored to detect any change over time. When no change is detected, the process returns to Step1301to repeat imaging and analyzing. When any change is detected for a pixel, the coordinate value of the pixel is calculated to determine the coordinate value of the position pressed by the user in Step1303. In Step1304, the position information of the key is retrieved from the memory of the computer, and a key event corresponding to the pressed position is generated.

Third Embodiment

FIG. 14toFIG. 17illustrate a third embodiment of the invention.

FIG. 14is a block diagram which illustrates an embodiment of the invention. In the figure,1401is a position detection unit such as an infrared touch panel,1402is an elastic member which covers the surface of position detection unit1401,1403is a user,1404is a computer device such as a personal computer,1405is an input which acquires data from position detection unit1401,1406is a memory which stores information including setting information,1407is an output which generates a key event in response to input data, and1408is a controller which controls operations of input1405, memory1406, and output1407.

Position detection unit1401is a device such as an infrared touch panel frame attached to a monitor that detects positions by using a plurality of light emitting element pairs and infrared sensors. The elements and sensors are arrayed in a horizontal and vertical matrix. When a finger blocks the infrared grid area of these light emitting elements, the position of the finger can be detected.

The distance between position detection unit1401and elastic member1402can be adjusted by interposing an appropriate member between them. That is, the distance can be set according to user's preference.

Elastic member1402may be made by a film comprising silicon rubber, or a fabric of nylon or polyurethane having high elasticity, for example.

Name of a key can be directly printed on the top surface of elastic member1402or, the user can attach a label having a printed character. User1403makes an input by pressing the intended key on the top surface of elastic member1402.

When an infrared touch panel which can identify a plurality of points, for example an infrared touch panel which can identify two points simultaneously is used as position detection unit1401, the user can carry out an operation involving two keys such as pressing one alphabet key and “Shift key” or “Ctrl key” simultaneously. When the detection unit can detect only one point, similar operation can be carried out by providing switch-like ON/OFF function to “Shift key” and “Ctrl key”.

FIG. 15AandFIG. 15Billustrate the surface of the elastic member of the invention.FIG. 15Aillustrates the surface before the elastic member is pressed with a finger. Before pressing, the elastic member is flat with no bending, thus the infrared grid emitted from position detection unit1502such as an infrared touch panel is not blocked. When elastic member1501is pressed by a finger, the member1501around the pressed position stretches as shown inFIG. 15B. The infrared grid of infrared touch panel1502is blocked and the pressed position can be detected.

FIG. 16is a block diagram of an embodiment in which “click” feeling is generated for user at input operation. In the figure,1601is a device such as an infrared touch panel which detects position of a finger,1602is an elastic member which covers surface of position detection unit1601,1603is a user,1604is a light emitting element such as LED,1605is a speaker,1606is a computer device such as a personal computer,1607is an input which acquires data from position detection unit1601,1608is a processor which determines the pressed position from input data,1609is a memory which stores information including setting information,1610is an output which generates a key event in response to input data, and1611is a controller which controls operations of input1607, processor1608, memory1609, and output1610.

Light emitting element1604and speaker1605is attached to the bottom of position detection unit1601. When user1603makes input, sound is output from computer1606at the time of a key event. The user can hear the sound via speaker1605.

The speaker1605can be turned ON/OFF. When the user1603does not use feedback by sound, speaker1605can be turned OFF.

The output from computer1606to speaker1605can be branched to LED light emitting element1604. When user1603makes input, LED as a visual feedback is flashed at the time of the key event. Alternatively, user1603can select type of the feedback, e.g., only light feedback emitted from LED, only sound feedback, or simultaneous light and sound feedback.

FIG. 17shows an example to avoid erroneous input in the input device according to the invention. A member1704is provided between elastic member1701and position detection unit1702such as an infrared touch panel.

Member1704is made from soft material such as a fabric or a film. A hole is made at each key position. When user1703makes an input by pressing exact key position, the key can be pressed. However, when user fails to press exact key position, the key is blocked by member1704, so that erroneous input can be avoided.