# Patent

## Title
Electronic device and control method of electronic device

## Abstract

An electronic device includes a tactile sensation providing unit 30 configured to provide a tactile sensation to a contact object being in contact with a panel 10 and a controller 50 configured to control the tactile sensation providing unit 30 on the basis of data based on press to the panel 10 and data threshold corresponding to the data. After the tactile sensation providing unit 30 provides a tactile sensation, the controller 50 changes the data threshold in response to the data based on press to the panel 10.

## Background
CROSS REFERENCE TO RELATED APPLICATION
This application is a National Phase of International Application Number PCT/JP2013/000111, filed Jan. 11, 2013, and claims priority to and the benefit of Japanese Patent Application No. 2012-005511 filed on Jan. 13, 2012, the entire contents of which are incorporated herein by reference.
FIELD
The present invention relates to an electronic device and to a control method of an electronic device.
BACKGROUND
Recently, in electronic devices such as mobile phones, smartphones, tablet terminals, game machines, PCs (Personal Computers), electronic books, ATMs (Automated Teller Machines), automatic ticket vending machines, automatic vending machines, printers, copy machines, fax (facsimile) and the like, a growing number of electronic devices are equipped with a tactile sensation providing function that provides a tactile sensation to the operator when he/she operates a panel (for example, see Patent Literature 1).
CITATION LIST
Patent Literature
PTL 1: The publication of Japanese Patent No. 4633167
SUMMARY OF INVENTION
The present invention is to provide an electronic device that may improve a tactile sensation providing function and may provide a tactile sensation appropriately without causing any discomfort to the operator and to provide a control method of the electronic device.
An electronic device according to the present invention, which achieves the above matter, includes:
a tactile sensation providing unit configured to provide a tactile sensation to a contact object being in contact with a panel; and
a controller configured to control the tactile sensation providing unit on the basis of data based on press to the panel and data threshold corresponding to the data, such that
after the tactile sensation providing unit provides a tactile sensation, the controller changes the data threshold in response to the data based on press to the panel.
The controller changes the data threshold in response to the data based on press to the panel at the point in time when a predetermined period of time has elapsed from provision of a tactile sensation by the tactile sensation providing unit.
Furthermore, a control method of the electronic device according to the present invention, which achieves the above matter, is a control method of an electronic device configured to control a tactile sensation providing unit that provides a tactile sensation to a contact object being in contact with a panel by a controller on the basis of data based on press to the panel and data threshold corresponding to the data, and includes the steps of:
providing a tactile sensation to the tactile sensation providing unit; and thereafter, changing the data threshold that causes the tactile sensation providing unit to provide a next tactile sensation in response to the data based on press to the panel.
According to the present invention, a tactile sensation providing function may be improved so that a tactile sensation may be provided appropriately without causing any discomfort to the operator.



BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 is a block diagram illustrating a schematic configuration of an electronic device according to an embodiment of the present invention;
FIG. 2 is a certain partial circuit diagram relating to a piezoelectric element in FIG. 1;
FIGS. 3A-3C are diagrams illustrating respectively an example of a mounting structure of the electronic device in FIG. 1;
FIGS. 4A-4C are diagrams that explain respectively a basic determination algorithm when a piezoelectric element is shared between a tactile sensation providing element and a press detection element;
FIG. 5 is a diagram illustrating a certain change in an output voltage of the piezoelectric element based on the basic determination algorithm in FIG. 4;
FIG. 6 is a diagram illustrating, in the basic determination algorithm in FIG. 4, an example of certain change in output voltage of the piezoelectric element when a release threshold voltage is set based on a voltage value after a charge discharge processing by the piezoelectric element;
FIG. 7 is a schematic diagram illustrating a vector calculated by a press/release determination unit in FIG. 1;
FIG. 8 is a diagram illustrating a change in output voltage of the piezoelectric element in a press pattern of “normal press/release”;
FIG. 9 is a diagram illustrating an example of a certain source code of a vector determination portion of the press/release determination unit in FIG. 1;
FIG. 10 is a diagram illustrating a change in output voltage of the piezoelectric element in a press pattern of “hold”;
FIG. 11 is a diagram illustrating an example of a certain source code of the changed portion of a reference value by the press/release determination unit in FIG. 1; and
FIG. 12 is a diagram illustrating an example of a certain source code of the changed portion of a release threshold vector by the press/release determination unit in FIG. 1.



DESCRIPTION OF EMBODIMENTS
An embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram illustrating a schematic configuration of an electronic device according to an embodiment of the present invention. The electronic device 1 illustrated in FIG. 1 has a panel 10, a display 20, a tactile sensation providing unit 30, a memory 40 and a controller 50. The controller 50 includes a press/release determination unit 51 and a tactile sensation control unit 52.
The panel 10 is disposed normally on the front surface of the display 20, and detects, on the operation face of the panel 10, contact or release of contact of a contact object (e.g. a finger or a stylus pen) to an object displayed on the display 20. Also, the panel 10 detects contact of a contact object to the operation face and supplies a signal according to the detected contact position to the controller 50. The panel 10 is configured using a known type, such as a resistive film type, a capacitive type and the like.
The display 20 is configured using, for example, a liquid crystal display panel (LCD), an organic EL display panel and the like, controlled by the controller 50 and displays objects such as characters, images, videos and the like.
The tactile sensation providing unit 30 is configured using, for example, a piezoelectric element 31. The piezoelectric element 31 is disposed on the backside of the panel 10, which is opposite the operation face thereof, and generates vibration of a predetermined vibration pattern in response to a drive signal (drive voltage) applied from the tactile sensation control unit 52. Thereby, the piezoelectric element 31 provides a predetermined tactile sensation to a contact object being in contact with the operation face of the touch panel 10.
Then, an output voltage (analog data) obtained from the piezoelectric element 31 based on press to the panel 10 is supplied to the press/release determination unit 51. That is, in the electronic device 1 according to the present embodiment, the piezoelectric element 31 is used as a tactile sensation providing element and as a press detection element (a press detection element as an acceleration sensor, that is, an element that outputs a voltage in response to a pressure applying velocity or acceleration).
The memory 40 stores operation programs and various thresholds of the electronic device 1 in a nonvolatile manner, and also stores various calculation results and the like in a nonvolatile or volatile manner.
The controller 50 controls the entire operation of the electronic device 1, and determines the processing to be executed based on the information input from the panel 10. The press/release determination unit 51 obtains an output voltage from the piezoelectric element 31 based on press to the panel 10, determines press or release based on the obtained output voltage, and supplies the determination result to the tactile sensation control unit 52.
The tactile sensation control unit 52 applies a predetermined drive signal to the piezoelectric element 31 based on the determination result from the press/release determination unit 51. Thereby the piezoelectric element 31 provides a predetermined tactile sensation to the contact object being in contact with the operation face of the panel 10.
FIG. 2 is an exemplified partial circuit diagram relating to the piezoelectric element 31 in FIG. 1. One electrode (positive electrode) and the other electrode (negative electrode) of the piezoelectric element 31 are connected to the tactile sensation control unit 52. The positive electrode and the negative electrode of the piezoelectric element 31 are connected to ADC (analog-digital converter) 80 via changeover switches 61 and 62 and capacitors 71 and 72. Then, the output from ADC 80 (data based on press (ADC value, digital data)) is input to the press/release determination unit 51.
The tactile sensation control unit 52 includes step-up converters 521 and 522, a positive electrode voltage control circuit 523 and a negative electrode voltage control circuit 524. The step-up converters 521 and 522 increase an input voltage and generate a predetermined voltage. The positive electrode voltage control circuit 523 receives the voltage generated by the step-up converter 521 and generates a drive signal for positive electrode under control of the controller 50. The generated drive signal for positive electrode is applied to the positive electrode of the piezoelectric element 31. Also, the negative electrode voltage control circuit 524 receives the voltage generated by the step-up converter 522 and generates a drive signal for negative electrode under control of the controller 50. The generated drive signal for negative electrode is applied to the negative electrode of the piezoelectric element 31.
Then, when the controller 50 causes the piezoelectric element 31 to function as a press detection element, it turns on the changeover switches 61 and 62. Thereby, the output voltage from the piezoelectric element 31 passes through the capacitors 71 and 72, is converted into ADC value by ADC 80, and is supplied to the press/release determination unit 51. Here, for the output voltage from the piezoelectric element 31, DC component thereof is cut by the capacitors 71 and 72, and only AC component (fluctuation) is supplied to ADC 80. ADC 80 has, for example, an intermediate potential of about 1.5V, and with the intermediate potential as a reference value (reference voltage), the potential on the input side (the side of the capacitors 71 and 72) of ADC 80 fluctuates.
Then, when the controller 50 causes the piezoelectric element 31 to function as a tactile sensation providing element, it turns off the changeover switches 61 and 62 so that a drive signal applied to the piezoelectric element 31 is not input to ADC 80. In this state, according to the determination result by the press/release determination unit 51, the controller 50 causes the tactile sensation control unit 52 to apply a drive signal for positive electrode to the positive electrode side of the piezoelectric element 31, and to apply a drive signal for negative electrode to the negative electrode side of the piezoelectric element 31, thereby causing the piezoelectric element 31 to vibrate.
Here, for the drive signal for positive electrode and the drive signal for negative electrode applied to the piezoelectric element 31, in order to prevent the piezoelectric element 31 from being in a depolarized state, the minimum voltage of the drive signal for positive electrode should be equal to or more than the maximum voltage of the drive signal for negative electrode. For example, when the withstand voltage of the piezoelectric element 31 is 40V, the controller 50 causes, with the intermediate potential of 20V, the step-up converter 521 of the tactile sensation control unit 52 to increase the input voltage of 3.6V, for example, to generate an output voltage of 40V, and causes the step-up converter 522 to increase the input voltage of 3.6V to generate an output voltage of 20V.
Then the controller 50 causes the positive electrode voltage control circuit 523 to generate, for example, a half cycle sine wave drive signal for positive electrode, with an amplitude of 20V to 40V, and to apply the generated drive signal for positive electrode to the positive electrode of the piezoelectric element 31. Also, the controller 50 causes the negative electrode voltage control circuit 524 to generate a half cycle inverse-phase sine wave drive signal for negative electrode with an amplitude of 0V to 20V, and to apply the generated drive signal for negative electrode to the negative electrode of the piezoelectric element 31. Thereby, the piezoelectric element 31 provides a predetermined tactile sensation to the contact object being in contact with the operation face of the panel 10. Note that the tactile sensation control unit 52 may, as long as within a range in which no depolarization of the piezoelectric element 31 occurs, apply a voltage that is lower than that for the negative electrode to the positive electrode.
FIGS. 3A-3C illustrate an example of a mounting structure of the electronic device illustrated in FIG. 1. FIG. 3A is an appearance perspective view. FIG. 3B is a schematic cross sectional view taken from line B-B in FIG. 3A. FIG. 3C is a plan view of the main part. The electronic device 1 illustrated in FIG. 3 is what is called a smartphone. The display 20 is enclosed and held in a housing 11. The panel 10 is held above the display 20 via insulators 12 made of an elastic member. The panel 10 is held above the display 20 via insulators 12 provided respectively at the four corners, away from a display region A of the display 20 illustrated in FIG. 3C by phantom lines.
Also, in the housing 11, an upper cover 13 is provided so as to cover a surface region of the panel 10, which is away from the display region of the display 20. An insulator 14 made of an elastic member is provided between the upper cover 13 and the panel 10.
Note that, for the panel 10 illustrated in FIG. 3, the surface member having the operation face (surface) 10a is made of, for example, transparent film or glass, and the back side member having the back face 10b is made of glass or acrylic. The panel 10 is configured so that, when its operation face 10a is pressed, the pressed portion thereof bends (strains) slightly or the structure itself bends slightly according to the pressing force.
On the back side 10b of the panel 10, piezoelectric vibrators 31 to vibrate the panel 10 are provided respectively, via adhesive or the like, near each of two opposing sides. The two piezoelectric vibrators 31 are driven in parallel or independently, thereby causing the panel 10 to vibrate, and the operation face 10a vibrates. Note that, in FIG. 3C, the housing 11, the upper cover 13 and the insulator 14 illustrated in FIG. 3B are omitted.
Here, the algorithm for determining press/release of the contact object to/from the panel 10 is discussed. FIGS. 4A-4C are diagrams illustrating a basic determination algorithm when the piezoelectric element 31 is used as a tactile sensation providing element and as a press detection element. FIG. 4A is a timing chart illustrating a discharge timing of the piezoelectric element 31. FIG. 4B is a timing chart illustrating a drive timing of the piezoelectric element 31. FIG. 4C is a diagram illustrating an output voltage from the piezoelectric element 31 supplied to the input side of ADC 80. In this determination algorithm, first, the controller 50 causes the piezoelectric element 31 to function as a press detection element. Then, in the press/release determination unit 51, when the output voltage from the piezoelectric element 31 based on press of a contact object to the panel 10 by the operator reaches the threshold voltage (R0) and is determined as press, the controller 50 causes the piezoelectric element 31 to function as a tactile sensation providing element. Thereby, the tactile sensation control unit 52 drives the piezoelectric element 31 and provides a tactile sensation to the operator. Then, after the piezoelectric element 31 is driven, in order to restore the output voltage from the piezoelectric element 31 to the reference voltage, the controller 50 executes processing of discharging the charge of the piezoelectric element 31 in the discharge circuit (charge discharge processing).
After that, the controller 50 causes the piezoelectric element 31 to function as a press detection element, and when the operator removes the contact object from the panel 10 (release), the output voltage from the piezoelectric element 31 changes from the reference voltage to the minus direction. In the press/release determination unit 51, when the output voltage from the piezoelectric element 31 reaches the threshold voltage (R1) and is determined as release, the controller 50 causes the piezoelectric element 31 to function as a tactile sensation providing element, and causes the tactile sensation control unit 52 to drive the piezoelectric element 31. Thereby, the piezoelectric element 31 provides a tactile sensation to the operator. Then, after driving the piezoelectric element 31, in order to restore the output voltage from the piezoelectric element 31 to the reference voltage, the controller 50 executes charge discharge processing of the piezoelectric element 31 to be prepared for the next determination operation.
FIG. 5 is a diagram illustrating a certain change in the output voltage from the piezoelectric element 31 based on the basic determination algorithm illustrated in FIG. 4. Here, the reference voltage is 1.6V. In the basic determination algorithm, for example, a threshold voltage for determining that press has been performed (hereinafter referred to as a press threshold voltage) and a threshold voltage for determining that release has been performed (hereinafter referred to as a release threshold voltage) are set respectively. Then, the press/release determination unit 51 determines, when the obtained output voltage value (ADC value) is more than the press threshold voltage (data threshold), that press has been performed, and when the obtained output voltage value is less than the release threshold voltage (data threshold), that release has been performed. In this case, it is assumed that the release threshold voltage is set lower than the reference voltage.
However, when the piezoelectric element 31 functions as a press detection element, it detects acceleration of depression (press acceleration). In this case, the piezoelectric element 31 has a characteristic in that it naturally discharges the charge accumulated by bending if there is no change in bending of the piezoelectric element 31. Therefore, when a contact object such as a finger is released from the panel 10, if the contact object is released slowly and not quickly, that is, the contact object is released in a manner of press pattern of, what is called a “slow release,” a voltage lower than the reference voltage may not be detected from the piezoelectric element 31. As a result thereof, even if the contact object 10 is released from the panel 10 before the output voltage reaches the release threshold voltage, it may be determined as a press state being kept.
As a method of solving such an inconvenience, it is assumed that a release threshold voltage is set based on the voltage value after the charge discharge processing of the piezoelectric element 31 (after the tactile sensation providing unit provides a tactile sensation). Thereby, even if the contact object is released from the panel 10 slowly, release may be determined FIG. 6 is a diagram illustrating an example of a change in the output voltage from the piezoelectric element 31 in this case. Although FIG. 6 illustrates a case where the release threshold voltage is set higher than the reference voltage, the release threshold voltage may be set lower than the reference voltage. Note that, in this case, the reference voltage is set to 1.5V. Note that, in FIG. 6, as described later, the press/release determination unit 51 determines the case where the obtained output voltage value is less than the release threshold voltage and the absolute value of the amount of change (negative amount of change) of the output voltage value satisfies (is more than) the absolute value of the release threshold vector (threshold of the amount of change) as “release.”
Also, the investors observed that, through their diligent experiments and examinations, in press/release, it is not the case that the output voltage from the piezoelectric element 31 will always take the waveform as illustrated in FIG. 6, and depending on the pressing state and the like by the operator, the waveform changes every time. For example, the inventors have found that the voltage value detected for the first time after the charge discharge processing, the amount of change and the direction of the change (positive or negative change) of the voltage detected after the charge discharge processing vary in each charge discharge processing. Thereby, an accurate determination of press/release may be difficult.
Then, in the electronic device 1 according to the present embodiment, a press threshold voltage as well as a release threshold voltage are set based on the voltage value after the charge discharge processing of the piezoelectric element 31 (ADC value obtained by the press/release determination unit 51). The press threshold voltage (in the case where a plurality of press threshold voltages are provided, and as a press to the panel 10 is increased, input at a plurality of stages may be accepted based on the plurality of press threshold voltages, for example, the press threshold voltage at the second stage) is set, for example, if a tactile sensation providing operation is not executed for over a predetermined period of time and the output voltage is the reference value, to an initial threshold voltage that is higher than the reference value by a predetermined voltage. Also, after a tactile sensation providing operation is executed, within a predetermined period of time after the latest provision of a tactile sensation, a press threshold voltage is set based on the output voltage in the predetermined period of time. In this case, for example, the press threshold voltage is set to a value obtained by adding a predetermined voltage to the output voltage at the point in time when a certain period of time has elapsed from provision of a tactile sensation by the tactile sensation providing unit (from the start of the tactile sensation providing processing or from the end thereof), or from the charge discharge processing (from the start of the charge discharge processing or from the end thereof). Note that, in this case, a press threshold voltage may not be set before elapse of the certain period of time, and whatever ADC value the press/release determination unit 51 obtains, it may not be determined as “press.” Also, the press threshold voltage may be set, for example, based on an output voltage after a tactile sensation is provided to the latest press (or after the charge discharge processing after provision of a tactile sensation) (the output voltage (ADC value) detected for the first time by the press/release determination unit 51), to the voltage value that is higher than the output voltage by a predetermined voltage.
Next, the release threshold voltage is set, for example, to a value obtained by subtracting a predetermined voltage from the output voltage at the point in time when a certain period of time has elapsed from, for example, provision of a tactile sensation by the tactile sensation providing unit (from the start of the tactile sensation providing processing or the end thereof), or from the charge discharge processing (from the start of the charge discharge processing or the end thereof). In addition, the release threshold voltage may be set, based on an output voltage after the latest provision of a tactile sensation (or after the charge discharge processing after the provision of a tactile sensation) (the output voltage value (ADC value) detected for the first time by the press/release determination unit 51), to the voltage value that is lower than the output voltage by a predetermined voltage. Thereby, a press threshold voltage and a release threshold voltage are changed and set each time the tactile sensation providing unit provides a tactile sensation.
Note that, as described above, the piezoelectric element 31 has a characteristic in that, it naturally discharges charge accumulated by bending, thereby, even if the contact object is released from the panel 10 after it is pressed against the panel 10, the output voltage lower than the reference voltage may not be detected from the piezoelectric element 31. Therefore, as described above, if the release threshold voltage is lower than the reference voltage when it is set to the above described value, that is, the value of the output voltage at the point in time when a certain period of time has elapsed minus a predetermined voltage, it may be set to a predetermined voltage (e.g. a voltage higher than the reference voltage by a predetermined voltage).
Note that, as described above, in press/release, the output voltage from the piezoelectric element 31 may not always take the waveform illustrated in FIG. 6, and the waveform may change significantly each time depending on the press condition of the operator and the like. Therefore, in the electronic device 1, in order to reduce the possibility that the output voltage from the piezoelectric element 31 exceeds the press threshold voltage or falls below the release threshold voltage without operator's intention, the press threshold voltage and the release threshold voltage may be set based on the amount of change in the output voltage after the charge discharge processing (after provision of a tactile sensation). For example, when a press threshold voltage is set to a value, which is the output voltage at the point in time when a certain period of time has elapsed plus a predetermined voltage, if the absolute value of the amount of change in the output voltage after the charge discharge processing is large, the predetermined voltage may be set to a large value, and if the absolute value thereof is small, the predetermined voltage may be set to a small value. Similarly, when the release threshold voltage is set to a value, which is the output voltage at the point in time when the certain period of time has elapsed minus a predetermined voltage, if the absolute value of the amount of change of the output voltage after the charge discharge processing is large, the predetermined voltage may be set to a large value, and if the absolute value thereof is small, the predetermined voltage may be set to a small value.
Furthermore, in the electronic device 1 according to the present embodiment, not only the press threshold voltage and the release threshold voltage, that is, the fixed threshold voltage (data threshold) corresponding directly to the output voltage value of the piezoelectric element 31, but also the threshold vector corresponding to the change in output voltage are used. Thereby, in the press/release determination unit 51, ADC value is obtained from ADC 80, and from the obtained ADC value, as schematically illustrated in FIG. 7, a vector indicating a temporal amount of change in ADC value and the polarity of the amount of change is calculated as well.
Then, the press/release determination unit 51 compares the obtained ADC value with the press threshold voltage and the release threshold voltage, which are data threshold stored in the memory 40, and compares the calculated vector with the press threshold vector and the release threshold vector stored in the memory 40 as well.
As a result thereof, if the calculated vector is a plus direction vector indicating an increase in the amount of change, and its absolute value (amount of change) satisfies the absolute value of the press threshold vector (threshold of the amount of change) a predetermined number of times in the press/release determination processing performed, for example, every 2 ms (e.g. if the absolute value of plus direction vector is larger than the absolute value of the press threshold vector, it is determined as “satisfied”), and the obtained ADC value satisfies the press threshold voltage as well, the press/release determination unit 51 determines it as “press.” Then, if the calculated vector is a minus direction vector indicating a decrease in the amount of change, and its absolute value (amount of change) satisfies the absolute value of the release threshold vector (threshold of the amount of change) a predetermined number of times in the press/release determination processing performed, for example, every 2 ms (e.g. if the absolute value of minus direction vector is larger than the absolute value of the release threshold vector, it is determined as “satisfied”), and the obtained ADC value satisfies the release threshold voltage as well, the press/release determination unit 51 determines it as “release.” The determination result of press/release by the press/release determination unit 51 is supplied to the tactile sensation control unit 52.
Here, the calculation of vector and the press/release determination processing by the press/release determination unit 51 are executed, for example, every 2 ms by using the average value calculated from the ADC values, which are obtained 10 times for about 40 μs. Then, the absolute value of the press threshold vector used for the determination of press is set larger than that of the release threshold vector used for the determination of release. That is, when pressing, if a force is continued to be applied, the ADC value continues to rise until it becomes physically impossible to rise, however, when releasing, if a contact object is released, it is impossible to decrease the ACD value any more. Thereby, if the absolute value of the release threshold vector is set to the same value as that of the press threshold vector, a “withheld release” (a phenomenon in which even if a contact object is released, release vibration may not be generated) tends to be caused. Thereby, for the release threshold vector, the conditions are eased (e.g. the absolute value of the release threshold vector is set smaller than that of the press threshold vector) to allow easy determination of release. Then, for the release threshold vector, when the release threshold voltage is set to the value closer to the reference value, the absolute value is set smaller than the case where the value is set far from the reference value to allow easy determination of release.
Furthermore, for the press threshold vector, when the press threshold voltage is set to the value which is far from the reference value, the absolute value thereof may be set smaller than the case where it is set to the value which is close to the reference value. Although the piezoelectric element 31 outputs a voltage when it is pressed and deformed, with an increasing amount of deformation thereof, its elastic force increases, thereby hardly be deformed. Therefore, in the piezoelectric element 31, when the amount of deformation increases and output voltage is large, in order to change the output voltage further, a larger force is required, compared with the case where the output voltage is small. Therefore, as described above, for the press threshold vector, when the press threshold voltage is set to the value which is far from the reference value, the absolute value thereof is set smaller than the case where the voltage is set close to the reference value, thereby improving the user operability whether the press threshold voltage is far from or close to the reference value.
Then, when the press/release determination unit 51 performs, as described above, the press/release determination processing at intervals of a predetermined period of time, and determines “press/release” when it determines that the absolute value of the vector of the output voltage (ADC value) from the piezoelectric element 31 is larger than the absolute value of the press/release threshold vector a predetermined times in a row, the absolute value of the press/release threshold vector may gradually be decreased with each press/release determination processing. Since the piezoelectric element 31 has a characteristic in that it naturally discharges the charge accumulated by bending, even if the bending state is kept, the output voltage becomes small with time. With such decrease in the output voltage with time in mind, the absolute value of the press/release threshold vector may be decreased gradually each time the press/release determination processing is performed.
In the tactile sensation control unit 52, according to the determination result from the press/release determination unit 51, a predetermined drive signal is applied to the piezoelectric element 31. Thereby a tactile sensation is provided to the operator who presses the panel 10.
The press pattern of the panel 10 by the operator includes four patterns such as, for example, “normal press/release,” “repeated strikes,” “hold” and “slow release.” The “repeated strikes” is a press pattern by which press and release are consecutively repeated in a short period of time. The “hold” is a press pattern by which, release is performed not immediately after press, and the press state is held for a while, and then release is performed, which is so called a “long press.” The “slow release” is a press pattern by which, as described above, when release is performed, the contact object is released from the panel 10 not immediately, but slowly. The “normal press/release” is a common press pattern belonging to none of the above described three patterns, and is a press pattern by which a panel 10 is pressed and is immediately released.
In the case of “normal press/release,” as described above, when the piezoelectric element 31 is driven by the tactile sensation control unit 52 based on the determination result from the press/release determination unit 51, the output voltage from the piezoelectric element 31 changes, for example, as illustrated in FIG. 8. Note that, in FIG. 8, for convenience sake, the vertical axis represents ADC value by ADC 80. ADC value is “0” at a minimum, “65520” at a maximum, and the reference value (reference voltage of 1.5V) is in between, which is “32760.”
As illustrated in FIG. 8, in the case of “normal press/release,” for example, after the piezoelectric element 31 discharges its charges after press vibration, ADC value rises sharply from the value that is smaller than the reference value. Then, after the piezoelectric element 31 discharges its charges immediately after the release vibration, for example, ADC value rises sharply and then rises slowly toward the value which is slightly larger than the reference value. Thereby, if the absolute value of the press threshold vector is set in a fixed manner, the vector after provision of a press/release tactile sensation satisfies the press threshold vector and may be determined erroneously as press.
Thereby, in the electronic device 1 according to the present embodiment, after the piezoelectric element 31 provides a press/release tactile sensation, further control is made so that the press/release determination unit 51 changes the threshold vector for press/release determination. In detail, in the output voltage waveform as illustrated in FIG. 8, in order to prevent the sharp rise of the voltage after provision of a tactile sensation from being determined as press, the absolute value of the press threshold vector is set larger immediately after the start of calculation of vector after provision of a tactile sensation, then is decreased with time.
FIG. 9 illustrates an example of certain source code of vector determination portion in the press/release determination unit 51. The variables illustrated in FIG. 9 are as follows:
“pre_ave_power”: ADC value obtained when the previous vector is determined;
“ave_power”: ADC value obtained when the present vector is determined;
“rel_vect”: Absolute value of release threshold vector;
“tilt”: Direction of vector [TILT_NONE: No change, TILT_MINUS: Minus direction, TILT_PLUS: Plus direction];
“vect_pow”: The value “100” is assigned immediately after a press, and the value is decreased by “1” until it becomes “0” each time a vector is determined;
“user_calibration.a_fn”: Value for in-plane calibration in response to the contact position on the panel 10; and
“up_times”: The number of times a plus direction vector is generated consecutively.
In FIG. 9, “else if (pre_ave_power>=(ave_power+rel_vect))” indicates the determination portion of minus direction vector. Then, the “else if (pre_ave_power<=(ave_power−0×3*vect_pow−(user_calibration.a_fn*2/up_times)))” indicates the determination portion of plus direction vector, and “vect_pow” prevents the sharp rise in voltage immediately after provision of a tactile sensation from being determined erroneously as press.
Then, when the press pattern is “hold,” the output voltage from the piezoelectric element 31 changes, for example, as illustrated in FIG. 10. The change in the output voltage in this case is basically the same as that of the “normal press/release.” However, also while the pressing force is kept after press, ADC value declines gently, thereby, which may be determined erroneously as release if the release threshold vector is set in a fixed manner.
Furthermore, after release vibration, for example, ADC value declines once, and restores slowly from the value that is significantly lower than the reference value to the reference value. Therefore, when a multistage press/release processing of two or more stages is performed in the same region of the panel 10, the width of ADC value required for ADC value to reach the press threshold voltage for the next press becomes wider than the normal one, which increases a force required for press, thereby causing discomfort to the operator.
Then, in the electronic device 1 according to the present embodiment, in the press/release determination unit 51, when the press pattern is “hold,” the absolute value of the release threshold vector after provision of a tactile sensation is further increased with time. The actual source code in this case is “else if (pre_ave_power>=(ave_power+rel_vect))” as illustrated in FIG. 9, in which “rel_vect” is a value by which a decline during “hold” is not regarded as release. Note that, the voltage decline rate of the piezoelectric element 31 varies depending on the pressed position on the panel 10, thereby the value of “rel_vect” is changed by “ser_calibration.a_fn” depending on the pressed position.
Furthermore, the press/release determination unit 51 sets, when it changes the setting of the press threshold voltage based on the voltage value after the charge discharge processing of the piezoelectric element 31, the ADC value at the point in time when a predetermined period of time has elapsed from provision of a release tactile sensation, that is, the ADC value at the point in time when a predetermined period of time has elapsed from the start of obtaining the ADC value after provision of a release tactile sensation as a reference value. Then, the press/release determination unit 51 changes the press threshold voltage so that the difference from the reference value will be a constant value, in accordance with the reference value that has been set.
FIG. 11 is a diagram illustrating an example of a source code of the changed portion of the reference value by the press/release determination unit 51 in this case. Then, FIG. 12 is a diagram illustrating an example of a source code of the changed portion of the release threshold vector. Variables indicated newly in FIGS. 11 and 12 are as follows:
“getV”: Obtained ADC value;
“base_getV”: ADC value which will be a reference (reference value). The press threshold voltage varies based on the difference from the reference value. The default value is “0xFFFF.”
“update_times”: The number of times a press/release determination is performed after provision of a tactile sensation. The press/release determination is performed every 2 ms; and
“down_thresh”: The number of consecutive times the minus direction vector is detected to be determined as release.
FIG. 11 illustrates a case where the ADC value after 16 ms from the start of obtaining ADC value after provision of a release tactile sensation is set as a reference value. Then, FIG. 12 illustrates a case where, when the time period from the press (value of update_times) is a certain value or more, it is regarded as “hold,” and the value of the release threshold vector (rel_vect) increases with time. Then, in FIG. 12, the position where the value of “user_calibration.a_fn” is less than “12” represents the position where a voltage is not detected appropriately, such as corners of the panel 10. On such positions, compared with the center of the panel 10, the value restores to the reference voltage sooner, and the decline rate is high, thereby the release threshold vector is set to a larger value. Furthermore, compared with the center of the panel 10, on the position where voltage is not detected appropriately such as corners of the panel 10, the value of the press threshold vector may be set to a smaller value.
According to the electronic device 1 of the above described embodiment, the output voltage (ADC value) from the piezoelectric element 31 is obtained and the vector indicating the temporal amount of change in the output voltage and the polarity of the amount of change is calculated as well, thereby the waveform of the output voltage caused by fluctuation of the contact object that is pressed/released by the operator may be recognized. Therefore, the press state and the release state may be recognized by comparing the vector with the threshold vector, thereby allowing a reliable determination of press/release for which a tactile sensation is provided.
Moreover, the threshold vector after provision of a tactile sensation is changed with time according to the press pattern, thereby, in the press pattern of “normal press/release,” a sharp rise in the absolute value of the plus direction vector after provision of a tactile sensation may be prevented from being determined erroneously as “press.” Then, in the press pattern of “hold,” the hold state of pressing force may be prevented from being determined erroneously as “release.”
Furthermore, the ADC value after a few ms from provision of a tactile sensation is set as a reference value, and the press threshold voltage is changed in accordance with the reference value that has been set, thereby realizing a relatively uniformed force required for press. Therefore, a tactile sensation providing function may be improved and a tactile sensation may be provided appropriately without causing any discomfort to the operator.
Note that the present invention is not limited to the above described embodiment, and variety of modifications and changes may be made. For example, in comparison of ADC value and threshold voltage by the press/release determination unit 51, the ADC value satisfies the press threshold voltage may be when the ADC value reaches the press threshold voltage, when the ADC value exceeds the press threshold voltage or when the press threshold voltage is detected by the press/release determination unit 51. Then, the ADC value satisfies the release threshold voltage may be when the ADC value reaches the release threshold voltage, when the ADC value falls below the release threshold voltage, or when the release threshold voltage is detected by the press/release determination unit 51. Similarly, the vector satisfies the threshold vector may be the point in time when the absolute value of the vector reaches the absolute value of the threshold vector, when the absolute value of the vector exceeds the absolute value of the threshold vector, or when the threshold vector is calculated by the press/release determination unit 51.
The press/release determination processing may be performed without using the vector calculated from the ADC value and the threshold vector, and may be performed by using an ADC value and a threshold voltage.
The panel 10 and the display 20 may be integrated into a device that includes a common substrate having both of these functions. An example of such device is a liquid crystal panel having a matrix of pixel electrodes, with a plurality of photoelectric conversion elements, such as photodiodes, regularly mixed therein. In such device, images are displayed by a liquid crystal panel structure, and on the other hand, the backlight for the liquid crystal display is reflected by the tip of pen that contacts with the desired position on the surface of the panel, and the light reflection is received by the peripheral photoelectric conversion elements, thereby the contact position may be detected.
Furthermore, in the above described embodiment, the panel 10 is used to detect contact to the operation face 10a, and it is also possible to determine that contact has been made when the output voltage from the piezoelectric element 31 satisfies the reference voltage corresponding to a predetermined press load.
The press detection element that obtains data based on press against the panel 10 may be provided independently, without sharing with the tactile sensation providing element. Therefore, in this case, as a press detection element, a vector of output voltage may be detected by using a piezoelectric element and a strain gauge, and a vector of contact area of the panel 10 may also be detected. Then, as a tactile sensation providing element, a vibration motor (eccentric motor) may be used and, by vibrating the motor, the touch face 10a of the panel 10 may be vibrated indirectly.
Furthermore, in the embodiment explained above, the reference value (reference voltage) is 1.5V or 1.6V, however, in the present invention, the reference value is not limited thereto, and may be 0V. Then, in the above described embodiment, as the data based on press, ADC value, which is digital data, is used. However, in the present invention, the data based on press is not limited thereto, and may be an output voltage, which is analog data. Then, all of the processing according to the present invention including data threshold may be processed by analog data.
REFERENCE SIGNS LIST


    
    
        1 Electronic device
        10 Panel
        20 Display
        30 Tactile sensation providing unit
        31 Piezoelectric element
        40 Memory
        50 Controller
        51 Press/release determination unit
        52 Tactile sensation control unit
        61,62 Changeover switch
        71,72 Capacitor
        80 ADC (analog digital converter)
        521,522 Step-up converter
        523 Positive electrode voltage control circuit
        524 Negative electrode voltage control circuit

## Claims

1. An electronic device, comprising:
a tactile sensation providing unit configured to provide a tactile sensation to a contact object being in contact with a panel; and
a controller configured to control the tactile sensation providing unit on the basis of data based on press to the panel, and
a data threshold corresponding to the data,

wherein
the controller is configured to change, after every time the tactile sensation providing unit provides a tactile sensation, the data threshold in response to the data based on press to the panel at a point in time when a predetermined time has elapsed from provision of the tactile sensation.

2. A control method of an electronic device, which comprises a controller and a tactile sensation providing unit configured to provide a tactile sensation to a contact object being in contact with a panel, the method executed by the controller and comprising:
controlling the tactile sensation providing unit to provide a tactile sensation on the basis of data based on press to the panel, and
a data threshold corresponding to the data; and

after each time the tactile sensation providing unit provides a tactile sensation and in response to the data based on press to the panel at a point in time when a predetermined time has elapsed from provision of the tactile sensation,
changing the data threshold for causing the tactile sensation providing unit to provide a tactile sensation next time.

3. An electronic device, comprising:
a tactile sensation providing unit configured to provide a tactile sensation to a contact object being in contact with a panel; and
a controller configured to control the tactile sensation providing unit on the basis of data based on press to the panel, and
a data threshold corresponding to the data,

wherein
the controller is configured to change, after the tactile sensation providing unit provides a tactile sensation, the data threshold in response to the data based on press to the panel,
the tactile sensation providing unit comprises a piezoelectric element configured to provide a tactile sensation, and
the piezoelectric element is also configured to detect the data based on press to the panel.

4. An electronic device, comprising:
a tactile sensation providing unit configured to provide a tactile sensation to a contact object being in contact with a panel; and
a controller configured to control the tactile sensation providing unit on the basis of data based on press to the panel, and
a data threshold corresponding to the data,

wherein
the controller is configured to change, after the tactile sensation providing unit provides a tactile sensation, the data threshold in response to the data based on press to the panel so that
the data threshold is changed to a first value when the tactile sensation providing unit provides the tactile sensation within a predetermined time period since a latest provision of a tactile sensation, and
the data threshold is changed to a second value different from the first value when the tactile sensation providing unit provides the tactile sensation after the predetermined time period since the latest provision of a tactile sensation.

5. A control method of an electronic device, which comprises a controller and a tactile sensation providing unit comprising a piezoelectric element configured to provide a tactile sensation to a contact object being in contact with a panel, the method executed by the controller and comprising:
detecting, by the piezoelectric element, data based on press to the panel;
controlling the tactile sensation providing unit to provide, by the piezoelectric element, a tactile sensation on the basis of
the data based on press to the panel, and
a data threshold corresponding to the data; and

after the tactile sensation providing unit provides a tactile sensation and in response to the data based on press to the panel, changing the data threshold for causing the tactile sensation providing unit to provide a tactile sensation next time.

6. A control method of an electronic device, which comprises a controller and a tactile sensation providing unit configured to provide a tactile sensation to a contact object being in contact with a panel, the method executed by the controller and comprising:
controlling the tactile sensation providing unit to provide a tactile sensation on the basis of data based on press to the panel, and
a data threshold corresponding to the data; and

after the tactile sensation providing unit provides a tactile sensation and in response to the data based on press to the panel, changing the data threshold for causing the tactile sensation providing unit to provide a tactile sensation next time, wherein said changing is such that
the data threshold is changed to a first value when the tactile sensation providing unit provides the tactile sensation within a predetermined time period since a latest provision of a tactile sensation, and
the data threshold is changed to a second value different from the first value when the tactile sensation providing unit provides the tactile sensation after the predetermined time period since the latest provision of a tactile sensation.