Patent ID: 12260033

DETAILED DESCRIPTION

Hereinafter, embodiments of the present disclosure will be described based on the drawings.FIG.1is a front view illustrating a display input device1(input device) according to an embodiment.FIG.2is a cross-sectional view taken along the line B-B ofFIG.1. The display input device1illustrated inFIGS.1and2is illustrated with a simplified structure of the device. Hereinafter, the front-rear direction, the left-right direction, and the up-down direction based on the display input device1are defined as indicated by arrows inFIGS.1and2.

The display input device1includes a display panel2such as a liquid crystal display or an organic EL panel, and a sensor panel3disposed to overlap the display panel2. A detection surface4for detecting an operation by a user is formed on the sensor panel3. The sensor panel3will be described in detail below. The display input device1has a function of displaying a video on the display panel2, and a function of receiving an operation on the detection surface4from the user. The display input device1is provided on, for example, an instrument panel of a vehicle, a center console of the vehicle, or another predetermined location of vehicle. However, a location where the display input device1is provided is not limited to the illustrated location.

As illustrated inFIGS.1and2, a cover member5made of glass or another transparent member is disposed on a front surface of the sensor panel3. A ring-shaped guide member6(guide member) is provided in the cover member5. The ring-shaped guide member6is fixed to the cover member5by adhesion or other units. That is, the ring-shaped guide member6is fixed onto the detection surface4of the sensor panel3with the cover member5. The ring-shaped guide member6is a transparent member containing a transparent material. However, the ring-shaped guide member6may not be transparent. In this embodiment, the ring-shaped guide member6is separate from the cover member5, but such members may be integrated.

As illustrated inFIGS.1and2, the ring-shaped guide member6includes a disk-shaped base portion7of which the back surface adheres to the cover member5, and an upright portion8provided to surround the base portion7. As illustrated inFIGS.1and2, the upright portion8is a ring-shaped portion in a front view, and a circular region9is formed inside the upright portion. The upright portion8is a portion extending in the state of protruding forward with respect to the detection surface4, an inner side wall10(side wall) is formed inside the upright portion, and an outer side wall11is formed outside the upright portion. The inner side wall10is formed to rise by a certain distance from a bottom surface12(the surface of the base portion7belonging to the circular region9).

The ring-shaped guide member6is operated in the following two modes. A first mode is a mode in which the finger of the user moves along the inner side wall10so as to rotate around a central portion O (FIG.1) of the upright portion8in a clockwise direction Y1(FIG.1) while touching the inner side wall10of the upright portion8of the ring-shaped guide member6. When the above operation is performed by the user, a control unit15of an operation detection device or an operation detector14described below enables the input and executes the corresponding action every time when the finger of the user rotates around the central portion O by “45°” in the clockwise direction Y1.

FIGS.3A and3Bare views illustrating a usage mode of the ring-shaped guide member6. In detail, referring to (A1) inFIG.3A, in the first mode, first, the finger of the user is disposed to touch the inner side wall10of the upright portion8of the ring-shaped guide member6and to touch the inner bottom surface12of the inner side wall10. InFIGS.3A and3B, a circle is marked at a point where the finger touches or approaches on the bottom surface12. Note that, a position at which the finger is initially disposed in the operation of the ring-shaped guide member6is not limited to the position illustrated in (A1) inFIG.3A, and may be any position inside the inner side wall10. The same applies to a second mode according to the operation of the ring-shaped guide member6. Thereafter, as illustrated in (A2) and (A3) inFIG.3A, the finger of the user moves so as to rotate around the central portion O along the inner side wall10while being in contact with the inner side wall10of the upright portion8, whereby the operation on the ring-shaped guide member6is performed.

In a case where the operations illustrated inFIG.3Aare performed, the control unit15of the operation detection device14detects that the finger rotates by 45° when the state of (A1) inFIG.3Ais changed to the state of (A2), enables the input, and executes the corresponding action. In this embodiment, as a simplified example, the control unit15executes an action of increasing the volume of an audio device (not illustrated) by one unit. Furthermore, the control unit15of the operation detection device14detects that the finger rotates by 45° when the state of (A2) inFIG.3Ais changed to the state of (A3), enables the input, and executes the corresponding action (the action of increasing the volume by one unit). In this manner, the user can gradually increase the volume of the audio device by moving the finger around the central portion O of the circular region9in the clockwise direction Y1while bringing the finger into contact with the inner side wall10of the upright portion8.

A second mode of the operation of the ring-shaped guide member6is an operation in which the finger of the user moves along the inner side wall10so as to rotate around the central portion O of the upright portion8in a counterclockwise direction Y2while touching the inner side wall10of the upright portion8of the ring-shaped guide member6. When the above operation is performed by the user, the control unit15of the operation detection device14described below enables the input and executes the corresponding action every time when the finger of the user rotates by “45°” around the central portion O in the counterclockwise direction Y2. The corresponding action is an action of decreasing the volume of the audio device by one unit.

FIG.3Billustrates the operation according to the second mode in the same method as inFIG.3A. In the example ofFIG.3B, when the state of (B1) inFIG.3Bis changed to the state of (B2) and when the state of (B2) inFIG.3Bis changed to the state of (B3), the input is enabled by the control unit15of the operation detection device14, and the corresponding action (the action of decreasing the volume by one unit) is executed. In this manner, the user can gradually decrease the volume of the audio device by moving the finger around the central portion O of the circular region9in the counterclockwise direction Y2while bringing the finger into contact with the inner side wall10of the upright portion8.

As described with reference to (D) inFIG.20, the finger may be rested on the upright portion8while the finger is moving in the operation on the ring-shaped guide member6. Here, the display input device1according to this embodiment is provided in a vehicle. Therefore, the housing of the display input device1may vibrate due to the vibration of an engine and other factors, and a case where the finger is rested on the upright portion8may easily occur due to the vibration.

FIG.4is a block diagram illustrating a functional configuration example of the operation detection device14according to this embodiment along with the configuration of an operation detection unit16. As illustrated inFIG.4, the operation detection unit16includes the display input device1and the operation detection device14. The display input device1includes a display panel2and a sensor panel3. The operation detection device14includes the control unit15as a functional configuration. The control unit15can be configured with any of hardware, a digital signal processor (DSP), and software. For example, when the control unit is configured with software, the control unit15actually includes a CPU, a RAM, and a ROM of a computer and is implemented by operating a program stored in a recording medium such as a RAM, a ROM, a hard disk, or a semiconductor memory.

The control unit15has a function of displaying a video on the display panel2. In the following description, it is assumed that the video is appropriately displayed on the display panel2from the control unit15, and the detailed description of this function will be omitted.

The control unit15has an electrostatic capacitance correspondence value detection function and a touch detection function. Hereinafter, these functions will be described in order.

<Electrostatic Capacitance Correspondence Value Detection Function>

First, the electrostatic capacitance correspondence value detection function will be described. The sensor panel3is an electrostatic capacitive touch sensor, and detected points are formed in a matrix form in the entire region of the detection surface4of the sensor panel3. Each of the detected points is a point at which a change in electrostatic capacitance is detected and an electrostatic capacitance correspondence value corresponding to the change in the electrostatic capacitance is detected. An electrostatic capacitance correspondence value table is stored in a storage area such as a RAM of the operation detection device14. In this electrostatic capacitance correspondence value table, coordinate information indicating coordinates (also functioning as identification information for uniquely identifying the detected point) and the electrostatic capacitance correspondence value detected by the control unit15are registered in association for all the detected points. The electrostatic capacitance correspondence value table is data in which a detection result of the sensor panel3is reflected. Accordingly, processing executed with reference to the electrostatic capacitance correspondence value table by the control unit15is processing executed based on a detection result of the sensor panel3.

The control unit15detects a change in the electrostatic capacitance at all the detected points based on the detection result of the sensor panel3at a predetermined cycle, and detects the electrostatic capacitance correspondence value indicating the magnitude of a change in the electrostatic capacitance at all the detected points. In this embodiment, to facilitate description, it is assumed that, as the electrostatic capacitance correspondence value, a value is taken in the range of 0 to 100 points (“points” are units for convenience), and when there is no change in the electrostatic capacitance, the electrostatic capacitance correspondence value is a minimum value of 0 points, and when an assumed maximum change occurs, the electrostatic capacitance correspondence value is a minimum value of 100 points. After the control unit15detects the electrostatic capacitance correspondence values at all the detected points, the control unit15updates the electrostatic capacitance correspondence value table based on the detected electrostatic capacitance correspondence values for the detected points. As a result, at a predetermined cycle, the values of the electrostatic capacitance correspondence values of the detected points registered in the electrostatic capacitance correspondence value table are updated to the values detected by the control unit15most recently.

The type of sensor panel3may be either a self-capacitance type of panel or a mutual capacitance type of panel (of course, another scheme may be used), and the control unit15detects a change in the electrostatic capacitance at each detected point and detects the electrostatic capacitance correspondence value by a method corresponding to the type of sensor panel3. As an example, the sensor panel3is a mutual electrostatic capacitance type of panel, and in the sensor panel3, an X-side sensor in which a transparent electrode is patterned to detect a change in the electrostatic capacitance in a left-right direction and a Y-side sensor in which a transparent electrode is patterned to detect a change in the electrostatic capacitance in an up-down direction are provided to overlap. The control unit15acquires the magnitude of electrostatic capacitance of each electrode of the X-side sensor and the magnitude of electrostatic capacitance of each electrode of the Y-side sensor at a predetermined cycle, detects the magnitude of a change in the electrostatic capacitance at each detected point based on the magnitude of electrostatic capacitance, and converts the magnitude of the change in the electrostatic capacitance into the electrostatic capacitance correspondence value.

<Touch Detection Function>

Next, the touch detection function will be described. A flowchart FA inFIG.5is a flowchart illustrating an information processing method by the operation detection device14. The control unit15executes the processing of the flowchart FA inFIG.5at a predetermined cycle.

As illustrated inFIG.5, the control unit15refers to the electrostatic capacitance correspondence value table stored in a predetermined storage area (step SA1). As described above, in the electrostatic capacitance correspondence value table, the coordinate information and the most recently detected electrostatic capacitance correspondence value are registered for each of the detected points formed on the detection surface4.

Next, the control unit15executes reaction point detection processing (step SA2). Reaction points A described below are a group of detected points (a set of one or more detected points adjacent to each other) at which the electrostatic capacitance correspondence value is a lowest detection threshold value TH1or more. Hereinafter, a detected point at which the electrostatic capacitance correspondence value is the lowest detection threshold value TH1or more is referred to as a “reaction detected point B”. The lowest detection threshold value TH1is set in advance from the viewpoint of reliable detection when the finger of the user approaches the detection surface4. The value of the lowest detection threshold value TH1is at least a value or less of a resting region threshold value TH2described below. The reaction points A are the group of detected points at which the electrostatic capacitance correspondence value is the lowest detection threshold value TH1or more. Therefore, when any object to be detected (which may not be a finger) approaches the detection surface4at any location on the detection surface4, the reaction point A appears at a position corresponding to the object to be detected.

In step SA2, the control unit15recognizes a relationship between the position of each detected point and the electrostatic capacitance correspondence value based on the electrostatic capacitance correspondence value table, recognizes the distribution of the reaction detected points B based on the relationship, and detects the reaction point A based on the distribution. No reaction point A may be detected, or one or more reaction points A may be detected.

In this embodiment, the control unit15detects all a “group of reaction detected points B” as the reaction points A. However, instead of setting all the “group of reaction detected points B” as the reaction points A, the control unit15may be configured to detect only points that are highly likely to appear due to the finger being in proximity to the detection surface4, among the “group of reaction detected points B”, as the reaction points A. In the case of this configuration, for example, the control unit15does not detect the “group of reaction detected points B” in which the reaction detected points B are distributed to be elongated beyond an allowable range as the reaction points A. This is because such a distribution of the reaction detected points B occurs due to noise. For example, the control unit15does not detect the “group of reaction detected points B” in which the reaction detected points B are distributed in a broad (or narrow) range beyond the allowable range as the reaction points A. This is because such a distribution of the reaction detected points B occurs due to the object to be detected other than the finger being in contact with or in proximity to the detection surface4.

After the processing of step SA2, the control unit15determines whether there are the reaction points A (step SA3). In a case where there is no reaction point A (step SA3: NO), the control unit15ends the processing of the flowchart FA. On the other hand, in a case where there are one or more reaction points A (step SA3: YES), the control unit15allows the processing procedure to proceed to step SA4.

In step SA4, the control unit15determines a reaction point position C and a reaction point value for each of the reaction points A. More specifically, the control unit15specifies the reaction detected point B having the highest electrostatic capacitance correspondence value, among one or more reaction detected points B (detected points of which the electrostatic capacitance correspondence value is the lowest detection threshold value TH1or more) included in the reaction points A. Then, the control unit15determines the electrostatic capacitance correspondence value of the reaction detected point B having the highest electrostatic capacitance correspondence value as the reaction point value, and further determines the position as the reaction point position C.

FIG.6is a diagram in which the detection surface4is divided into a matrix form for each detected point, and an electrostatic capacitance correspondence value of each detected point is written in each cell. Now, it is assumed that the lowest detection threshold value TH1is “60 points”. It is assumed that the electrostatic capacitance correspondence value is detected for each detected point as illustrated inFIG.6, in a certain region of the detection surface4. In the example ofFIG.6, a reaction point A-1is detected in a lightly painted region. In the example ofFIG.6, among the reaction detected points B belonging to the reaction point A-1, a reaction detected point B-1having an electrostatic capacitance correspondence value of “87 points” is the reaction detected point B having the highest electrostatic capacitance correspondence value. Therefore, for the reaction point A-1, the control unit15determines the reaction point position C as the position of the reaction detected point B-1, and determines the reaction point value as “87 points”.

A method for determining the reaction point position C and the reaction point value of the reaction point A is not limited to the method exemplified in this embodiment. For example, regarding the reaction point position C, the control unit15may be configured to set a position closest to the gravity center of the reaction point A as the reaction point position C. Further, for example, regarding the reaction point value, the control unit15may be configured to derive the reaction point value by performing some statistical calculation on the electrostatic capacitance correspondence value of the reaction detected point B included in the reaction point A.

After the processing of step SA4, the control unit15determines whether an operation mode is a mode before the start of the operation or a mode after the start of the operation (step SA5). The mode after the start of the operation is an operation mode in a period from when the control unit15detects that the operation on ring-shaped guide member6is started until the control unit15detects that the operation is released. The mode after the start of the operation is an operation mode in a period other than the “period of the mode after the start of the operation”. Therefore, in a period in which the user does not perform the operation on the ring-shaped guide member6, the operation mode is, in principle, the mode before the start of the operation. As it will be apparent later, the control unit15of the operation detection device14according to this embodiment has a function of detecting that the operation on the ring-shaped guide member6is started on the basis of the detection result of the sensor panel3, and the control unit15switches the operation mode between the mode before the start of the operation and the mode after the start of the operation by using this function.

When the operation mode is the mode before the start of the operation (step SA5: “MODE BEFORE START OF OPERATION”), the control unit15excludes a resting region18corresponding to a region where the finger rested on the upright portion8can be positioned from a “region where a touch is enabled”, and sets only an operation-corresponding region19as the region where a touch is enabled (step SA6).

FIGS.7A and7Bare views used to describe the operation-corresponding region19and the resting region18, in whichFIG.7Ais a front view of the periphery of the ring-shaped guide member6, andFIG.7Bis a cross-sectional view taken along the line C-C ofFIG.7A. The operation-corresponding region19is a region where the “reaction point position C based on the finger positioned in the circular region9of the ring-shaped guide member6” can be positioned. That is, when the finger approaches the detection surface4within the circular region9, the reaction point position C is positioned within the operation-corresponding region19. Therefore, while the finger is moving along the inner side wall10within the circular region9, the reaction point position C based on the finger is positioned within the operation-corresponding region19. InFIGS.7A and7B, the operation-corresponding region19is clearly illustrated. In particular, inFIG.7A, the operation-corresponding region19is a region inside a circle D1indicated by a dotted line. The operation-corresponding region19is a region corresponding to the circular region9, but the outer edge of the operation-corresponding region19does not necessarily coincide with the outer edge of the circular region9.

On the other hand, the resting region18is a region where the “reaction point position C based on the finger rested on the upright portion8” can be positioned. That is, the resting region18is a region corresponding to the “region where the finger rested on the upright portion8can be positioned”. Therefore, in a situation where the finger is rested on the upright portion8, the reaction point position C based on the finger is positioned within the resting region18.FIGS.7A and7Bclearly illustrate the resting region18. In particular, inFIG.7A, the resting region18is a region outside the circle D1indicated by the dotted line and inside a circle D2indicated by a dotted line. The resting region18is the region corresponding to the “region where the finger rested on the upright portion8can be positioned”, but the outer edge of the resting region18does not necessarily coincide with the outer edge when the upright portion8is viewed from the front.

“Including a certain region in the region where a touch is enabled” means that the control unit15detects the touch in a case where a predetermined condition is satisfied when the object to be detected approaches the detection surface4in the region. On the other hand, excluding a certain region from the “region where a touch is enabled” means that the control unit15does not detect any touch even in a case where in the region, the object to be detected approaches the detection surface4in any mode. As described above, in step SA6, the control unit15excludes the resting region18from the region where a touch is enabled, and sets only the operation-corresponding region19as the region where a touch is enabled. According to such processing, in the mode before the start of the operation, only the operation-corresponding region19is a region where a touch can be detected, and no touch is detected in the resting region18. The significance of the processing of step SA6will be clarified later.

After the processing of step SA6, the control unit15executes touch point detection processing before the start of the operation (step SA7). More specifically, the control unit15detects a point E in a normal operation as a touch point F. The point E in the normal operation is a “reaction point A in which the reaction point position C belongs to the operation-corresponding region19(=the region where a touch is enabled in step SA7) and the reaction point value is an operation-corresponding region threshold value TH3or more”, among the reaction points A.

The operation-corresponding region threshold value TH3is a threshold value set to such a value that the reaction point value of the corresponding reaction point A is the operation-corresponding region threshold value TH3or more when the user brings the finger close to the detection surface4within the circular region9for the purpose of operating the ring-shaped guide member6. In particular, the operation-corresponding region threshold value TH3is set to such a value that the reaction point value of the reaction point A based on the finger is the operation-corresponding region threshold value TH3or more during a period in which the user moves the finger along the inner side wall10to operate the ring-shaped guide member6in a normal mode. That is, the operation-corresponding region threshold value TH3is a threshold value for detecting a touch performed within the circular region9. Referring toFIG.7B, when the finger is brought into contact with the bottom surface12within the circular region9, a distance between the finger and a surface20of the display input device1is a distance L1. The operation-corresponding region threshold value is determined on the basis of a test or a simulation in advance in consideration of the distance L1.

In step SA7, the control unit15detects the point E in the normal operation as the touch point F on the basis of the reaction point position C and the reaction point value for each of the reaction points A determined in step SA4. A range on the coordinates of the operation-corresponding region19is defined in advance. No touch point F may be detected, or one or more touch points F may be detected. Hereinafter, the reaction point position C of the touch point F (not only the touch point F detected in the touch point detection processing before the start of the operation in step SA7but also the touch point F detected in touch point detection processing after the start of the operation in step SA12described below) is referred to as a “touch position G”.

After the processing of step SA7, the control unit15determines whether there is the touch point F (=the point E in the normal operation) (step SA8). When there is no touch point F (step SA8: NO), the control unit15ends the processing of the flowchart FA. On the other hand, when there are one or more touch points F (step SA8: YES), the control unit15detects a touch for each of the touch points F (step SA9).

Next, for each of the touch points F, the control unit15records information indicating the coordinates of the touch position G in touch position transition data in association with information for identifying the current timing (as an example, date and time engraved to millisecond) (step SA10). As described above, in the touch position transition data, the touch position G is recorded in time series for each detected touch. The touch position transition data is stored in a predetermined storage area. The touch position transition data is data in which the detection result of the sensor panel3is reflected. Accordingly, processing executed with reference to the touch position transition data by the control unit15is processing executed based on the detection result of the sensor panel3. After the processing of step SA10, the control unit15ends the processing of the flowchart FA.

As described above, in this embodiment, when the operation mode is the mode before the start of the operation (that is, when the start of the operation on the ring-shaped guide member6is not detected), the control unit15excludes the resting region18from the “region where a touch is enabled”. The reason for this is as described using the input device X1with a guide in the related art (FIGS.18,19, and20) as an example, but will be described in more detail below.

That is, it is assumed that the user who is a person on board a vehicle in which the display input device1is provided desires to operate the ring-shaped guide member6. At this time, the user can visually recognize the position of the ring-shaped guide member6and allow the own hand to access the ring-shaped guide member6with a pinpoint accuracy. On the other hand, the user can find the position of the ring-shaped guide member6not only by the above-described method but also by the following method. That is, the user moves the hand along the surface20around a position where the ring-shaped guide member6is likely to be present, or moves the hand along the surface20toward the position where the ring-shaped guide member6is likely to be present, without seeing the surface20of the display input device1at all or hardly.

When such a work is performed, any part of the hand touches the upright portion8of the ring-shaped guide member6in the process. This is because the upright portion8extends in the state of protruding forward with respect to the detection surface4. The user recognizes that the finger touches the upright portion8through the tactile sense, thereby recognizing the position of the ring-shaped guide member6including the upright portion8. Note that, the user who is the person on board the vehicle is often unable to firmly check the surface20of the display input device1over time, and it is very convenient for the user that the user can recognize the position of the ring-shaped guide member6without seeing the surface at all or hardly. Hereinafter, the work in which the user moves the hand to search for the guide member (not limited to the ring-shaped guide member6of this embodiment) is referred to as a “fumbling work”. The fumbling work is not a work performed for the purpose of performing some input by operating the guide member, but is a work performed for finding the guide member.

As described above, the upright portion8is a portion that may be touched by the finger in the process of the fumbling work. That is, there is a possibility that the user touches the upright portion in a state where the user does not intend to make any input. It is assumed that the touch is also enabled for the resting region18in a state where the operation on the ring-shaped guide member6is not started. This causes the following problems. That is, in this case, a touch is detected when the finger touches the upright portion8and is rested on the upright portion during the fumbling work, and the input is enabled due to the touch, and there is a possibility that some action is executed. As described above, the fumbling work is not a work performed for the purpose of the user performing some input by operating the guide member, and the executed action is a malfunction that is not desired by the user. As described above, when the touch is also enabled for the resting region18in a state where the operation on the ring-shaped guide member6is not started, there is a problem that a malfunction may occur in the process of the fumbling work.

In order to solve this problem, when the operation mode is the mode before the start of the operation, that is, when the operation on the ring-shaped guide member6is not started, the control unit15of the operation detection device14according to this embodiment excludes the resting region18from the “region where a touch is enabled”.

In a case where it is determined that the operation mode is the mode after the start of the operation in step SA5(step SA5: “MODE AFTER START OF OPERATION”), the control unit15includes the resting region18in the “region where a touch is enabled”, and sets the operation-corresponding region19and the resting region18as the “region where a touch is enabled” (step SA11). That is, when the operation mode is the mode after the start of the operation, the operation-corresponding region19and the resting region18correspond to the “region where a touch is enabled”.

Next, the control unit15executes the touch point detection processing after the start of the operation (step SA12). More specifically, the control unit15detects the point E in the normal operation and a point H at resting as the touch points F. The point H at resting is a “reaction point A in which the reaction point position C belongs to the resting region18(=the region where a touch is enabled in step SA12), and the reaction point value is the resting region threshold value TH2or more”, among the reaction points A.

The resting region threshold value TH2is set to such a value that the reaction point value of the corresponding reaction point A is the resting region threshold value TH2or more when the finger of the user is rested on the upright portion8. That is, the resting region threshold value TH2is a threshold value for detecting that the finger is rested on the upright portion8. Referring toFIG.7B, when the finger of the user is rested on the upright portion8and the finger is in contact with a top surface21of the upright portion8(the upper surface of the upright portion8), a distance between the finger and the surface20of the display input device1is a distance L2. In a situation where the finger is rested on the upright portion8, the finger and the surface20of the display input device1do not come closer than the distance L2. The distance L2is greater than the distance L1. Based on the above, the resting region threshold value TH2is less than the operation-corresponding region threshold value TH3. The resting region threshold value TH2is determined on the basis of a test or a simulation in advance in consideration of the distance L2. Since the value of the resting region threshold value TH2is set from the above viewpoint, the point H at resting appears corresponding to the finger of the user when the finger of the user is rested on the upright portion8.

In step SA12, the control unit15detects the touch point (=Point E in Normal Operation+Point H at Resting) based on the reaction point position C and the reaction point value for each of the reaction points A determined in step SA4. The range on the coordinates of the resting region18is defined in advance. No touch point F may be detected, or one or more touch points F may be detected.

After the processing of step SA12, the control unit15determines whether there is the touch point F (=Point E in Normal Operation+Point H at Resting) (step SA13). When there is no touch point (step SA13: NO), the control unit15ends the processing of the flowchart FA. On the other hand, when there are one or more touch points (step SA13: YES), the control unit15detects a touch for each of the touch points F (step SA14). Next, for each of the touch points F, the control unit15records the information indicating the coordinates of the touch position G in the touch position transition data in association with the information for identifying the current timing (step SA15). After the processing of step SA15, the control unit15ends the processing of the flowchart FA.

As described above, in this embodiment, when the operation mode is the mode after the start of the operation, that is, when the operation on the ring-shaped guide member6is started, the control unit15includes the resting region18in the “region where a touch is enabled”. Accordingly, the following effects are obtained. That is, according to this embodiment, after the operation on the ring-shaped guide member6is started, the touch is also enabled in the resting region18. Therefore, even in a case where the user moves the finger within the circular region9for the operation on the ring-shaped guide member6and the finger is rested on the upright portion8, the touch is detected in the resting region18. Therefore, when the user moves the finger within the circular region9for the operation on the ring-shaped guide member6and the finger is rested on the upright portion8, it is not determined that the operation is interrupted, and it is possible to suppress the determination that the operation is interrupted against the intention of the user.

Next, the processing of the operation detection device14regarding the detection of the operation on the ring-shaped guide member6will be described. A flowchart FB ofFIG.8is a flowchart illustrating an example of an information processing method by the operation detection device14regarding the detection of the operation on the ring-shaped guide member6. At the start of the processing of the flowchart FB ofFIG.8, it is assumed that the operation on the ring-shaped guide member6by the user is not started, and the operation mode is the mode before the start of the operation.

As illustrated inFIG.8, the control unit15refers to the touch position transition data stored in a predetermined storage area (step SB1). Even in a case where the processing after step SB2is not particularly described, the control unit15refers to the touch position transition data as necessary and executes the processing. As described above, in the touch position transition data, the touch position G is recorded in time series together with a detection timing for each detected touch. Next, the control unit15determines whether the operation on the ring-shaped guide member6is started on the basis of the touch position transition data (step SB2). Hereinafter, the processing of step SB2will be described in detail.

In step SB2, the control unit15determines whether the touch position G is dislocated around the central portion O of the circular region9by a start angle threshold value TH4(5° in this embodiment) or more in the clockwise direction Y1or in the counterclockwise direction Y2along the inner side wall10of the upright portion8, on the basis of the touch position transition data. Hereinafter, a “mode in which the touch position G is dislocated around the central portion O of the circular region9by the start angle threshold value TH4(=5°) or more in the clockwise direction Y1or in the counterclockwise direction Y2along the inner side wall10of the upright portion8” is referred to as a “specification mode TY1at start”. Then, the control unit15determines that the operation on the ring-shaped guide member6is started when the touch position G is dislocated in the specification mode TY1at start.

FIGS.9A and9Bare front views illustrating the periphery of the ring-shaped guide member6to describe the processing of the control unit15. For example, referring toFIG.9A, it is assumed that a touch position G-1appears at a position P1at a timing T1, a touch position G-2appears at a position P2at a timing T2, and a touch position G-3appears at a position P3at a timing T3. The timings T1, T2, and T3are timings that continuously appear at a predetermined cycle. Then, it is assumed that the angle of the central angle formed by the touch position G-1and the touch position G-3with respect to the central portion O of the circular region9is 5° (the angle does not need to be exactly 5°, and may be 5° or more). In this case, the control unit15determines that the operation on the ring-shaped guide member6is started at the timing T3. InFIGS.9A and9B, the angle formed by the touch position G-1and the touch position G-3with respect to the central portion O is greater than 5° in consideration of the visibility of the drawings. In the other drawings, when the angle is clearly shown in the drawings for the visibility of the drawings, the angle on the description may be different from the angle drawn in the drawings.

Note that, the control unit15determines whether the touch position G is dislocated in the specification mode at start for a “series of touch position groups”. The “series of touch position groups” is a group of consecutive touch positions G. For example, in a situation where a touch position G-X, a touch position G-Y, and a touch position G-Z appear, in a case where the touch position G-X and the touch position G-Y are consecutive and the touch position G-Y and the touch position G-Z are consecutive, the {Touch Position G-X, Touch Position G-Y, Touch Position G-Z} is a group of continuous touch positions G, and thus, is the “series of touch position groups”. The control unit15determines whether one touch position G and the other touch position G are consecutive by the following method. That is, the control unit15determines that the one touch position G and the other touch position G are consecutive when a detection timing of the one touch position G and a detection timing of the other touch position G continuously appear at a predetermined cycle and a separation distance between the one touch position G and the other touch position G is a certain distance or less. However, a method for determining whether one touch position G and the other touch positions G are consecutive is not limited to the illustrated method.

In the processing ofFIG.9A, the control unit15determines that the touch position G-1and the touch position G-2are consecutive and the touch position G-2and the touch position G-3are consecutive, and determines that {Touch Position G-1, Touch Position G-2, Touch Position G-3} is the “series of touch position groups” based on the determination. Then, the control unit15determines whether the touch position G is dislocated in the specification mode TY1at start for {Touch Position G-1, Touch Position G-2, Touch Position G-3}, which is the “series of touch position groups”.

Note that, the determination of whether the touch position G is dislocated in a specific mode for the “series of touch position groups” is performed not only for the case of the specification mode TY1at start but also for the case of a mode TY2in clockwise input and a mode TY3in counterclockwise input described later. The same applies to the similar processing of a second embodiment.

Note that, the control unit15determines whether a certain touch position G is a position along the inner side wall10of the upright portion8based on whether the touch position G belongs to a region set in advance as a region along the inner side wall10of the upright portion8. The same applies to the other processing of determining whether the touch position G is the position along the inner side wall10of the upright portion8.

Referring toFIG.9B, it is assumed that touch positions G-4, G-5, and G-6appear at positions P4, P5, and P6at consecutive timings T4, T5, and T6. {Touch Position G-4, Touch Position G-5, Touch Position G-6} is the “series of touch position groups”, and the angle of the central angle formed by the touch position G-4and the touch position G-6with respect to the central portion O of the circular region9is 5°. In this case, the control unit15determines that the operation on the ring-shaped guide member6is started at the timing T6.

As described above, the control unit15determines whether the touch position G is dislocated around the central portion O of the circular region9by the start angle threshold value TH4(5°) or more in the clockwise direction Y1or in the counterclockwise direction Y2along the inner side wall10of the upright portion8, thereby determining whether the operation on the ring-shaped guide member6is started. Hereinafter, the validity of this processing will be described. That is, as described with reference toFIGS.3A and3B, in this embodiment, the input is enabled every time when the finger of the user rotates around the central portion O by “45°” in the clockwise direction Y1or in the counterclockwise direction Y2. When the user starts the operation on the ring-shaped guide member6for the purpose of performing some input, a “state where the touch position G is dislocated around the central portion O of the circular region9by 5° or more in the clockwise direction Y1or in the counterclockwise direction Y2along the inner side wall10of the upright portion8” always appears before the input is enabled. From the above, the processing described above is valid.

When the operation on the ring-shaped guide member6is not started (step SB2: NO), the control unit15returns the processing procedure to step SB1. On the other hand, when the operation on the ring-shaped guide member6is started (step SB2: YES), the control unit15changes the operation mode from the mode before the start of the operation to the mode after the start of the operation (step SB3). As described above, in the mode after the start of the operation, the touch is enabled in the resting region18, the touch is detected in a predetermined case also in the resting region18, and the touch position G corresponding to the detected touch is recorded in the touch position transition data.

Next, the control unit15determines whether the touch position G is dislocated in the mode TY2in the clockwise input or in the mode TY3in the counterclockwise input on the basis of the touch position transition data (step SB4). The mode TY2in the clockwise input is a mode corresponding to an operation of rotating the finger around the central portion O by 45° in the clockwise direction Y1as illustrated inFIG.3A. Specifically, the mode TY2in the clockwise input is a mode in which the touch position G is dislocated around the central portion O of the circular region9by an effective angle threshold value TH5(45° in this embodiment) or more in the clockwise direction Y1. Similarly, the mode TY3in the counterclockwise input is a mode corresponding to an operation of rotating the finger around the central portion O by 45° in the counterclockwise direction Y2as illustrated inFIG.3B. Specifically, the mode TY3in the counterclockwise input is a mode in which the touch position G is dislocated around the central portion O of the circular region9by the effective angle threshold value TH5(45° in this embodiment) or more in the counterclockwise direction Y2.

FIGS.10A to10Care front views illustrating the periphery of the ring-shaped guide member6to describe the processing of the control unit15. For example, it is assumed that the finger of the user moves along the inner side wall10while being in contact with the inner side wall10of the upright portion8, and accordingly, the touch position G appears in the mode illustrated inFIG.10A. That is, as illustrated inFIG.10A, it is assumed that touch positions G-7, G-8, G-9, G-10, and G-11appear at positions P7, P8, P9, P10, and P11at consecutive timings T7, T8, T9, T10, and T11. The touch positions G-7, G-8, G-9, G-10, and G-11are a “series of touch position groups”. It is assumed that the center angle formed by the touch position G-7and the touch position G-8with respect to the central portion O is 5°, and the center angle formed by the touch position G-7and the touch position G-11with respect to the central portion O is 45° (the angle does not need to be exactly 45°, and may be 45° or more). In this case, the control unit15determines that the operation on the ring-shaped guide member6is started at the timing T8, and accordingly, changes the operation mode from the mode before the start of the operation to the mode after the start of the operation, and further determines that the touch position G is dislocated in the mode TY2in the clockwise input at the timing T11.

Furthermore, for example, it is assumed that, after the finger of the user starts to move along the inner side wall10while being in contact with the inner side wall10of the upright portion8, the finger is rested on the upright portion8in the middle of the movement, and then, the finger returns to the inside of the inner side wall10. Then, it is assumed that the touch position G appears in the mode illustrated inFIG.10Balong with the movement of the finger. That is, as illustrated inFIG.10B, it is assumed that touch positions G-12, G-13, G-14, G-15, and G-16appear at positions P12, P13, P14, P15, and P16at consecutive timings T12, T13, T14, T15, and T16. The touch positions G-12, G-13, G-14, G-15, and G-16are a “series of touch position groups”. The positions P12, P13, and P16are positions belonging to the operation-corresponding region19, and positions P14and P15are positions belonging to the resting region18. It is assumed that the center angle formed by the touch position G-12and the touch position G-13with respect to the central portion O is 5°, and the center angle formed by the touch position G-12and the touch position G-16with respect to the central portion O is 45°.

In this case, the control unit15determines that the operation on the ring-shaped guide member6is started at the timing T13, changes the operation mode from the mode before the start of the operation to the mode after the start of the operation, and further determines that the touch position G is dislocated in the mode TY2in the clockwise input at the timing T16. Here, the touch position G-14and the touch position G-15belong to the resting region18. However, at the timing T13, the operation mode is changed from the mode before the start of the operation to the mode after the start of the operation, and accordingly, the touch of the resting region18is enabled, and thus, the touch is detected by the control unit15for the touch position G-14and the touch position G-15, and the touch position G is recorded in the touch position transition data.

Note that, it is assumed that the touch is not enabled in the resting region18regardless of whether there is no mode after the start of the operation as the operation mode and the operation is started. In this case, as shown inFIG.10C, it is assumed that the reaction point position C of the reaction point A appears in the order of the positions P12, P13, P14, P15, and P16at the consecutive timings T12, T13, T14, T15, and T16. As described above, the positions P12, P13, and P16are positions belonging to the operation-corresponding region19, and the positions P14and P15are positions belonging to the resting region18. In this case, a touch is detected for the position P12, the position P13, and the position P16(it is assumed that the reaction point value is the operation-corresponding region threshold value TH3or more at any position), and the touch positions G-12, G-13, and G-16are recorded in the touch position transition data. However, no touch is detected for the positions P14and P15(it is assumed that the reaction point value is the resting region threshold value TH2or more at any position), and the touch position G is not recorded in the touch position transition data. In this case, the control unit15determines that the operation on the ring-shaped guide member6is interrupted between the timing T13and the timing T14. Therefore, in such an assumed case, the control unit15does not determine that the touch position G is dislocated in the mode TY2in the clockwise input.

In step SB4, when the control unit15determines that the touch position G is dislocated in the mode TY2in the clockwise input or in the mode TY3in the counterclockwise input (step SB4: YES), the processing procedure proceeds to step SB5. On the other hand, when it is determined that the touch position G is not dislocated in a specific mode (step SB4: NO), the control unit15allows the processing procedure to proceed to step SB7.

In step SB5, the control unit15determines that the input based on the operation of the user is enabled. Next, the control unit15executes an action corresponding to the mode of dislocating the touch position G (step SB6). In a simplified example of this embodiment, when the mode of dislocating the touch position G is the mode TY2in the clockwise input, the control unit15increases the volume of the audio device by one unit. On the other hand, when the mode of dislocating the touch position G is the mode TY3in the counterclockwise input, the control unit15decreases the volume of the audio device by one unit. After the processing of step SB6, the control unit15returns the processing procedure to step SB4.

As described above, in this embodiment, in a case where the touch position G is dislocated in the mode TY2in the clockwise input or in the mode TY3in the counterclockwise input, it is considered that the user intentionally performs the operation on the ring-shaped guide member6, and it is determined that the input based on the operation of the user is enabled with this as a trigger, and an action corresponding to the mode of dislocating the touch position G is executed.

In step SB7, the control unit15determines whether the operation on ring-shaped guide member6is released. More specifically, the control unit15refers to the touch position transition data and determines whether there is no touch position G (=a state where no touch is detected). When there is no touch position G, the control unit15determines that the operation on the ring-shaped guide member6is released. On the other hand, when there are one or more touch positions G, the control unit15determines that the operation on the ring-shaped guide member6is not released. Note that, the absence of any touch position G means that no touch is detected in the operation-corresponding region19and the resting region18, and it is estimated that the user releases the hand from the ring-shaped guide member6and releases the operation on the ring-shaped guide member6.

In step SB7, in a case where it is determined that the operation on the ring-shaped guide member6is not released (step SB7: NO), the control unit15returns the processing procedure to step SB4. On the other hand, when it is determined that the operation on the ring-shaped guide member6is released (step SB7: YES), the control unit15changes the operation mode from the mode after the start of the operation to a change mode before the start of the operation (step SB8). After the processing of step SB8, the control unit15ends the processing of the flowchart FA. After the processing of the flowchart FA is ended, the control unit15starts the processing of step SA1again.

As described above in detail, in this embodiment, the control unit15of the operation detection device14has a function of detecting that the operation on the ring-shaped guide member6(guide member) is started on the basis of the detection result of the sensor panel3. Before detecting the start of the operation on the ring-shaped guide member6, the control unit15excludes the resting region18corresponding to the region where the finger rested on the upright portion8can be positioned from the region where a touch is enabled, and after detecting the start of the operation on the ring-shaped guide member6, the control unit includes the resting region18in the region where a touch is enabled.

According to this configuration, before the operation on the ring-shaped guide member6is started, the touch is not enabled in the resting region18corresponding to the region where the finger rested on the ring-shaped guide member6can be positioned, so that a malfunction is suppressed. In addition, after the operation on the ring-shaped guide member6is started, the touch is enabled in the resting region18, and thus, even in a case where the finger is rested on the upright portion8in a process where the user is moving the finger during the operation, it is not determined that the operation is interrupted, and it is possible to suppress the determination that the operation is interrupted against the intention of the user.

MODIFICATION EXAMPLE

Next, a modification example will be described. In the following description of the modification example, the same reference numerals will be applied to the same elements as those of the above embodiment (including members that exhibit the same functions with the same structural features), and the detailed description thereof will be omitted.FIG.11is a front view of a display input device1A according to this modification example.FIG.12Ais a cross-sectional view taken along the line D-D ofFIG.11, andFIG.12Bis a cross-sectional view taken along the line E-E ofFIG.11.

As illustrated inFIGS.11to12B, a rectangular frame-shaped guide member30(guide member) is provided in the cover member5instead of the ring-shaped guide member6according to the first embodiment. The rectangular frame-shaped guide member30is fixed to the cover member5by adhesion or other units. That is, the rectangular frame-shaped guide member30is fixed to the detection surface4of the sensor panel3with the cover member5. The rectangular frame-shaped guide member30is a transparent member containing a transparent material. However, the rectangular frame-shaped guide member30may not be transparent. In this embodiment, the rectangular frame-shaped guide member30is separate from the cover member5, but these members may be integrated.

As illustrated inFIGS.11to12B, the rectangular frame-shaped guide member30includes a plate-shaped base portion31of which back surface adheres to the cover member5, and an upright portion32provided to surround the base portion31. As illustrated inFIGS.11to12B, the upright portion32is a portion having a rectangular frame shape in a front view, and an elongated rectangular region33is formed inside the upright portion. In this embodiment, the length of the rectangular region33in a longitudinal direction is approximately “8 cm”. The upright portion32is a portion extending in the state of protruding forward with respect to the detection surface4. In the upright portion32, an inner side wall34U (side wall) and an inner side wall34D (side wall) are formed corresponding to a pair of long sides of the rectangular region33. The inner side wall34U and the inner side wall34D are a pair of facing side walls. Hereinafter, the inner side wall34U and the inner side wall34D may be referred to as a “pair of inner side walls34U and34D”. The pair of inner side walls34U and34D are formed to rise by a certain distance from a bottom surface35(the surface of the base portion31belonging to the rectangular region33).

The rectangular frame-shaped guide member30is operated in the following mode. A first mode is an operation in which the finger of the user moves rightward along the pair of inner side walls34U and34D within the rectangular region33. When the above operation is performed by the user, the control unit15of the operation detection device14enables the input and executes the corresponding action every time when the finger of the user moves “3 cm”.

More specifically,FIG.13is a diagram illustrating a usage mode of the rectangular frame-shaped guide member. Referring to (A) inFIG.13, first, the finger of the user is disposed to touch the bottom surface35of the rectangular region33of the rectangular frame-shaped guide member30. InFIG.13, a circle is marked at a point where the finger touches or approaches on the bottom surface35In (A′) inFIG.13, a part of the state of (A) seen from the side is illustrated as a cross-sectional view. Note that, a position at which the finger is initially disposed in the operation of the rectangular frame-shaped guide member30is not limited to the position illustrated inFIG.3A, and may be any position in the rectangular region33. The same applies to a second mode according to the operation of the rectangular frame-shaped guide member30. Thereafter, as illustrated in (B) and (C) inFIG.13, the finger of the user moves rightward along the pair of inner side walls34U and34D, whereby the operation on the rectangular frame-shaped guide member30is performed.

In a case where the operations illustrated in (A), (B), and (C) inFIG.13are performed, the control unit15of the operation detection device14detects that the finger moves 3 cm when the state of (A) inFIG.13is changed to the state of (B), enables the input, and executes the corresponding action. In this embodiment, similarly to the above embodiment, the control unit15executes the action of increasing the volume of the audio device (not illustrated) by one unit. Furthermore, the control unit15of the operation detection device14detects that the finger moves 3 cm when the state of (B) inFIG.13is changed to the state of (C), enables the input, and executes the corresponding action (the action of increasing the volume by one unit). In this manner, the user can gradually increase the volume of the audio device by moving the finger rightward along the pair of inner side walls34U and34D of the upright portion32.

A second mode according to the operation of the rectangular frame-shaped guide member30is an operation in which the finger of the user moves leftward along the pair of inner side walls34U and34D within the rectangular region33. When the above operation is performed by the user, the control unit15of the operation detection device14enables the input, and executes the corresponding action (an action of once decreasing the volume of the audio device) every time when the finger of the user moves “3 cm”. The user can gradually decrease the volume of the audio device by moving the finger leftward while bringing the finger into contact with at least one of the pair of inner side walls34U and34D of the upright portion32.

As described above, in the rectangular frame-shaped guide member30according to this modification example, the finger of the user moves along the pair of inner side walls34U and34D of the upright portion32in the rectangular region33, whereby the operation on the rectangular frame-shaped guide member30is performed. During this operation, the finger may be rested on the upright portion32while the finger is moving along the pair of inner side walls34U and34D. (D) inFIG.13illustrates a state in which the finger is rested on the upright portion32at the timing of (B) inFIG.13. In particular, the display input device1A according to this embodiment is provided in a vehicle.

Therefore, the housing of the display input device1A may vibrate due to the vibration of the engine and other factors, and a case in which the finger is rested on the upright portion32may easily occur due to the vibration.

The control unit15of the operation detection device14according to this modification example executes the processing of the flowchart FA inFIG.5regarding the touch detection function. However, in this modification example, the operation-corresponding region37and the resting region38are defined as follows, and an operation-corresponding region threshold value TH3′ and a resting region threshold value TH2′ are set as follows.

FIGS.14A and14Bare views used to describe the operation-corresponding region37and the resting region38,FIG.14Ais a front view of the periphery of the rectangular frame-shaped guide member30, andFIG.14Bis a cross-sectional view taken along the line F-F ofFIG.14A. The operation-corresponding region37is a region where the “reaction point position C based on the finger positioned in the rectangular region33of the rectangular frame-shaped guide member30” can be positioned. That is, when the finger approaches the detection surface4within the rectangular region33, the reaction point position C is positioned within the operation-corresponding region37. Therefore, while the finger is moving along the pair of inner side walls34U and34D within the rectangular region33, the reaction point position C based on the finger is positioned within the operation-corresponding region37. InFIGS.14A and14B, the operation-corresponding region37is clearly illustrated. In particular, inFIG.14A, the operation-corresponding region37is a region inside a rectangular frame D3indicated by a dotted line. The operation-corresponding region37is a region corresponding to the rectangular region33, but the outer edge of the operation-corresponding region37does not necessarily coincide with the outer edge of the rectangular region33.

On the other hand, the resting region38is a region where the “reaction point position C based on the finger rested on the upright portion32” can be positioned. That is, the resting region38is a region corresponding to a “region where the finger rested on the upright portion32can be positioned”. Therefore, in a situation where the finger is rested on the upright portion32, the reaction point position C based on the finger is positioned within the resting region38.FIGS.14A and14Bclearly illustrate the resting region38. In particular, inFIG.14A, the resting region38is a region outside the rectangular frame D3indicated by the dotted line and inside a rectangular frame D4indicated by a dotted line. The resting region38is the region corresponding to the “region where the finger rested on the upright portion32can be positioned”, but the outer edge of the resting region38does not necessarily coincide with the outer edge when the upright portion32is viewed from the front.

The operation-corresponding region threshold value TH3′ is set to a value such that the reaction point value of the corresponding reaction point A is the operation-corresponding region threshold value TH3′ or more when the user brings the finger close to the detection surface4within the rectangular region33for the purpose of operating the rectangular frame-shaped guide member30. In particular, the operation-corresponding region threshold value TH3′ is set to such a value that the reaction point value of the reaction point A based on the finger is the operation-corresponding region threshold value or more during a period in which the user moves the finger along the pair of inner side walls34U and34D to operate the rectangular frame-shaped guide member30in a normal mode. Referring toFIG.14A, when the finger is brought into contact with bottom surface35within the rectangular region33, a distance between the finger and a surface39of the display input device1A is a distance L3. The operation-corresponding region threshold value is determined on the basis of a test or a simulation in advance in consideration of the distance L3. On the other hand, the resting region threshold value TH2′ is set to such a value that the reaction point value of the corresponding reaction point A is the resting region threshold value TH2′ or more when the finger of the user is rested on the upright portion32. With reference toFIG.14B, the distance between a top surface40of the upright portion32(the upper surface of the upright portion32) and the surface39of the display input device1A is a distance L4. In a situation where the finger is rested on the upright portion32, the finger and the surface39of the display input device1A do not come closer than the distance L4. The distance L4is greater than the distance L3. Based on the above, the resting region threshold value TH2′ is less than the operation-corresponding region threshold value TH3′. The resting region threshold value TH2′ is determined on the basis of a test or a simulation in advance in consideration of the distance L4.

With regard to a touch position detection function, according to this modification example, the same effects as those of the above embodiment are obtained. That is, when the operation mode is the mode before the start of the operation, that is, when the operation on the rectangular frame-shaped guide member30is not started, the control unit15according to this modification example excludes the resting region38from the “region where a touch is enabled”. For this reason, in a state where the operation on the rectangular frame-shaped guide member30is not started, the occurrence of a malfunction in the process of the fumbling work is suppressed. Furthermore, when the operation mode is the mode after the start of the operation, that is, after the operation on the rectangular frame-shaped guide member30is started, the control unit15includes the resting region38in the “region where a touch is enabled”. Therefore, even when the user moves the finger within the rectangular region33for the operation on the rectangular frame-shaped guide member30and the finger is rested on the upright portion32, the touch is detected in the resting region38. As a result, when the user moves the finger within the rectangular region33for the operation on the rectangular frame-shaped guide member30and the finger is rested on the upright portion32, it is not determined that the operation is interrupted, and it is possible to suppress the determination that the operation is interrupted against the intention of the user.

Next, the processing of the operation detection device14when the operation on the rectangular frame-shaped guide member30is detected will be described. A flowchart FC inFIG.15is a flowchart illustrating an example of an information processing method by the operation detection device14regarding the detection of the operation on the rectangular frame-shaped guide member30. As it is clear from the comparison betweenFIG.8andFIG.15, the control unit15according to this modification example executes step SC1instead of the processing of step SB2of the flowchart FA inFIG.8, and executes step SC2instead of the processing of step SB4.

In step SC1, the control unit15determines whether the touch position G is dislocated leftward or rightward by a start distance threshold value TH6(1 cm in this modification example) or more along the pair of inner side walls34U and34D within the operation-corresponding region37on the basis of the touch position transition data. Hereinafter, a “mode in which the touch position G is dislocated leftward or rightward by the start distance threshold value TH6(1 cm in this modification example) or more along the pair of inner side walls34U and34D” is referred to as a “specification mode TY4at start”. Then, the control unit15determines that the operation on the rectangular frame-shaped guide member30is started when the touch position G is dislocated in the specification mode TY4at start.

FIG.16is a front view illustrating the periphery of the rectangular frame-shaped guide member30to describe the processing of the control unit15. For example, referring toFIG.16A, it is assumed that touch positions G-17, G-18, and G-19appear at positions P17, P18, and P19at consecutive timings T17, T18, and T19. The touch positions G-17, G-18, and G-19are a “series of touch position groups”. It is assumed that a separation distance between the touch position G-17and the touch position G-19is 1 cm (the distance does not need to be exactly 1 cm, and may be 1 cm or more). In this case, the control unit15determines that the operation on the rectangular frame-shaped guide member30is started at the timing T19.

Referring toFIG.16B, it is assumed that touch positions G-20, G-21, and G-22appear at positions P20, P21, and P22at consecutive timings T20, T21, and T22. The touch positions G-20, G-21, and G-22are a “series of touch position groups”. It is assumed that a separation distance between the touch position G-20and the touch position G-22is 1 cm (the distance does not need to be exactly 1 cm, and may be 1 cm or more). In this case, the control unit15determines that the operation on the rectangular frame-shaped guide member30is started at the timing T22.

As described above, in this embodiment, the control unit15determines whether the touch position G is dislocated 1 cm or more rightward or leftward along the pair of inner side walls34U and34D of the upright portion32, thereby determining whether the operation on the rectangular frame-shaped guide member30is started. Hereinafter, the validity of this processing will be described. That is, as described with reference toFIG.13, in this embodiment, the input is enabled every time when the finger of the user moves 3 cm rightward or leftward within the rectangular region33. In a case where the user starts the operation on the rectangular frame-shaped guide member30with the purpose of performing some input, a “state in which the touch position G is dislocated 1 cm or more rightward or leftward along the pair of inner side walls34U and34D of the upright portion32” always appears before the input is enabled. From the above, the processing described above is valid.

In a case where the operation on the rectangular frame-shaped guide member30is not started (step SC1: NO), the control unit15returns the processing procedure to step SB1. On the other hand, when the operation on the rectangular frame-shaped guide member30is started (step SC1: YES), the control unit15allows the processing procedure to proceed to step SB3.

In step SC2, the control unit15determines whether the touch position G is dislocated in a mode TY5in right input or in a mode TY6in left input on the basis of the touch position transition data. The mode TY5in the right input is a mode corresponding to the operation of moving the finger rightward within the rectangular region33to enable the input as illustrated in (A) inFIG.13. Specifically, the mode TY5in the right input is a mode in which the touch position G is dislocated rightward by an effective distance threshold value TH7(3 cm in this embodiment) or more. Similarly, the mode TY6in the left input is a mode corresponding to the operation of moving the finger leftward within the rectangular region33to enable the input as illustrated in (B) inFIG.13. Specifically, the mode TY6in the left input is a mode in which the touch position G is dislocated leftward by the effective distance threshold value TH7(3 cm in this embodiment) or more.

FIG.17is a front view illustrating the periphery of the rectangular frame-shaped guide member30to describe the processing of the control unit15. For example, it is assumed that the finger of the user moves along the pair of inner side walls34U and34D of the upright portion32, and accordingly, the touch position G appears in the mode illustrated inFIG.17A. That is, as illustrated inFIG.17A, it is assumed that touch positions G-23, G-24, G-25, G-26, and G-27appear at positions P23, P24, P25, P26, and P27at consecutive timings T23, T24, T25, T26, and T27. The touch positions G-23, G-24, G-25, G-26, and G-27are a “series of touch position groups”. It is assumed that a distance between the touch position G-23and the touch position G-24is 1 cm, and a distance between the touch position G-23and the touch position G-27is 3 cm (the distance does not need to be exactly 3 cm, and may be 3 cm or more). In this case, the control unit15determines that the operation on the rectangular frame-shaped guide member30is started at the timing T24, and accordingly, changes the operation mode from the mode before the start of the operation to the mode after the start of the operation, and further determines that the touch position G is dislocated in the mode TY5in the right input at the timing T27.

Furthermore, for example, it is assumed that after the finger of the user starts to move along the pair of inner side walls34U and34D of the upright portion32, the finger is rested on the upright portion32in the middle of the movement, and then, the finger returns to the inside of the pair of inner side walls34U and34D. Then, it is assumed that the touch position G appears in the mode illustrated inFIG.17Balong with the movement of the finger. That is, as illustrated inFIG.17B, it is assumed that touch positions G-28, G-29, G-30, G-31, and G-32appear at positions P28, P29, P30, P31, and P32at consecutive timings T28, T29, T30, T31, and T32. The touch positions G-28, G-29, G-30, G-31, and G-32are a “series of touch position groups”. The positions P28, P29, and P32are positions belonging to the operation-corresponding region37, and the positions P30and P31are positions belonging to the resting region38. It is assumed that a distance between the touch position G-28and the touch position G-29is 1 cm, and a distance between the touch position G-28and the touch position G-32is 3 cm.

In this case, the control unit15determines that the operation on the rectangular frame-shaped guide member30is started at the timing T29, changes the operation mode from the mode before the start of the operation to the mode after the start of the operation, and further determines that the touch position G is dislocated in the mode TY5in the right input at the timing T32. Here, the touch position G-30and the touch position G-31belong to the resting region38. However, at the timing T29, the operation mode is changed from the mode before the start of the operation to the mode after the start of the operation, and accordingly, the touch of the resting region38is enabled, and thus, the touch is detected by the control unit15for the touch position G-30and the touch position G-31, and the touch position G is recorded in the touch position transition data.

Note that, it is assumed that a touch is not enabled in the resting region38regardless of whether there is no mode after the start of the operation as the operation mode and the operation is started. In this case, as shown inFIG.17C, it is assumed that the reaction point position C of the reaction point A appears at the positions P28, P29, P30, P31, and P32at the consecutive timings T28, T29, T30, T31, and T32. As described above, the positions P28, P29, and P32are positions belonging to the operation-corresponding region37, and the positions P31and P32are positions belonging to the resting region38. In this case, a touch is detected for the position P28, the position P29, and the position P32(it is assumed that the reaction point value is the operation-corresponding region threshold value TH3′ or more at any position), and the touch positions G-28, G-29, and G-32are recorded in the touch position transition data. However, no touch is detected for the positions P30and P31(it is assumed that the reaction point value is the resting region threshold value TH2′ or more at any position), and the touch position G is not recorded in the touch position transition data. In this case, the control unit15determines that the operation on the rectangular frame-shaped guide member30is interrupted between the timing T29and the timing T30. Therefore, in such an assumed case, the control unit15does not determine that the touch position G is dislocated in the mode TY5in the right input.

In step SC2, when the control unit15determines that the touch position G is dislocated in the mode TY5in the right input or in the mode TY6in the left input (step SC2: YES), the processing procedure proceeds to step SB5. On the other hand, when it is determined that the touch position G is not dislocated in a specific manner (step SC2: NO), the control unit15allows the processing procedure to proceed to step SB7.

In this embodiment, the same effects as those of the above embodiment are also obtained. That is, before the operation on the rectangular frame-shaped guide member30is started, the touch is not enabled in the resting region38corresponding to the region where the finger that has gotten on the rectangular frame-shaped guide member30can be positioned, so that the malfunction is suppressed. In addition, after the operation on the rectangular frame-shaped guide member30is started, the touch is enabled in the resting region38, and thus, even in a case where the finger is rested on the upright portion32while the user moves the finger during the operation, it is not determined that the operation is interrupted, and it is possible to suppress the determination that the operation is interrupted against the intention of the user.

Although one embodiment (including the modification example) of the present disclosure has been described above, the above embodiment is merely an example given to embody the present disclosure, and the technical scope of the present disclosure should not be interpreted in a limited manner. That is, the present disclosure can be implemented in various forms without departing from the gist or main features of the present disclosure.

For example, in the above embodiment, the action executed when it is determined that the input is enabled is the adjustment of the volume of the audio device, but it is natural that the action is not limited thereto. As an example, the action may be an action of moving a cursor or an action of adjusting the temperature of an air conditioner.

For example, the operation detection device14and an external device may cooperatively execute some of the processing pieces described as being executed by the functional block of the operation detection device14. In this case, the operation detection device14and the external device cooperate with each other to function as an “operation detection device”. As an example, the external device is a cloud server capable of communicating with the operation detection device14via a network.

For example, the embodiment may include the provision of a program executed by a computer of the operation detection device14or a recording medium in which the program is recorded in a computer readable manner. As the recording medium, a magnetic or optical recording medium or a semiconductor memory device can be used. Specific examples of the recording medium include a portable or fixed recording medium such as a flexible disk, a hard disk drive (HDD), a compact disk read only memory (CD-ROM), a digital versatile disk (DVD), a Blu-ray (registered trademark) Disc, a magneto-optical disc, a flash memory, and a card-type recording medium. The recording medium may be a recording medium included in the operation detection device14or the external device connected to the operation detection device14.

For example, for the exemplified flowchart, the order of processing may be changed, the processing may be more finely divided, processing may be added, or the processing may be deleted, as long as the purpose can be realized and there is no contradiction in the processing.

In each of the above-described embodiments, the operation detection device14has been described as a device independent of the sensor panel3, but the operation detection device14does not need to be an independent device that can be distributed independently. As an example, a circuit or a unit mounted on the same housing as the sensor panel3may be used.