Patent ID: 12193818

DESCRIPTION OF EMBODIMENTS

Hereinafter, a mode for carrying out the present invention will be described in detail with reference to the drawings.

First Embodiment

FIG.1is a block diagram illustrating an example of a configuration of an information processing apparatus according to a first embodiment of the present invention. An information processing apparatus10includes a control unit11that controls entire operation, an input/output unit12that performs various types of input/output, a storage unit13that stores various types of data, programs, and the like, a communication unit14that performs communication with the outside, and an internal bus15that connects the blocks so that the blocks can communicate with each other.

The information processing apparatus10is, for example, a computer, and may be a device that can be carried by a subject, such as a smartphone, a PDA, a tablet, or a laptop computer, or may be a computer that is fixed at an installation position without being carried by the subject. PDA is an abbreviation for Personal Digital Assistant.

The control unit11is, for example, a device called a CPU, an MCU, or an MPU, and for example, a program stored in the storage unit13is executed. CPU is an abbreviation for Central Processing Unit. MCU is an abbreviation for Micro Controller Unit. MPU is an abbreviation for Micro Processor Unit.

The input/output unit12is a device that performs input/output with respect to a subject who operates the information processing apparatus10. The input/output unit12inputs and outputs information and signals by a display, a keyboard, a mouse, a button, a touch panel, a printer, a microphone, a speaker, and the like. In the present embodiment, the input/output unit12at least functions as a microphone, and inputs voice data by this microphone. Furthermore, in the present embodiment, the input/output unit12at least serves as a display, and displays a Sound Pressure Change acceleration index and a depression state to be described later on this display.

The storage unit13is, for example, a device such as a ROM, a RAM, an HDD, or a flash memory, and stores programs executed by the control unit11and various data. ROM is an abbreviation for Read Only Memory. RAM is an abbreviation for Random Access Memory. HDD is an abbreviation for Hard Disk Drive.

The communication unit16communicates with the outside. Communication by the communication unit16may be wired communication or wireless communication. The communication by the communication unit16may use any communication scheme. The control unit11can transmit and receive various data such as voice data by the communication unit16. The control unit11may transmit a Sound Pressure Change acceleration index, presence or absence of depression, or severity of depression to be described later to an external device by the communication unit16.

FIG.2is a flowchart illustrating an example of processing executed by the information processing apparatus10. In the present embodiment, as will be described in detail later, the Sound Pressure Change acceleration index (strength of a Sound Pressure Change acceleration) is obtained from an utterance of a subject. Since this Sound Pressure Change acceleration index has a correlation with a HAMD score as described later, it is possible to perform a screening test as an alternative in an environment where the HAMD cannot be performed only by asking the subject to make a simple utterance.

First, the control unit11inputs voice data of the subject by the input/output unit12(for example, a microphone) (step S201). At this time, the subject makes an utterance toward the microphone. The Sound Pressure Change acceleration index used in the present embodiment has little phrase dependency as described later. Therefore, accurate measurement can be performed even if the subject does not necessarily speak the same phrase and the number of utterances is small. Note that the voice data input in step S201may be voice data recorded in advance. Subsequently, the control unit11acquires time-series data of sound pressure from the voice data input in step S201(step S202). Subsequently, the control unit11calculates a Sound Pressure Change acceleration index from the time-series data of the sound pressure acquired in step S202(step S203). Subsequently, the control unit11outputs the Sound Pressure Change acceleration index calculated in step S203by the input/output unit12(for example, a display) (step S204). At this time, the Sound Pressure Change acceleration index itself may be output, the presence or absence of depression or the severity of depression of the subject corresponding to the Sound Pressure Change acceleration index may be output, or the HAMD score corresponding to the Sound Pressure Change acceleration index may be output.

Here, the time-series data of the sound pressure acquired in step S202inFIG.2will be described.

FIG.3is a diagram illustrating an example of time-series data of sound pressure. InFIG.3, the horizontal axis represents time, and the vertical axis represents sound pressure. In step S202, the sound pressure is obtained for each time from the voice data input in step S201. The example ofFIG.3illustrates that the voice data input in step S201has the sound pressure of x(t−1) at time t−1, the sound pressure of x(t) at time t, and the sound pressure of x(t+1) at time t+1.

Next, the Sound Pressure Change acceleration index calculated in step S203inFIG.2will be described.

First, for example, an intermediate value between the maximum value and the minimum value of the sound pressure is defined as the center. InFIG.3, the sound pressure changes from x(t−1) to x(t) from time t−1, and the sound pressure increases. Subsequently, the sound pressure changes from x(t) to x(t+1) from time t to time t+1, and the sound pressure decreases.

When looking at a period from time t−1 to time t+1, since the sound pressure at time t is above the center and the sound pressures at the preceding and subsequent times are below the center, it is assumed that a force toward the center is generated at time t.

In a case where the sound pressure at a certain time is above the center and the sound pressure at either one of the preceding and subsequent times is below the center, it is assumed that a force toward the center is generated at that time.

In a case where the sound pressure at a certain time is below the center and the sound pressure at either one of the preceding and subsequent times is above the center, it is assumed that a force toward the center is generated at that time.

In a case where the sound pressures at a certain time and before or after the certain time are above the center, and in a case where the sound pressure at the certain time is stronger than the sound pressure before or after the certain time, it is assumed that a force toward the center is generated at that time.

In a case where the sound pressures at a certain time and before or after the certain time are above the center, and in a case where the sound pressure at the certain time is weaker than the sound pressure before or after the certain time, it is assumed that a force away from the center is generated at that time.

If X(t) is above the center, a downward force, ie negative F(t), represents a force towards the center. Similarly, if X(t) is above the center, an upward force, ie positive F(t), represents a force away from the center.

Conversely, if X(t) is below the center, then a downward force, ie negative F(t), represents a force away from the center. Similarly, if X(t) is below the center, an upward force, ie positive F(t), represents a force towards the center.

Formula 1 is an expression for obtaining F(t) indicating a force toward the center and a force away from the center at time t.

v⁡(t)=x⁡(t+1)-x⁡(t)[Formula⁢1]v⁡(t-1)=x⁡(t)-x⁡(t-1)F⁡(t)=v⁡(t)-v⁡(t-1)min⁡(❘"\[LeftBracketingBar]"v⁡(t)❘"\[RightBracketingBar]",❘"\[LeftBracketingBar]"v⁡(t-1)❘"\[RightBracketingBar]")

The strength of the Sound Pressure Change acceleration, that is, the Sound Pressure Change acceleration index is, for example, a value obtained by dividing a value obtained by subtracting the sum of forces away from the center from the sum of forces toward the center of the time-series data of the sound pressure by the total of the number of forces toward the center and the number of forces away from the center.

The following processing (1), (2), and (3) is performed to calculate the Sound Pressure Change acceleration index.(1) F(t) is obtained by Formula 1.(2) When X(t) is above the center, a sign of F(t) is reversed.(3) When F(t) is positive, it is defined as a force toward the center, and when F(t) is negative, it is defined as a force away from the center.

FIG.4is a graph in which data of a plurality of subjects is plotted, with the strength of the Sound Pressure Change acceleration, that is, the Sound Pressure Change acceleration index obtained by the information processing apparatus10ofFIG.1with respect to an utterance made by a subject on the vertical axis and a HAMD score of the subject on the horizontal axis. As shown inFIG.4, a correlation is observed between the strength of the Sound Pressure Change acceleration and the HAMD score, and effectiveness of using the Sound Pressure Change acceleration index as a substitute in an environment where the HAMD score cannot be performed could be confirmed.

FIGS.5A to5Jare graphs each illustrating a correlation between the strength of the Sound Pressure Change acceleration and the HAMD score by making a phrase uttered by a subject different to obtain the strength of the Sound Pressure Change acceleration as inFIG.4.

The graph ofFIG.5Ais a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “i ro ha ni ho he to”.

The graph ofFIG.5Bis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “It's sunny today”.

The graph ofFIG.5Cis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “Once upon a time in a certain place”.

The graph ofFIG.5Dis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “Galapagos islands”.

The graph ofFIG.5Eis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “I'm tired and exhausted”.

The graph ofFIG.5Fis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “I'm great”.

The graph ofFIG.5Gis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “I had a good sleep yesterday”.

The graph ofFIG.5His a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “I have a good appetite”.

The graph ofFIG.5Iis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “I'm hot-tempered”.

The graph inFIG.5Jis a graph showing the correlation between the strength of the Sound Pressure Change acceleration and the HAMD score when uttering, “I feel calm”.

Referring to the graphs inFIGS.5A to5J, it can be seen that the strength of the Sound Pressure Change acceleration and the HAMD score have a correlation without depending on the phrase.

FIG.6is a diagram illustrating an ROC curve of a result of screening healthy persons and depressed patients by the strength of the Sound Pressure Change acceleration obtained by the information processing apparatus10inFIG.1.

FIG.6(A)illustrates a case of screening healthy persons and patients with mild and severe depression. As illustrated inFIG.6(A), according to the information processing apparatus10, an area under the curve (AUC) is 0.92. The AUC takes a value from 0.5 to 1, and the closer the value is to 1, the higher the discriminability is. Further, when sensitivity is 89%, the specificity is 91%. Thus, according to the information processing apparatus10ofFIG.1, screening with high discriminability can be performed.

FIG.6(B)shows a case of screening healthy persons and patients with No symptoms, mild, and severe depression. As illustrated inFIG.6(B), the AUC is 0.86 according to the information processing apparatus10. Further, when the sensitivity is 81%, the specificity is 83%. Thus, according to the information processing apparatus10ofFIG.1, screening with high discriminability can be performed.

FIG.7is a graph illustrating an ROC curve of a result of screening according to the severity of depression by the strength of the Sound Pressure Change acceleration obtained by the information processing apparatus10inFIG.1.

FIG.7(A)illustrates a case of screening patients with No symptoms depression (No depression) and patients with mild and severe depression (Depression). As illustrated inFIG.7(A), the AUC is 0.814 according to the information processing apparatus10. Thus, according to the information processing apparatus10ofFIG.1, screening with high discriminability can be performed.

FIG.7(B)illustrates a case of screening patients with No symptoms depression (No depression) and patients with severe depression (Severe). As illustrated inFIG.7(B), the AUC is 0.918 according to the information processing apparatus10. Thus, according to the information processing apparatus10ofFIG.1, screening with high discriminability can be performed.

FIG.7(C)illustrates a case of screening patients with No symptoms depression (No depression) and patients with mild depression (Mild). As illustrated inFIG.7(C), the AUC is 0.795 according to the information processing apparatus10. Thus, according to the information processing apparatus10ofFIG.1, screening with high discriminability can be performed.

FIG.7(D)shows a case of screening patients with mild depression (Mild) and patients with severe depression (Severe). As illustrated inFIG.7(D), the AUC is 0.708 according to the information processing apparatus10. Thus, according to the information processing apparatus10ofFIG.1, screening with high discriminability can be performed.

FIG.8is a graph showing, on the vertical axis, the strength of the Sound Pressure Change acceleration Sound Pressure Change acceleration obtained by the information processing apparatus10ofFIG.1for each of the plurality of utterances having different utterance contents by each of the healthy persons and the depressed patients.

In the graph ofFIG.8, each of the plurality of utterances having different utterance contents by each of the healthy persons and the depressed patients is arranged on the horizontal axis. InFIG.8, phrases P1to P12are phrases having utterance contents different from each other. Ave is an average value of the phrases P1to P12.

InFIG.8, for each of the phrases P1to P17and the average value Ave, the strength of the Sound Pressure Change acceleration of patients with severe depression is indicated by the leftmost bar graph, the strength of the Sound Pressure Change acceleration of patients with mild depression is indicated by a second bar graph from the left, the strength of the Sound Pressure Change acceleration of patients with No symptoms depression is indicated by a third bar graph from the left, and the strength of the Sound Pressure Change acceleration of healthy persons is indicated by the rightmost bar graph.

Referring toFIG.8, it can be seen that the strength of the Sound Pressure Change acceleration does not greatly change due to the difference in the utterance content uttered by the subject.

Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment. An object of the present invention is also achieved by supplying a storage medium storing a program code (computer program) for realizing the functions of the above-described embodiment to a system or an apparatus, and reading and executing the program code stored in the storage medium by a computer of the supplied system or apparatus. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. Furthermore, in the above-described embodiment, the computer executes the program to function as each processing unit, but a part or all of the processing may be configured by a dedicated electronic circuit (hardware). The present invention is not limited to the specific embodiment described above, and various modifications and changes can be made within the scope of the gist of the present invention described in the claims, including replacement of each configuration of each embodiment.

The present application claims priority based on JP 2020-78995 A filed on Apr. 28, 2020, the entire contents of which are incorporated herein by reference.

REFERENCE SIGNS LIST

10Information processing apparatus11Control unit12Input/output unit13Storage unit14Communication unit15Internal bus