Abstract:
The present disclosure relates to methods for measuring affective bandwidth of a subject (e.g., a human) and determining depression determination of the subject. The affective bandwidth measurement may include the following operations. For example, the subject may watch positive neutral and negative pictures for 8-10 seconds, respectively. Information for all fixation points may be obtained using an eye movement tracking device. Pupil diameter sizes of the subject while watching the positive, neutral and negative picture tasks may be calculated, and the affective bandwidth may be calculated. The affective bandwidth may include positive affective bandwidth (positive-neutral), negative affective bandwidth (negative-neutral) and positive-negative affective bandwidth (positive-negative) of the subject.

Description:
CROSS REFERENCE TO RELATED APPLICATION 
       [0001]    This application is a continuation application of International application number PCT/CN2014/086011, filed Sep. 14, 2014, titled “a Method for Affective Bandwidth Measurement and Affective Disorder Determination,” which claims the priority benefit of Chinese Patent Application No. 201410148099.X, filed on April, 2014, which is hereby incorporated by reference in its entirety. This application also claims priority to Chinese Patent Application No. 201410440520.4, filed on Sep. 1, 2014, titled “a Method for Affective Bandwidth Measurement and Affective Disorder Determination,” which is hereby incorporated by reference in its entirety. 
     
    
     TECHNICAL FIELD 
       [0002]    The present disclosure relates to a method for measuring affective bandwidth of subject and determining an affective disorder of the subject. 
       BACKGROUND 
       [0003]    Previous affective recognition technologies have primarily been used in studies such as recognition of different types of emotions (e.g., pleasure, sadness and fear) based on the different affective recognition (e.g., voice and face). However, most methods cannot recognize and quantify the same type of affective recognitions in terms of the level of pleasure (i.e., extremely pleased vs. relatively pleased) or the scope of pleasure. 
         [0004]    In the field of cognitive psychology, affective experience is measured by presenting pictures of different types of emotions to a subject. The level of pleasure is measured on a scale of 1 to 9, with 9 being the most pleasant and 1 being the least pleasant. The subject selects the level that best depicts the affect induced by the pictures. This method can be used to quantify an emotions of the subject, which is influenced by the subjectivity of the subject with a certain level of uncertainty. 
         [0005]    Studies have shown that, the visual stimulation of positive emotions, such as joy and happiness, induces pleasant emotions, indicated by the expansion of the diameter of the pupils of the subject. In contrast, the visual stimulation of negative emotions, such as sorrow and fear, induces unpleasant emotions, indicated by the contraction of the diameter of the pupils of the subject. Therefore, the expansion and contraction of the pupils of a subject serves as an objective indicator of changes of emotions of the subjects. 
         [0006]    Affective disorder primarily is characterized as moodiness, deficiency of pleasurable feelings and feeling of depression. Currently, auxiliary scales (such as the Beck scale and the self-rating affective disorder scale) have primarily been used for the determination and estimation of affective disorder, and brain waves and eye movement indexes are also used in determination estimations; however, these determination and estimations are not directly associated with the affective experience due to the shortage of affective indexes directly associated with mood. Therefore, the recognition rate and accuracy of affective injuries is not high. The affective width describes the affective change, and the positive affective bandwidth will be remarkably narrowed, thereby decreasing the affective change range and deficiency of the affective experience induced through external positive emotion information in the case of gloomy mood and the deficiency of pleasurable feelings. Hence, mood disorders such as the deficiency of pleasurable feelings and black moods can be induced. However, affective deficiency will induce negative cognitive schema, resulting in negative cognitive deviation to external information. This tends to perform cognitive processing in the negative psychology for non-negative (positive or neutral) visual stimulation. Therefore, experiences and affective disorder of a normal person are different from external positive and negative affective stimulation such that the positive emotion experience of the affective disorder is smaller than that of the normal person. 
       SUMMARY 
       [0007]    The present disclosure relates to a method obtaining an affective bandwidth measurement and affective disorder determination. The present disclosure is the first to propose the affective bandwidth concept. For example, the affective width refers to the size and range of the affective experience of a cognitive individual induced with external stimulation, including positive affective bandwidth, negative affective bandwidth and positive-negative affective bandwidth. The positive affective bandwidth refers to the size and range of the positive affective experience of the cognitive individual induced with external positive emotional stimulation; the negative affective bandwidth refers to the size and range of the negative affective experience of the cognitive individual induced with external negative emotion stimulation. The positive-negative affective bandwidth refers to the size and range of the maximum positive affective experience and the minimum negative affective experience of the cognitive individual. On the one hand, the advantage of this method is that the sizes and ranges of the positive, negative and positive-negative affective bandwidths, can be measured and on the other hand, the affective disorder of the subject can be judged and evaluated. 
         [0008]    To this end, the technical solution of the disclosure includes the following procedures. 
         [0009]    Affective Bandwidth Measurement. 
         [0010]    Positive Affective Bandwidth Measurement Method: 
         [0011]    (1-1) Selecting multiple positive pictures with a valence level higher than about 8.0 and an arousal level higher than about 5.0 according to the International Affective Picture System (IAPS); 
         [0012]    (1-2) Selecting multiple neutral pictures with a valence level between about 4.0-5.0 and an arousal level between about 2.0-3.0 according to the IAPS; 
         [0013]    (1-3) Processing all pictures selected in Steps (1-1) and (1-2) into pictures of the same form in terms of size, brightness and gray level using image processing software; 
         [0014]    (1-4) Combining the multiple positive pictures processed in Step (1-3) in a non-overlapping manner to form a vision stimulation task with positive information; 
         [0015]    (1-5) Combining the multiple neutral pictures processed in Step (1-3) together in a non-overlapping manner to form a vision stimulation task with neutral information; 
         [0016]    (1-6) Presenting the vision stimulation of the positive pictures generated in Step (1-4) in the center of a display for 8-10 seconds of viewing, and synchronously acquiring information for all fixation points of the subject by using an eye movement tracking device; 
         [0017]    (1-7) Presenting the vision stimulation of the neutral pictures generated in Step (1-4) in the center of a display for 8-10 seconds of viewing, and synchronously acquiring information for all fixation points of the subject using an eye movement tracking device; 
         [0018]    (1-8) Confirming the existence of m fixation points when the subject views the positive pictures are obtained according to Step (1-6), wherein the pupil diameter mean value of each fixation point is calculated according to the following formula: 
         [0000]        d   i =( d   i   left   +d   i   right )/2 
         [0000]        d   p =Σ 1   m   di/m  
       (i=1, 2, 3, . . . , m),       
 
         [0020]    wherein d i   left  and d i   right  are the left and right pupil diameters of the i th  fixation point, respectively; 
         [0021]    (1-9) Confirming the existence of q fixation points when the subject views neutral pictures, wherein the mean pupil diameter value d M  of each fixation point is calculated according to the formula: 
         [0000]        d   k =(d k   left   +d   k   right )/2 
         [0000]        d   M =Σ 1   q   d   k   /q    (Formula 2)
       (k=1, 2, 3, . . . , q),       
 
         [0023]    wherein d k   left  and d k   right  are the left and right pupil diameters of the k th  fixation point, respectively; and 
         [0024]    (1-10) Acquiring the size S paBW  and variation range R PaBW  of the positive affective bandwidth (PaBW) are obtained according to Steps (1-8) and (1-9) using the following calculation: 
         [0000]    
       
      
       S 
       paBW 
       =d 
       p 
       −d 
       M  
      
     
         [0000]      R paBW =0˜( d   p   −d   M )   (Formula 3)
 
         [0025]    wherein the size S paBW (D) of the positive affective bandwidth of the subject and the size S paBW (H) of the positive affective bandwidth of the healthy control group can be obtained. 
         [0026]    (2) Negative affective bandwidth measurement method: 
         [0027]    (2-1) Selecting multiple negative pictures with a valence level between about 1.0-2.0 and an arousal level higher than about 5.0 according to the IAPS; 
         [0028]    (2-2) Processing all pictures selected in Step (2-1) into pictures of the same form in terms of size, brightness and gray level using image processing software; 
         [0029]    (2-3) Combining multiple the negative pictures processed in Step (2-2) to form a vision stimulation task with negative information; 
         [0030]    (2-4) Presenting the negative pictures generated in Step (2-3) in the center of the display for 8-10 seconds of viewing, and synchronously acquiring the information for all fixation points of the subject using an eye movement tracking device; 
         [0031]    (2-5) Confirming existence of n fixation points when the subject views the negative picture are obtained according to Step (2-4), wherein the pupil diameter mean value of each fixation point is calculated according to the following formula: 
         [0000]        d   j =( d   j   left   +d   j   right )/2 
         [0000]        d   N =Σ 1   n   d   j   /n    (Formula 4)
       (j=1,2,3, . . . , n),       
 
         [0033]    wherein d j   left  and d j   right  are the left and right pupil diameters of the j th  fixation point, respectively; and 
         [0034]    (2-6) Acquiring the size S NaBW  and range R NaBW  of the negative affective bandwidth (NaBW) are obtained according to Steps (2-5) and (1-9) using the following formula: 
         [0000]    
       
      
       S 
       NaBW 
       =d 
       N 
       −d 
       M  
      
     
         [0000]        R   NaBW =0˜( d   N   −d   M )   (Formula 5)
 
         [0035]    wherein the size S NaBW (D) of the negative affective bandwidth of the subject and the size S NaBW (H) of the negative affective bandwidth of the healthy control group can be obtained; and 
         [0036]    (3) Positive-negative affective bandwidth measurement method; 
         [0037]    The positive-negative affective bandwidth (PNaBW) refers to the size and range of the maximum positive experience and the minimum negative affective experience of the cognitive individual; and the size S PNaBW  and variation range R PNaBW  of the positive-negative affective bandwidth (PNaBW) are obtained according to Steps (1-8) and (2-5) using the following formula; 
         [0000]    
       
      
       S 
       PNaBW 
       =d 
       P 
       −d 
       N  
      
     
         [0000]        R   PNaBW   =d   N   −d   P    (Formula 6)
 
         [0038]    wherein the size S PNaBW (D) of the positive-negative affective bandwidth of the subject and the size S PNaBW (H) of the positive-negative affective bandwidth of the healthy control group can be obtained. 
         [0039]    Affective disorder determination method: 
         [0040]    (2-1) Measuring the size S PaBW (D) of the positive affective bandwidth of the subject and the size S PaBW (H) of the positive affective bandwidth of the healthy control group according to Step (1); 
         [0041]    (2-2) Measuring the size S NaBW (D) of the negative affective bandwidth of the subject and the size S NaBW (H) of the negative affective bandwidth of the healthy control group according to Step (2); 
         [0042]    (2-3) Measuring the size S PNaBW (D) of the positive-negative affective bandwidth of the subject and size S PNaBW (H) of the positive-negative affective bandwidth of the healthy control group according to Step (3); and 
         [0043]    (2-4) Assessing the affective disorder of the subject according to the following standards: the positive affective bandwidth S PaBW (D) of the subject is smaller than S PaBW (H) of a normal person, and the positive-negative affective bandwidth S PNaBW (D) of the subject is smaller than S PNaBW (H) of the normal person; and the determination is determined using the following formula: 
         [0000]        S   PaBW ( D )&lt; S   PaBW ( H ) 
         [0000]        S   PNaBW ( D )&lt; S   PNaBW ( H )   (Formula 7)
 
         [0044]    This method generates the following technical effects. This affective bandwidth measurement method overcomes the vagueness and uncertainty of people to a subjective scoring method for external affective experience and objectively measures the sizes and ranges (the positive affective bandwidth, the negative affective bandwidth and the positive-negative affective bandwidth) of the positive and negative affective experiences using pupil diameter as a physical index. By measuring the affective bandwidth of the subject, the defects of the previous deficiency of quantified affective evaluation are overcome, and whether the subject is affectively injured or not can be judged and evaluated compared with the normal person. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0045]      FIG. 1  is a diagram illustrating affective bandwidth measurement and disorder determination; 
           [0046]      FIG. 2  is a flowchart of selecting affective pictures; 
           [0047]      FIG. 3  is a flowchart illustrating affective bandwidth measurement; 
           [0048]      FIG. 4  is a flowchart illustrating affective disorder determination; 
           [0049]      FIG. 5  is a diagram illustrating results of effective bandwidth comparison between a subject and a normal person; and 
           [0050]      FIG. 6  is a diagram illustrating results of effective disorder determination and evaluation of a subject. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0051]    The technical solution for this method may be further described using the attached drawings implemented in the following manner. 
         [0052]      FIG. 1  is a diagram illustrating implementations related to affective bandwidth measurement and disorder determination. These implementations may be performed by a computing device, which may be a user device or a server. In one exemplary configuration, the computing device includes one or more processors, input/output interfaces, network interface, and memory. The memory may include various modules configured to perform the following implementations. 
         [0053]      FIG. 1  includes three parts, namely, affective picture task design, affective bandwidth measurement and affective disorder determination of the depressive disorder, comprising the following procedures: 
         [0054]    1) First, the affective picture task design shown in  FIG. 2 , including the following steps: 
         [0055]    (1) Selecting 16 affective pictures from the IAPS, including four positive pictures (valence level is higher than about 8.0 and the arousal level is higher than about 5.0), four negative pictures (valence level is between about 4.0 and 5.0 and arousal level between about 2.0 and 3.0) and four neutral pictures (valence level is between about 1.0 and 2.0 and the arousal level is higher than about 5.0); 
         [0056]    (2) Because the selected pictures are likely of different sizes, brightness and gray levels, these pictures will be normalized, and each picture will be processed into the picture of the same form in terms of size (200*200 pixels), brightness and gray level using Photoshop software; and 
         [0057]    (3) Because a certain period is needed to induce emotions from people, vision fatigue will only be induced when one picture is used to induce the emotion. Therefore, four pictures of the same form in emotion type will constitute an emotion picture task, as follows: combing the four positive pictures according to four quadrants together in a non-overlapping manner to generate a vision stimulation task with positive information; combining the four negative pictures in a non-overlapping manner according to four quadrants to generate a vision stimulation task with negative information; and combining the four neutral pictures in a non-overlapping manner according to four quadrants to generate a vision stimulation task with neutral information. 
         [0058]    2) Measurement of the affective bandwidth, as shown in  FIG. 3 , will including the following steps: 
         [0059]    (1) Positive affective bandwidth is measured, presenting the positive affective picture task in Step 1) in the center (both the horizontal view angle and the vertical view angle are 12 degrees) of a 17-inch color display (the resolution is 1024*768) for 10 seconds of viewing and synchronously acquiring the information for all fixation points of the subject using an eye movement tracking device associated with the computing device; presenting the neutral affective picture task in Step 1) in the center (both the horizontal view angle and the vertical view angle are 12 degrees) of a 17-inch color display (the resolution is 1024*768) for 10 seconds of viewing, and synchronously acquiring the information for all fixation points using an eye movement tracking device; and presenting the negative affective picture task in Step 1) in the center (both the horizontal view angle and the vertical view angle are 12 degrees) of a 17-inch color display (the resolution is 1024*768) for 10 seconds, and synchronously acquiring the information for all fixation points using an eye movement tracking device; 
         [0060]    (2) Pupil diameter mean value of all fixation points when the subject views the most pleasant picture is calculated: 
         [0000]        d   j =( d   j   left   +d   j   right )/2 
         [0000]        d   P =Σ 1   n   d   j   /m    (Formula 1)
       (i=1, 2, 3, . . . , m)       
 
         [0062]    wherein d i   left  and d i   right  are the left and right pupil diameters of the i th  fixation point, respectively; 
         [0063]    Similarly, the mean pupil diameters d N  and d M  of the subject viewing the most unpleasant picture and the neutral picture, respectively, will be calculated according to the method used in Step (2) for calculating d P ; 
         [0064]    (3) The size S PaBW  of positive affective bandwidth (PaBW) refers to the difference between the pupil diameter d P  of the subject viewing the most pleasant picture and the pupil diameter d M  of the subject viewing the neutral picture, and the variation range R PaBW  of the positive affective bandwidth (PaBW) is 0 to d P −d M  according to the formula: 
         [0000]    
       
      
       S 
       PaBW 
       =d 
       P 
       −d 
       M  
      
     
         [0000]        R   PaBW =0˜( d   P   −d   M )   (Formula 3);
 
         [0065]    (4) The size S NaBW  of negative affective bandwidth (NaBW) refers to the difference between the pupil diameter d N  of the subject viewing the most unpleasant picture and the pupil diameter d M  of the subject viewing the neutral picture, and the variation range R NaBW  the NaBW is 0 to d N −d M  according to the formula: 
         [0000]    
       
      
       S 
       NaBW 
       =d 
       N 
       −d 
       M  
      
     
         [0000]        R   NaBW =0˜( d   n   −d   M )   (Formula 5)
 
         [0066]    (5) The PNaBW (Positive-Negative affective bandwidth) refers to the size range of the maximum positive affective experience and the size range of the minimum negative affective experience of the cognitive individual. The size S PNaBW  and the variation range R PNaBW  of the PNaBW are calculated according to the formula: 
         [0000]    
       
      
       S 
       PNaBW 
       =d 
       P 
       −d 
       N  
      
     
         [0000]        P   PNaBW   =d   N   −d   P    (Formula 6)
 
         [0067]    3) Affective disorder determination flow, as shown in  FIG. 4 , will first acquire the positive affective bandwidth and the positive-negative affective bandwidth of the healthy control group; subsequently, the positive affective bandwidth and the negative affective bandwidth of the subject will be acquired; and finally, the positive affective bandwidths and the positive-negative affective bandwidths of the subject and the healthy control group will be compared. If the positive affective bandwidth of the subject is lower than that of the healthy control group and the positive-negative affective bandwidth of the subject is lower than that of the healthy control group, then the subject is depressed; 
         [0068]    4) Evaluation of the affective disorder level of the subject; 
         [0069]      FIG. 5  is a diagram illustrating results of effective bandwidth comparison between a subject and a normal person.  FIG. 5  includes the comparison of the affective bandwidth sizes and variation ranges of 36 subjects determined as depressed according to the Beck scale and the self-rating affective disorder scale provided using implementation data obtained from the present method and the normal person. This result indicates that both the positive affective bandwidth and the positive-negative affective bandwidth of the subject are lower than those of the normal person, suggesting the positive affective experience deficiency of the subject, leading to a gloomy mood and deficiency of pleasurable feeling. 
         [0070]      FIG. 6  is a diagram illustrating results of effective disorder determination and evaluation of a subject. The results may indicate the affective disorder assessment for the 36 subjects determined as depressed according to the Beck scale and the self-rating affective disorder scale provided using implementation data obtained from the present disclosure. The affective disorder determination and evaluation based on the affective bandwidth was obtained for 36 persons whose psychological magnitudes were assessed as depressed using the present disclosure, wherein 29 persons are evaluated as affective disorder (accounting for about 80.6%) and 7 persons are evaluated as affective normal (accounting for about 19.4%).