Patent Publication Number: US-11392820-B2

Title: Transpose memory unit for multi-bit convolutional neural network based computing-in-memory applications, transpose memory array structure for multi-bit convolutional neural network based computing-in-memory applications and computing method thereof

Description:
BACKGROUND 
     Technical Field 
     The present disclosure relates to a memory unit, a memory array structure and a computing method thereof. More particularly, the present disclosure relates to a transpose memory unit for a plurality of multi-bit convolutional neural network (CNN) based computing-in-memory (CIM) applications, a transpose memory array structure for the multi-bit CNN based CIM applications and a computing method thereof. 
     Description of Related Art 
     In these years, due to the industrial growth of mobile device, medical electrical equipment, portable storage, etc., requirement of memory with low power, high speed and high density is increased. Computation-in-Memory (CIM) is a promising solution to improve the energy efficiency of multiplication-and-accumulation (MAC) operations for AI chips, and multiple-bit convolutional neural network (CNN) is required for high inference accuracy in many applications. 
     In the CNN application, a user wants to increase operation number to enhance performance. However, the user doesn&#39;t want to lose the accuracy. In general, the user will enhance input/weight bits, but this may cause degradation in operation. In addition, the value of the weight needs to be refreshed frequently in operation, thus increasing lots of latency and power consumption when reading and moving data. Accordingly, a transpose memory unit for a plurality of multi-bit CNN based CIM applications, a transpose memory array structure for the multi-bit CNN based CIM applications and a computing method thereof having the features of reducing the latency and power consumption without causing the write disturb issue are commercially desirable. 
     SUMMARY 
     According to one aspect of the present disclosure, a transpose memory unit for a plurality of multi-bit convolutional neural network (CNN) based computing-in-memory (CIM) applications is controlled by a first word line and a second word line. The transpose memory unit for the multi-bit CNN based CIM applications includes a memory cell and a transpose cell. The memory cell stores a weight. The memory cell is controlled by the first word line and includes a local bit line transmitting the weight. The transpose cell is connected to the memory cell and receives the weight via the local bit line. The transpose cell includes an input bit line, at least one first input word line, a first output bit line, at least one second input word line and a second output bit line. One of the at least one first input word line and the at least one second input word line transmits at least one multi-bit input value, and the transpose cell is controlled by the second word line to generate a multiply-accumulate output value on one of the first output bit line and the second output bit line according to the at least one multi-bit input value multiplied by the weight. 
     According to another aspect of the present disclosure, a transpose memory array structure for a plurality of multi-bit CNN based CIM applications is controlled by a first word line and a second word line. The transpose memory array structure for the multi-bit CNN based CIM applications includes a plurality of transpose memory units connected to each other via the first word line and the second word line. Each of the transpose memory units includes a memory cell and a transpose cell. The memory cell stores a weight. The memory cell is controlled by the first word line and includes a local bit line transmitting the weight. The transpose cell is connected to the memory cell and receives the weight via the local bit line. The transpose cell includes an input bit line, at least one first input word line, a first output bit line, at least one second input word line and a second output bit line. One of the at least one first input word line and the at least one second input word line transmits at least one multi-bit input value, and the transpose cell is controlled by the second word line to generate a multiply-accumulate output value on one of the first output bit line and the second output bit line according to the at least one multi-bit input value multiplied by the weight. 
     According to further another aspect of the present disclosure, a computing method of the transpose memory array structure for the multi-bit CNN based CIM applications is controlled by the first word line and the second word line. The computing method includes a voltage level applying step and a computing step. The voltage level applying step includes applying a plurality of voltage levels to the first word line, the second word line, the weight, the at least one first input word line and the at least one second input word line of each of the transpose memory units, respectively. The computing step includes driving the transpose cell of each of the transpose memory units to compute the voltage levels of the weight, the at least one first input word line and the at least one second input word line so as to generate the multiply-accumulate output value on the one of the first output bit line and the second output bit line according to the at least one multi-bit input value multiplied by the weight. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       The present disclosure can be more fully understood by reading the following detailed description of the embodiment, with reference made to the accompanying drawings as follows: 
         FIG. 1  shows a block diagram of a transpose memory array structure for a plurality of multi-bit convolutional neural network based computing-in-memory applications according to a first embodiment of the present disclosure. 
         FIG. 2  shows a circuit diagram of a first type of one of a plurality of transpose memory units of the transpose memory array structure of  FIG. 1 . 
         FIG. 3  shows a circuit diagram of a second type of one of a plurality of transpose memory units according to a second embodiment of the present disclosure. 
         FIG. 4  shows a circuit diagram of a column multiply-accumulate operation of the second type of the one of the transpose memory units of  FIG. 3 , with a 2-bit input and a 1-bit weight. 
         FIG. 5  shows a circuit diagram of a column multiply-accumulate operation of a transpose memory array structure according to a third embodiment of the present disclosure, which the transpose memory array structure includes the plurality of the transpose memory units of  FIG. 3 , with 2-bit inputs and 8-bit weights. 
         FIG. 6  shows a circuit diagram of a row multiply-accumulate operation of the second type of the one of the transpose memory units of  FIG. 3 , with a 2-bit input and a 1-bit weight. 
         FIG. 7  shows a circuit diagram of a row multiply-accumulate operation of the transpose memory array structure of  FIG. 5 , with 2-bit inputs and 8-bit weights. 
         FIG. 8  shows a circuit diagram of a third type of one of a plurality of transpose memory units according to a fourth embodiment of the present disclosure. 
         FIG. 9  shows a flow chart of a computing method of a transpose memory array structure for a plurality of multi-bit convolutional neural network based computing-in-memory applications according to a fifth embodiment of the present disclosure. 
     
    
    
     DETAILED DESCRIPTION 
     The embodiment will be described with the drawings. For clarity, some practical details will be described below. However, it should be noted that the present disclosure should not be limited by the practical details, that is, in some embodiment, the practical details is unnecessary. In addition, for simplifying the drawings, some conventional structures and elements will be simply illustrated, and repeated elements may be represented by the same labels. 
     It will be understood that when an element (or device) is referred to as be “connected to” another element, it can be directly connected to the other element, or it can be indirectly connected to the other element, that is, intervening elements may be present. In contrast, when an element is referred to as be “directly connected to” another element, there are no intervening elements present. In addition, the terms first, second, third, etc. are used herein to describe various elements or components, these elements or components should not be limited by these terms. Consequently, a first element or component discussed below could be termed a second element or component. 
     Before describing any embodiments in detail, some terms used in the following are described. A voltage level of “1” represents that the voltage is equal to a power supply voltage VDD. The voltage level of “0” represents that the voltage is equal to a ground voltage VSS. A PMOS transistor and an NMOS transistor represent a P-type MOS transistor and an N-type MOS transistor, respectively. Each transistor has a source, a drain and a gate. 
       FIG. 1  shows a block diagram of a transpose memory array structure  100  for a plurality of multi-bit convolutional neural network (CNN) based computing-in-memory (CIM) applications according to a first embodiment of the present disclosure.  FIG. 2  shows a circuit diagram of a first type of one of a plurality of transpose memory units  210  of the transpose memory array structure  100  of  FIG. 1 . In  FIGS. 1 and 2 , the transpose memory array structure  100  for the multi-bit CNN based CIM applications is controlled by a first word line WL and a second word line HWL. The transpose memory array structure  100  for the multi-bit CNN based CIM applications includes a plurality of local memory array units  200 , a word line driver  300 , a normal input-output (IO) circuit  400 , a vertical analog-to-digital converter  500  and a horizontal analog-to-digital converter  600 . 
     The local memory array units  200  are connected to each other. Each of the local memory array units  200  includes the transpose memory units  210 . The transpose memory units  210  are connected to each other via the first word line WL and the second word line HWL. Each of the transpose memory units  210  includes at least one memory cell  212  and the transpose cell  214 . In one embodiment, the number of the at least one memory cell  212  may be 16× (e.g., 16, 32, and so on). 
     The memory cell  212  stores a weight (1-bit weight). The memory cell  212  is controlled by the first word line WL. In detail, the memory cell  212  includes a first node Q, a second node QB, a local bit line BLB, a local bit line bar LBLB, a first memory cell transistor T 1 , a second memory cell transistor T 2 , a first inverter INV 1  and a second inverter INV 2 . The first node Q stores the weight. The second node QB stores an inverted weight opposite to the weight of the first node Q. The local bit line BLB is connected to the transpose cell  214  and transmits the weight from the memory cell  212  to the transpose cell  214 . The local bit line bar LBLB is connected to the transpose cell  214  and transmits the inverted weight from the memory cell  212  to the transpose cell  214 . The first memory cell transistor T 1  is connected to the first node Q, the local bit line LBL and the first word line WL. The second memory cell transistor T 2  is connected to the second node QB, the local bit line bar LBLB and the first word line WL. The first inverter INV 1  is located between the first node Q and the second node QB. The first inverter INV 1  includes a third memory cell transistor T 3  and a fourth memory cell transistor T 4  connected to the third memory cell transistor T 3 . The second inverter INV 2  is connected to the first inverter INV 1 . The second inverter INV 2  includes a fifth memory cell transistor T 5  and a sixth memory cell transistor T 6  connected to the fifth memory cell transistor T 5 . In other words, the memory cell  212  is a 6T static random access memory (SRAM) cell. Each of the first memory cell transistor T 1 , the second memory cell transistor T 2 , the third memory cell transistor T 3  and the fifth memory cell transistor T 5  is the NMOS transistor. Each of the fourth memory cell transistor T 4  and the sixth memory cell transistor T 6  is the PMOS transistor. 
     The transpose cell  214  is connected to the memory cell  212  and receives the weight via the local bit line LBL. The transpose cell  214  includes an input bit line GBL&lt;m&gt;, a first input word line C_RWL&lt;n&gt;, a first output bit line C_RBL&lt;m&gt;, a second input word line R_RWL&lt;m&gt; and a second output bit line R_RBL&lt;n&gt;. “m” and “n” represent an mth column and an nth row, respectively. Each of “m” and “n” is an integer which is greater than or equal to 0. One of the first input word line C_RWL&lt;n&gt; and the second input word line R_RWL&lt;m&gt; transmits a multi-bit input value, and the transpose cell  214  is controlled by the second word line HWL to generate a multiply-accumulate output value on one of the first output bit line C_RBL&lt;m&gt; and the second output bit line R_RBL&lt;n&gt; according to the multi-bit input value multiplied by the weight. In detail, the first output bit line C_RBL&lt;m&gt; can also be represented by an input bit line bar GBLB&lt;m&gt;, i.e., the first output bit line C_RBL&lt;m&gt; and the input bit line bar GBLB&lt;m&gt; share the same line and are represented as “C_RBL&lt;m&gt;/GBLB&lt;m&gt;” in  FIG. 2 . The multi-bit input value is a digital signal. The first input word line C_RWL&lt;n&gt; and the second output bit line R_RBL&lt;n&gt; are extended in a horizontal direction, and the first output bit line C_RBL&lt;m&gt; and the second input word line R_RWL&lt;m&gt; are extended in a vertical direction. Moreover, the transpose cell  214  includes a first transpose cell transistor M 1 , a second transpose cell transistor M 2 , a third transpose cell transistor M 3 , a fourth transpose cell transistor M 4  and a fifth transpose cell transistor M 5 . The first transpose cell transistor M 1  is connected to the second word line HWL, the input bit line GBL&lt;m&gt; and the local bit line LBL. The second transpose cell transistor M 2  is connected to the second word line HWL, the first output bit line C_RBL&lt;m&gt; and the local bit line bar LBLB. The third transpose cell transistor M 3  is connected to the first input word line C_RWL&lt;n&gt;, the first output bit line C_RBL&lt;m&gt; and a third node. The fourth transpose cell transistor M 4  is connected to the second input word line R_RWL&lt;m&gt;, the first output bit line C_RBL&lt;m&gt; and the third node. The fifth transpose cell transistor M 5  is connected to the local bit line LBL, the second output bit line R_RBL&lt;n&gt; and the third node. Each of the first transpose cell transistor M 1 , the second transpose cell transistor M 2 , the third transpose cell transistor M 3 , the fourth transpose cell transistor M 4  and the fifth transpose cell transistor M 5  is the NMOS transistor. Each of the third transpose cell transistor M 3 , the fourth transpose cell transistor M 4  and the fifth transpose cell transistor M 5  has a first transistor width. Each of the first transpose cell transistor M 1 , the second transpose cell transistor M 2  has a second transistor width. The first transistor width is equal to twice the second transistor width. 
     Table 1 lists the multi-bit input values (Input), the weights (Weight) and the multiply-accumulate output values (MAC) of the first type of the transpose memory unit  210  of  FIG. 2 , in a column multiply-accumulate operation. The multiply-accumulate output values can be computed by the multi-bit input values and the weights in the vertical direction. The voltage levels of the second input word line R_RWL&lt;m&gt; and the second output bit line R_RBL&lt;n&gt; are all equal to VSS (0 V). The multi-bit input value is corresponding to the voltage level of the first input word line C_RWL&lt;n&gt; and is equal to 1 (i.e., VDD) or 0 (i.e., VSS). The weight is corresponding to the voltage level on the local bit line LBL. The multiply-accumulate output value is corresponding to a current on the first output bit line C_RBL&lt;m&gt; (Input×Weight). In one embodiment, the multi-bit input value may be regarded as “Horizontal Din”, and the multiply-accumulate output value may be regarded as “Vertical Dout”, as shown in  FIG. 1 . 
     
       
         
           
               
               
               
               
               
             
               
                   
                 TABLE 1 
               
               
                   
                   
               
               
                   
                 Input 
                 Weight 
                 Input × Weight 
                   
               
               
                   
                 (C_RWL&lt;n&gt;) 
                 (LBL(Q)) 
                 (C_RBL&lt;m&gt;) 
                 MAC 
               
               
                   
                   
               
             
            
               
                   
                 1 
                 1 
                 1 × Idis 
                 1 
               
               
                   
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
                 1 
                 0 
                 0 × Idis 
                 0 
               
               
                   
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
                   
               
            
           
         
       
     
     Table 2 lists the multi-bit input values (Input), the weights (Weight) and the multiply-accumulate output values (MAC) of the first type of the transpose memory unit  210  of  FIG. 2 , in a row multiply-accumulate operation. The multiply-accumulate output values can be computed by the multi-bit input values and the weights in the horizontal direction. The voltage levels of the first input word line C_RWL&lt;n&gt; and the first output bit line C_RBL&lt;m&gt; are all equal to VSS (0 V). The multi-bit input value is corresponding to the voltage level of the second input word line R_RWL&lt;m&gt; and is equal to 1 (i.e., VDD) or 0 (i.e., VSS). The weight is corresponding to the voltage level on the local bit line LBL. The multiply-accumulate output value is corresponding to a current on the second output bit line R_RBL&lt;n&gt; (Input×Weight). In one embodiment, the multi-bit input value may be regarded as “Vertical Din”, and the multiply-accumulate output value may be regarded as “Horizontal Dout”, as shown in  FIG. 1 . 
     
       
         
           
               
               
               
               
               
             
               
                   
                 TABLE 2 
               
               
                   
                   
               
               
                   
                 Input 
                 Weight 
                 Input × Weight 
                   
               
               
                   
                 (R_RWL&lt;m&gt;) 
                 (LBL(Q)) 
                 (R_RBL&lt;n&gt;) 
                 MAC 
               
               
                   
                   
               
             
            
               
                   
                 1 
                 1 
                 1 × Idis 
                 1 
               
               
                   
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
                 1 
                 0 
                 0 × Idis 
                 0 
               
               
                   
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
                   
               
            
           
         
       
     
     The word line driver  300  is connected to each of the local memory array units  200  via the first word line WL and the second word line HWL. The word line driver  300  is represented as “WLDRV &amp; NN input driver” and is located on a left side of the local memory array units  200 . The word line driver  300  generates the voltage level of the first word line WL and the voltage level of the second word line HWL to control each of the local memory array units  200 . 
     The normal IO circuit  400  is connected to each of the local memory array units  200  via the input bit line GBL&lt;m&gt; and the input bit line bar GBLB&lt;m&gt; (i.e., the first output bit line C_RBL&lt;m&gt;). The normal IO circuit  400  is represented as “Normal IO” and is located on a bottom side of the local memory array units  200 . The normal IO circuit  400  receives the weights from the local memory array units  200 . 
     The vertical analog-to-digital converter  500  is connected to each of the local memory array units  200  via the first output bit line C_RBL&lt;m&gt; and the second input word line R_RWL&lt;m&gt;. The vertical analog-to-digital converter  500  is represented as “Vertical ADC” and is located on a top side of the local memory array units  200 . The vertical analog-to-digital converter  500  receives the multiply-accumulate output values (MAC) from the local memory array units  200  in the vertical direction. 
     The horizontal analog-to-digital converter  600  is connected to each of the local memory array units  200  via the first input word line C_RWL&lt;n&gt; and the second output bit line R_RBL&lt;n&gt;. The horizontal analog-to-digital converter  600  is represented as “Horizontal ADC” and is located on a right side of the local memory array units  200 . The horizontal analog-to-digital converter  600  receives the multiply-accumulate output values (MAC) from the local memory array units  200  in the horizontal direction. 
     When the first transpose cell transistor M 1  and the second transpose cell transistor M 2  are turned on by the second word line HWL, the transpose memory unit  210  is operated in a normal mode. The voltage level of the first word line WL and the voltage level of the second word line HWL are both equal to 1. In the normal mode, the memory cell  212  is processed in one of a normal read operation and a normal write operation. The normal read operation represents that the weight in the memory cell  212  may be transmitted to the input bit line GBL&lt;m&gt; via the local bit line LBL and the first transpose cell transistor M 1 . The inverted weight may be transmitted to the input bit line bar GBLB&lt;m&gt; via the local bit line bar LBLB and the second transpose cell transistor M 2 . Then, the weight and the inverted weight may be transmitted from the local memory array unit  200  to the normal IO circuit  400  via the input bit line GBL&lt;m&gt; and the input bit line bar GBLB&lt;m&gt;, respectively. The normal write operation represents that the weight is transmitted from the input bit line GBL&lt;m&gt; to the memory cell  212  via the first transpose cell transistor M 1  and the local bit line LBL. 
     When the first transpose cell transistor M 1  and the second transpose cell transistor M 2  are turned off by the second word line HWL, the transpose memory unit  210  is operated in a CIM mode. The voltage level of the first word line WL and the voltage level of the second word line HWL are equal to 1 and 0, respectively, so that the weight in the memory cell  212  is configured to control the fifth transpose cell transistor M 5  to establish a current path via the fifth transpose cell transistor M 5  and one of the third transpose cell transistor M 3  and the fourth transpose cell transistor M 4 . 
     Accordingly, the transpose memory unit  210  for the multi-bit CNN based CIM applications and the transpose memory array structure  100  for the multi-bit CNN based CIM applications of the present disclosure can operate the multi-bit input values and the weights at the same time without causing the write disturb issue, and utilize a two way transpose array to do training and inference in the horizontal and vertical directions respectively, thereby substantially reducing the latency and power consumption. 
       FIG. 3  shows a circuit diagram of a second type of one of a plurality of transpose memory units  210   a  according to a second embodiment of the present disclosure.  FIG. 4  shows a circuit diagram of a column multiply-accumulate operation of the second type of the one of the transpose memory units  210   a  of  FIG. 3 , with a 2-bit input and a 1-bit weight.  FIG. 5  shows a circuit diagram of a column multiply-accumulate operation of a transpose memory array structure  100  according to a third embodiment of the present disclosure, which the transpose memory array structure  100  includes the plurality of transpose memory units  210   a  of  FIG. 3 , with 2-bit inputs and 8-bit weights.  FIG. 6  shows a circuit diagram of a row multiply-accumulate operation of the second type of the one of the transpose memory units  210   a  of  FIG. 3 , with a 2-bit input and a 1-bit weight.  FIG. 7  shows a circuit diagram of a row multiply-accumulate operation of the transpose memory array structure  100  of  FIG. 5 , with 2-bit inputs and 8-bit weights. In  FIGS. 1 and 3-7 , the transpose memory array structure  100  for the multi-bit CNN based CIM applications is controlled by a first word line WL and a second word line HWL. The transpose memory array structure  100  for the multi-bit CNN based CIM applications includes a plurality of local memory array units  200 , a word line driver  300 , a normal IO circuit  400 , a vertical analog-to-digital converter  500  and a horizontal analog-to-digital converter  600 . 
     The local memory array units  200  are connected to each other. Each of the local memory array units  200  includes the transpose memory units  210   a . The transpose memory units  210   a  are connected to each other via the first word line WL and the second word line HWL. Each of the transpose memory units  210   a  includes at least one memory cell  212  and the transpose cell  214   a . In one embodiment, the number of the at least one memory cell  212  may be 16× (e.g., 16, 32, and so on). In  FIGS. 3, 4 and 6 , the detail of the memory cell  212  is the same as the memory cell  212  of  FIG. 2 , and will not be described again herein. 
     The transpose cell  214   a  is connected to the memory cell  212  and receives the weight via the local bit line LBL. The transpose cell  214   a  includes an input bit line GBL&lt;m&gt;, two first input word lines C_RWL_MSB&lt;n&gt;, C_RWL_LSB&lt;n&gt;, a first output bit line C_RBL&lt;m&gt;, two second input word lines R_RWL_MSB&lt;m&gt;, R_RWL_LSB&lt;m&gt; and a second output bit line R_RBL&lt;n&gt;. “m” and “n” represent an mth column and an nth row, respectively. Each of “m” and “n” is an integer which is greater than or equal to 0. In one embodiment, “m” and “n” are equal to 128 and 512, respectively. The two first input word lines C_RWL_MSB&lt;n&gt;, C_RWL_LSB&lt;n&gt; or the two second input word lines R_RWL_MSB&lt;m&gt;, R_RWL_LSB&lt;m&gt; transmit two multi-bit input values, respectively. The transpose cell  214   a  is controlled by the second word line HWL to generate a multiply-accumulate output value on one of the first output bit line C_RBL&lt;m&gt; and the second output bit line R_RBL&lt;n&gt; according to the two multi-bit input values multiplied by the weight. In detail, the first output bit line C_RBL&lt;m&gt; can also be represented by an input bit line bar GBLB&lt;m&gt;, i.e., the first output bit line C_RBL&lt;m&gt; and the input bit line bar GBLB&lt;m&gt; share the same line and are represented as “C_RBL&lt;m&gt;/GBLB&lt;m&gt;” in  FIG. 3 . Each of the two multi-bit input values is a digital signal. The two first input word lines C_RWL_MSB&lt;n&gt;, C_RWL_LSB&lt;n&gt; and the second output bit line R_RBL&lt;n&gt; are extended in a horizontal direction, and the first output bit line C_RBL&lt;m&gt; and the two second input word lines R_RWL_MSB&lt;m&gt;, R_RWL_LSB&lt;m&gt; are extended in a vertical direction. 
     Moreover, the transpose cell  214   a  includes a first transpose cell transistor M 1 , a second transpose cell transistor M 2 , a third transpose cell transistor M 3 , a fourth transpose cell transistor M 4 , a fifth transpose cell transistor M 5 , a sixth transpose cell transistor M 6 , a seventh transpose cell transistor M 7  and an eighth transpose cell transistor M 8 . The first transpose cell transistor M 1  is connected to the second word line HWL, the input bit line GBL&lt;m&gt; and the local bit line LBL. The second transpose cell transistor M 2  is connected to the second word line HWL, the first output bit line C_RBL&lt;m&gt; and the local bit line bar LBLB. The third transpose cell transistor M 3  is connected to one of the two first input word lines C_RWL_MSB&lt;n&gt;, the first output bit line C_RBL&lt;m&gt; and a third node. The fourth transpose cell transistor M 4  is connected to one of the two second input word lines R_RWL_MSB&lt;m&gt;, the first output bit line C_RBL&lt;m&gt; and the third node. The fifth transpose cell transistor M 5  is connected to the local bit line LBL, the second output bit line R_RBL&lt;n&gt; and the third node. The sixth transpose cell transistor M 6  is connected to the local bit line LBL, the second output bit line R_RBL&lt;n&gt; and a fourth node. The seventh transpose cell transistor M 7  is connected to another of the two first input word lines C_RWL_LSB&lt;n&gt;, the first output bit line C_RBL&lt;m&gt; and the fourth node. The eighth transpose cell transistor M 8  is connected to another of the two second input word lines R_RWL_LSB&lt;m&gt;, the first output bit line C_RBL&lt;m&gt; and the fourth node. Each of the third transpose cell transistor M 3 , the fourth transpose cell transistor M 4  and the fifth transpose cell transistor M 5  has a first transistor width. Each of the sixth transpose cell transistor M 6 , the seventh transpose cell transistor M 7 , the eighth transpose cell transistor M 8  has a second transistor width, and the first transistor width is equal to twice the second transistor width. 
     Table 3 lists the multi-bit input values (Input), the weights (Weight) and the multiply-accumulate output values (MAC) of the second type of the transpose memory unit  210   a  of  FIG. 3 , in a column multiply-accumulate operation. In  FIGS. 4, 5  and Table 3, the multiply-accumulate output values can be computed by the multi-bit input values and the weights in the vertical direction. The voltage levels of the two second input word lines R_RWL_MSB&lt;m&gt;, R_RWL_LSB&lt;m&gt; and the second output bit line R_RBL&lt;n&gt; are all equal to VSS (0 V). The two multi-bit input values are corresponding to the voltage levels of the two first input word lines C_RWL_MSB&lt;n&gt;, C_RWL_LSB&lt;n&gt;, respectively. The two multi-bit input values may be “11”, “10”, “01” or “00”. The weight is corresponding to the voltage level on the local bit line LBL. The multiply-accumulate output value is corresponding to a current on the first output bit line C_RBL&lt;m&gt; (Input×Weight). 
     
       
         
           
               
               
               
               
             
               
                 TABLE 3 
               
             
            
               
                   
               
               
                 Input 
                 Weight 
                 Input × Weight 
                   
               
            
           
           
               
               
               
               
               
            
               
                 C_RWL_MSB&lt;n&gt; 
                 C_RWL_LSB&lt;n&gt; 
                 (LBL(Q)) 
                 (C_RBL&lt;m&gt;) 
                 MAC 
               
               
                   
               
               
                 1 
                 1 
                 1 
                 3 × Idis 
                 3 
               
               
                 1 
                 0 
                   
                 2 × Idis 
                 2 
               
               
                 0 
                 1 
                   
                 1 × Idis 
                 1 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 1 
                 1 
                 0 
                 0 × Idis 
                 0 
               
               
                 1 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 1 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
               
            
           
         
       
     
     Table 4 lists the multi-bit input values (Input), the weights (Weight) and the multiply-accumulate output values (MAC) of the second type of the transpose memory unit  210   a  of  FIG. 3 , in a row multiply-accumulate operation. In  FIGS. 6, 7  and Table 4, the multiply-accumulate output values can be computed by the multi-bit input values and the weights in the horizontal direction. The voltage levels of the two first input word lines C_RWL_MSB&lt;n&gt;, C_RWL_LSB&lt;n&gt; and the first output bit line C_RBL&lt;m&gt; are all equal to VSS (0 V). The two multi-bit input values are corresponding to the voltage levels of the two second input word lines R_RWL_MSB&lt;m&gt;, R_RWL_LSB&lt;m&gt;, respectively. The two multi-bit input values may be “11”, “10”, “01” or “00”. The weight is corresponding to the voltage level on the local bit line LBL. The multiply-accumulate output value is corresponding to a current on the second output bit line R_RBL&lt;n&gt; (Input×Weight). 
     
       
         
           
               
               
               
               
             
               
                 TABLE 4 
               
             
            
               
                   
               
               
                 Input 
                 Weight 
                 Input × Weight 
                   
               
            
           
           
               
               
               
               
               
            
               
                 R_RWL_MSB&lt;m&gt; 
                 R_RWL_LSB&lt;m&gt; 
                 (LBL(Q)) 
                 (R_RBL&lt;n&gt;) 
                 MAC 
               
               
                   
               
               
                 1 
                 1 
                 1 
                 3 × Idis 
                 3 
               
               
                 1 
                 0 
                   
                 2 × Idis 
                 2 
               
               
                 0 
                 1 
                   
                 1 × Idis 
                 1 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 1 
                 1 
                 0 
                 0 × Idis 
                 0 
               
               
                 1 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 1 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
               
            
           
         
       
     
     When the first transpose cell transistor M 1  and the second transpose cell transistor M 2  are turned on by the second word line HWL, the transpose memory unit  210   a  is operated in a normal mode. In the normal mode, the memory cell  212  is processed in one of a normal read operation and a normal write operation. The normal read operation represents that the weight in the memory cell  212  is transmitted to the input bit line GBL&lt;m&gt; via the local bit line LBL and the first transpose cell transistor M 1 . The normal write operation represents that the weight is transmitted from the input bit line GBL&lt;m&gt; to the memory cell  212  via the first transpose cell transistor M 1  and the local bit line LBL. On the contrary, when the first transpose cell transistor M 1  and the second transpose cell transistor M 2  are turned off by the second word line HWL, the transpose memory unit  210   a  is operated in a CIM mode. The weight in the memory cell  212  is configured to control the fifth transpose cell transistor M 5  and the sixth transpose cell transistor M 6  to establish two current paths via the fifth transpose cell transistor M 5 , the sixth transpose cell transistor M 6 , one of the third transpose cell transistor M 3  and the fourth transpose cell transistor M 4  and one of the seventh transpose cell transistor M 7  and the eighth transpose cell transistor M 8 . In  FIG. 5 , the local memory array units  200  of the transpose memory array structure  100  are operated to generate the multiply-accumulate output values (IN 0 *W[0]+IN 1 *W[0]+ . . . IN N *W[0], IN 0 *W[7]+IN 1 *W[7]+ . . . IN N *W[7]) with 2-bit inputs (R_input 0&lt;1:0&gt;, R_input N&lt;1:0&gt;) and 8-bit weights (Weight[0]-Weight[7]) in the vertical direction. In  FIG. 7 , the local memory array units  200  of the transpose memory array structure  100  are operated to generate the multiply-accumulate output values (IN 0 *W[0]+IN 1 *W[0]+ . . . IN N *W[0], IN 0 *W[7]+IN 1 *W[7]+ . . . IN N *W[7]) with 2-bit inputs (R_input 0&lt;1:0&gt;, R_input N&lt;1:0&gt;) and 8-bit weights (Weight[0]-Weight[7]) in the horizontal direction. Therefore, the transpose memory unit  210   a  for the multi-bit CNN based CIM applications and the transpose memory array structure  100  for the multi-bit CNN based CIM applications of the present disclosure can operate the multi-bit input values and the weights at the same time without causing the write disturb issue, and utilize a two way transpose array to do training and inference in the horizontal and vertical directions respectively, thereby substantially reducing the latency and power consumption. 
       FIG. 8  shows a circuit diagram of a third type of one of a plurality of transpose memory units  210   b  according to a fourth embodiment of the present disclosure. Each of the transpose memory units  210   b  includes two memory cells  2120 ,  2121  and two transpose cells  214   b   0 ,  214   b   1 . The detail of each of the two memory cells  2120 ,  2121  is the same as the memory cell  212  of  FIG. 2 . The detail of the transpose cell  214   b   0  is the same as the transpose cell  214  of  FIG. 2 , and will not be described again herein. 
     The two memory cells  2120 ,  2121  store two weights, respectively. The two memory cells  2120 ,  2121  are controlled by the first word line WL. The transpose cell  214   b   1  is connected to the memory cell  2121 , a first input word line C_RWL&lt;n&gt;, a first output bit line C_RBL&lt;m&gt;, a second input word line R_RWL&lt;m&gt; and a second output bit line R_RBL&lt;n&gt;. The transpose cell  214   b   1  receives the weight from the memory cell  2121 . The two transpose cells  214   b   0 ,  214   b   1  are controlled by the second word line HWL to generate a multiply-accumulate output value (MAC) on one of the first output bit line C_RBL&lt;m&gt; and the second output bit line R_RBL&lt;n&gt; according to a multi-bit input value multiplied by two multi-bit weights, and the two multi-bit weights are formed by the weight of the memory cell  2120  and the weight of the memory cell  2121 . In addition, the transpose cell  214   b   1  includes a sixth transpose cell transistor M 6 , a seventh transpose cell transistor M 7 , an eighth transpose cell transistor M 8 , a ninth transpose cell transistor M 9  and a tenth transpose cell transistor M 10 . The sixth transpose cell transistor M 6 , the seventh transpose cell transistor M 7 , the eighth transpose cell transistor M 8 , the ninth transpose cell transistor M 9  and the tenth transpose cell transistor M 10  are corresponding to the first transpose cell transistor M 1 , the second transpose cell transistor M 2 , the third transpose cell transistor M 3 , the fourth transpose cell transistor M 4  and the fifth transpose cell transistor M 5 . Each of the third transpose cell transistor M 3 , the fourth transpose cell transistor M 4  and the fifth transpose cell transistor M 5  has a first transistor width. Each of the eighth transpose cell transistor M 8 , the ninth transpose cell transistor M 9  and the tenth transpose cell transistor M 10  has a second transistor width, and the first transistor width is equal to twice the second transistor width. 
     Table 5 lists the multi-bit input values (Input), the multi-bit weights (Weight) and the multiply-accumulate output values (MAC) of the second type of the transpose memory unit  210   b  of  FIG. 8 , in a column multiply-accumulate operation. The multiply-accumulate output values can be computed by the multi-bit input values and the multi-bit weights in the vertical direction. 
     
       
         
           
               
               
               
               
             
               
                 TABLE 5 
               
             
            
               
                   
               
               
                 Weight 
                 Input 
                 Input × Weight 
                   
               
            
           
           
               
               
               
               
               
            
               
                 LBL(Q1) 
                 LBL(Q0) 
                 (C_RWL&lt;n&gt;) 
                 (C_RBL&lt;m&gt;) 
                 MAC 
               
               
                   
               
               
                 1 
                 1 
                 1 
                 3 × Idis 
                 3 
               
               
                 1 
                 0 
                   
                 2 × Idis 
                 2 
               
               
                 0 
                 1 
                   
                 1 × Idis 
                 1 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 1 
                 1 
                 0 
                 0 × Idis 
                 0 
               
               
                 1 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 1 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
               
            
           
         
       
     
     Table 6 lists the multi-bit input values (Input), the multi-bit weights (Weight) and the multiply-accumulate output values (MAC) of the second type of the transpose memory unit  210   b  of  FIG. 8 , in a row multiply-accumulate operation. The multiply-accumulate output values can be computed by the multi-bit input values and the multi-bit weights in the horizontal direction. 
     
       
         
           
               
               
               
               
             
               
                 TABLE 6 
               
             
            
               
                   
               
               
                 Weight 
                 Input 
                 Input × Weight 
                   
               
            
           
           
               
               
               
               
               
            
               
                 LBL(Q1) 
                 LBL(Q0) 
                 (R_RWL&lt;m&gt;) 
                 (R_RBL&lt;n&gt;) 
                 MAC 
               
               
                   
               
               
                 1 
                 1 
                 1 
                 3 × Idis 
                 3 
               
               
                 1 
                 0 
                   
                 2 × Idis 
                 2 
               
               
                 0 
                 1 
                   
                 1 × Idis 
                 1 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 1 
                 1 
                 0 
                 0 × Idis 
                 0 
               
               
                 1 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 1 
                   
                 0 × Idis 
                 0 
               
               
                 0 
                 0 
                   
                 0 × Idis 
                 0 
               
               
                   
               
            
           
         
       
     
       FIG. 9  shows a flow chart of a computing method  700  of a transpose memory array structure  100  for a plurality of multi-bit CNN based CIM applications according to a fifth embodiment of the present disclosure. The computing method  700  of the transpose memory array structure  100  for the multi-bit CNN based CIM applications is controlled by a first word line WL and a second word line HWL. The computing method  700  includes a voltage level applying step S 2  and a computing step S 4 . 
     The voltage level applying step S 2  includes applying a plurality of voltage levels to the first word line WL, the second word line HWL, the weight, the at least one first input word line (e.g., C_RWL&lt;n&gt; of  FIGS. 2 and 8  or C_RWL_MSB&lt;n&gt; and C_RWL_LSB&lt;n&gt; of  FIG. 3 ) and the at least one second input word line (e.g., R_RWL&lt;m&gt; of  FIGS. 2 and 8  or R_RWL_MSB&lt;m&gt; and R_RWL_LSB&lt;m&gt; of  FIG. 3 ) of each of the transpose memory units  210 ,  210   a ,  210   b , respectively. The computing step S 4  includes driving the transpose cell  214 ,  214   a ,  214   b   0 ,  214   b   1  of each of the transpose memory units  210 ,  210   a ,  210   b  to compute the voltage levels of the weight, the at least one first input word line and the at least one second input word line so as to generate the multiply-accumulate output value (MAC) on the one of the first output bit line C_RBL&lt;m&gt; and the second output bit line R_RBL&lt;n&gt; according to the at least one multi-bit input value multiplied by the weight. In addition, the at least one first input word line and the second output bit line R_RBL&lt;n&gt; are extended in a horizontal direction, and the first output bit line C_RBL&lt;m&gt; and the at least one second input word line are extended in a vertical direction. 
     According to the aforementioned embodiments and examples, the advantages of the present disclosure are described as follows. 
     1. The transpose memory unit for the multi-bit CNN based CIM applications and the transpose memory array structure for the multi-bit CNN based CIM applications and the computing method thereof of the present disclosure can operate the multi-bit input values and the weights at the same time without causing the write disturb issue. 
     2. The transpose memory unit for the multi-bit CNN based CIM applications and the transpose memory array structure for the multi-bit CNN based CIM applications and the computing method thereof of the present disclosure can utilize a two way transpose array to do training and inference in the horizontal and vertical directions respectively, thereby substantially reducing the latency and power consumption. 
     Although the present disclosure has been described in considerable detail with reference to certain embodiments thereof, other embodiments are possible. Therefore, the spirit and scope of the appended claims should not be limited to the description of the embodiments contained herein. 
     It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present disclosure without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the present disclosure cover modifications and variations of this disclosure provided they fall within the scope of the following claims.