# Video Multi-Scale-Based End-to-End Rate Control in Deep Contextual Video Compression
## 4 Experimental Results
### Performance Analysis of End-to-End Rate Control
\begin{table}
\begin{tabular}{c c c c c c c c} \hline \hline \multirow{2}{*}{**Class**} & \multirow{2}{*}{**Sequence**} & \multicolumn{2}{c}{**[PERSON] et al. [22]**} & \multicolumn{2}{c}{**[PERSON] et al. [9]**} & \multicolumn{2}{c}{**Proposed**} \\ \cline{3-8}  & & **BD-Rate** & **BD-Rate** & **BD-Rate** & **BD-Rate** & **BD-Rate** & **BD-Rate** \\  & & **(PSNR)** & **(SSIM)** & **(PSNR)** & **(SSIM)** & **(PSNR)** & **(SSIM)** \\ \hline \multirow{4}{*}{Class A1} & Tango2 & \(-\)3.63 & \(-\)0.77 & \(-\)0.20 & \(-\)0.03 & \(-\)0.42 & \(-\)0.27 \\ \cline{2-8}  & FoodMarket4 & 0.83 & 0.10 & 0.08 & 0.02 & 0.74 & 0.07 \\ \cline{2-8}  & Campfire & \(-\)2.02 & \(-\)0.65 & \(-\)0.32 & \(-\)0.20 & \(-\)1.66 & \(-\)0.42 \\ \hline \multirow{4}{*}{Class A2} & CatRobot1 & \(-\)2.27 & \(-\)0.68 & \(-\)0.32 & \(-\)0.03 & \(-\)0.63 & \(-\)0.40 \\ \cline{2-8}  & DaylightRoad2 & \(-\)0.82 & \(-\)0.12 & \(-\)0.22 & \(-\)0.06 & \(-\)0.07 & \(-\)0.12 \\ \cline{2-8}  & ParkRunning3 & 0.40 & 0.04 & 0.34 & 0.05 & 0.29 & \(-\)0.05 \\ \hline \multirow{4}{*}{Class B} & MarketPlace & 1.03 & 0.12 & 0.14 & \(-\)0.02 & \(-\)1.60 & \(-\)0.67 \\ \cline{2-8}  & RitualDance & \(-\)0.93 & \(-\)0.31 & \(-\)0.82 & \(-\)0.36 & \(-\)1.30 & \(-\)0.58 \\ \cline{2-8}  & Cactus & \(-\)0.49 & \(-\)0.19 & \(-\)0.40 & \(-\)0.18 & \(-\)1.13 & \(-\)0.51 \\ \cline{2-8}  & BasketballDrive & \(-\)2.52 & \(-\)0.68 & \(-\)1.07 & \(-\)0.67 & \(-\)2.56 & \(-\)0.72 \\ \cline{2-8}  & BQTerrace & \(-\)1.83 & \(-\)0.60 & \(-\)1.16 & \(-\)0.65 & \(-\)1.52 & \(-\)0.60 \\ \hline \multirow{4}{*}{Class C} & BasketballDrill & \(-\)0.06 & \(-\)0.01 & \(-\)0.51 & \(-\)0.32 & \(-\)1.14 & \(-\)0.43 \\ \cline{2-8}  & BQMall & 0.15 & 0.00 & \(-\)0.22 & \(-\)0.03 & \(-\)0.50 & \(-\)0.34 \\ \cline{2-8}  & PartyScene & 0.23 & \(-\)0.02 & 0.18 & 0.02 & \(-\)1.96 & \(-\)0.50 \\ \cline{2-8}  & RaceHorses & \(-\)0.59 & \(-\)0.08 & \(-\)0.61 & \(-\)0.28 & \(-\)1.12 & \(-\)0.46 \\ \hline \multirow{4}{*}{Class D} & BasketballPass & \(-\)0.89 & \(-\)0.30 & \(-\)1.13 & \(-\)0.44 & \(-\)0.05 & \(-\)0.08 \\ \cline{2-8}  & BQSquare & 1.03 & 0.13 & \(-\)0.93 & \(-\)0.41 & \(-\)0.80 & \(-\)0.30 \\ \cline{2-8}  & BlowingBubbles & 1.02 & 0.10 & 1.04 & 0.32 & \(-\)0.01 & \(-\)0.06 \\ \cline{2-8}  & RaceHorses & \(-\)0.45 & \(-\)0.20 & \(-\)0.10 & \(-\)0.01 & \(-\)0.46 & \(-\)0.22 \\ \hline \multirow{4}{*}{Class E} & FourPeople & \(-\)1.33 & \(-\)0.43 & \(-\)0.69 & \(-\)0.23 & \(-\)1.29 & \(-\)0.37 \\ \cline{2-8}  & Johnny & \(-\)0.43 & \(-\)0.12 & \(-\)0.17 & \(-\)0.10 & \(-\)0.43 & \(-\)0.33 \\ \cline{2-8}  & KristenAndSara & \(-\)1.59 & \(-\)0.61 & \(-\)0.50 & \(-\)0.21 & \(-\)0.82 & \(-\)0.38 \\ \hline \multirow{4}{*}{Class E} & **Average** & **\(-\)0.69** & **\(-\)0.24** & **\(-\)0.35** & **\(-\)0.17** & **\(-\)0.84** & **\(-\)0.35** \\ \cline{2-8}  & & & & & & & \\ \hline \hline \end{tabular}
\end{table} 
Table 3: Experimental comparisons of [PERSON] et al. [22], [PERSON] et al. [9], and the end-to-end rate control. In Table 3, the average BD-rate (PSNR) indexes of [PERSON] et al. [22], [PERSON] et al. [9], and the end-to-end rate control are \(-0.69\), \(-0.35\), and \(-0.84\), respectively. This means that the proposed end-to-end rate control uses the lowest bit rate but improves coding quality the most. For the BD-rate (SSIM) indexes, the proposed algorithm achieves -0.35. [PERSON] et al. [22] and [PERSON] et al. [9] achieved \(-0.24\) and \(-0.17\), respectively. This also means that the proposed end-to-end rate control mostly improves subjective coding quality. Since temporal coding information is used to train the network for coding, the bit rate is allocated more reasonably to meet the changing frame feature, and \(\lambda\) can be selected more effectively to decrease RD costs. The RD comparisons are shown in Figure 8.  
Figure 8 shows the RD comparisons of DCVC, [PERSON] et al. [22], [PERSON] et al. [9], and the proposed algorithm.