# Detection and Adaptive Video Processing of Hyperopia Scene in Sports Video

Authors: Qingjie Chen; Minkai Dong
Journal: Complexity
 (2021)

---

## Abstract

In the research of motion video, the existing target detection methods are susceptible to changes in the motion video scene and cannot accurately detect the motion state of the target. Moving target detection technology is an important branch of computer vision technology. Its function is to implement real-time monitoring, real-time video capture, and detection of objects in the target area and store information that users are interested in as an important basis for exercise. This article focuses on how to efficiently perform motion detection on real-time video. By introducing the mathematical model of image processing, the traditional motion detection algorithm is improved and the improved motion detection algorithm is implemented in the system. This article combines the advantages of the widely used frame difference method, target detection algorithm, and background difference method and introduces the moving object detection method combining these two algorithms. When using Gaussian mixture model for modeling, improve the parts with differences, and keep the unmatched Gaussian distribution so that the modeling effect is similar to the actual background; the binary image is obtained through the difference between frames and the threshold, and the motion change domain is extracted through mathematical morphological filtering, and finally, the moving target is detected. The experiment proved the following: when there are more motion states, the recall rate is slightly better than that of the VIBE algorithm. It decreased about 0.05 or so, but the relative accuracy rate increased by about 0.12, and the increase ratio is significantly higher than the decrease ratio. Departments need to adopt effective target extraction methods. In order to improve the accuracy of moving target detection, this paper studies the method of background model establishment and target extraction and proposes its own improvement.


---

## Body

## 1. Introduction

With the maturity of computer technology, especially multimedia technology, and the processing and analysis theory of digital images, video images, as more direct and richer information carriers, are becoming more and more important research objects. In recent years, with the introduction of highway and digital earth concepts and the widespread application of the Internet, video image information has become an important source and means for humans to obtain and use information. The detection and tracking of target images is based on dynamic image analysis combined with image recognition and image tracking methods to detect targets in image sequences. The process of recognition and follow-up tracking is very important in the field of image processing. After inspection, it was found that there was a sentence segmentation phenomenon, so the incomplete sentence was deleted directly. Inspection technology is the intersection of image processing technology, machine vision technology, and artificial intelligence technology. Therefore, detection technology has broad prospects in scientific theoretical research and also has broad prospects in practical engineering applications.The research on video processing technology in foreign countries started early, almost accompanied by the birth of black-and-white TV sets, but limited by the technical level, the development is slow. The combination of embedded system and computer vision and image processing technology forms an object-oriented embedded video processing technology. Shukla and Sharma proposed that moving target detection and moving target tracking algorithms are the most basic components, especially target detection algorithms, which have a direct impact on the overall performance of video surveillance systems and have been a hot spot in the field of image processing and machine vision. After inspection, it was found that there was a sentence segmentation phenomenon, so the incomplete sentence was deleted directly [1]. Yang et al. proposed an RFID security monitoring system that combines motion sensors and RFID modules. The system application relies on motion detection sensors to detect moving targets [2]. Chebi et al. used frame difference sharpness pattern matching to detect vehicles in motion and incorporated the background removal function into a small portable camera, which can better segment the foreground in the background area [3].The domestic video surveillance industry initially developed from closed-circuit television surveillance. From simple analog video surveillance to the current purely digital network video surveillance, surveillance systems have been widely used in China recently, and their performance is comparable to that of large foreign companies. Quite a gap. Wang et al. uses the interframe difference method in the detection of moving objects in the video. Compared with the optical flow method, the advantage of the frame difference method is that the calculation speed is very fast, but there is still a big disadvantage, that is, in the detection process, the target object is easily detected [4]. Huang et al. proposed to use Wiener filtering to model and used it to predict the pixel value of the model and regarded the pixels that deviate from the estimated value as the former scenic spot [5]. Huang et al. assumed that the pixel value will change linearly with Gaussian changes over time, so a single Gaussian distribution is adopted to simulate the background model. This method mainly uses a Gaussian distribution to represent the characteristic value of a pixel and detects the pixel of the image. The eigenvalue size of will match the Gaussian distribution to classify the pixels [6].Moving target detection and tracking are at the bottom of the vision system and are the basis for various subsequent advanced processing such as target classification and behavior understanding. This paper uses an adaptive background subtraction algorithm on a fixed single node to better complete the extraction of the moving area under a complex dynamic background and uses the static and dynamic characteristics of the moving target for multitarget tracking. The model of the tracking system under the condition that a single node can be moved is discussed, and a system model is proposed. In this paper, the contour of the target is detected, and the smallest bounding rectangle of the largest contour is used as the tracking frame of MeanShift, combined with the detection results to track the selected target, and the algorithm is applied to the UAV video to detect and track the target.


## 2. Detection and Adaptive Video Processing of Hyperopia Scene in Sports Video

### 2.1. Background Modeling Based on Gaussian Mixture Model

TheK-Gaussian model is used to model every pixel in RGB color space to represent every pixel in the image. According to the priority ωI,tωI,t=1,I=2k, the K-Gaussian distribution used to describe the color distribution of each point has different weights from high to high ωI/σI.Let us say you have a low order [7, 8]. Given an appropriate background weight and threshold T, only the previous distribution within this threshold is considered as background distribution, and the other distribution is foreground distribution. At time t, Xt is the pixel value, and the probability density function can be written as a linear combination of K-Gaussian distribution.(1)Pxt=∑i=1kϖ,it2πd/2Covt,i1/2,where ωI, t, μI, t, Covi, and t are the weight, mean, and covariance matrices of the i Gaussian distribution at time t, respectively. The K-Gaussian distribution is sorted in descending order of priority ωI/σI, while the previous b Gaussian distribution is used to represent the background distribution, for example,(2)B=argmin∑i=1bwi,t>T,where t is the set background threshold. For the convenience of calculation, it is assumed that the red, green, and blue components of pixels are independent of each other.(3)xt=xhtx≤xba,μj,t=μj,ty,μj,tg,μj,tb,Covi,t=Covi,tr,Covi,tg,Covi,tb.


### 2.2. Automatic Extraction of Stadium Main Area Based on Histogram Statistics

The document used statistical information on the differences of color elements to distinguish legal areas. For the main characteristics of the green soccer field and the lawn tennis court, the extraction algorithm is used based on the difference in component color information. In the lawn area, the green element of the pixel is larger than the red and blue elements. The differences between the green component and the other two components were calculated and then the color characteristics of the lawn were obtained by threshold treatment. The grass area is extracted from the image, and the binary image is achieved by threshold processing [9, 10].(4)Ix,y=1,Gx,y−Rx,y>TandGx,y−Bx,y>Tb,0,other.Among them,Rx,y, Gx,y, and Bx,y are pixel values of color image and TR and TB are two thresholds which can be adjusted according to the position. Choosing reasonable parameters in the green football field, the extraction accuracy of the main areas of the stadium is relatively accurate [11, 12]. However, this algorithm can only be used in lawns and other places with prior knowledge and cannot be extracted adaptively.After inspection, it was found that there was a sentence segmentation phenomenon, so the incomplete sentence was deleted directly. Due to the influence of noise and other factors in the imaging process, there are many small noises or small areas in the main area of the segmented stadium, so it is impossible to remove them directly by removing small areas. According to the nature of noise, the method of eliminating block motion noise can solve this problem well [13, 14]. The blocking operation used in this paper is noise algorithm which is as follows: the image is divided into n×n blocks, and the statistical value of stadium color in each block is greater than a certain percentage; the block is regarded as stadium; otherwise, the stadium block is considered. The formula is(5)Bi,j1,if∑y=N∗jy=Nj+1∑x=N∗ix=Ni+1Gx,y>T×N2,0,other.Among them,BI,J is a binary result graph composed of n×n blocks, Gx,y is the primary extracted main area of the course, and t is the proportion of the area. In most cases, t is 0.6 and n is 36.It is assumed that the gray value of the pixel at the same point does not change significantly in two consecutive frames, so it can be considered to be approximately equal as shown in the following formula:(6)fx+dx,y+dy,t+dt=fx,y,t.Among them,fx,y,t is the gray scale of pixel x,y at time t and fx+dx,y+dy,t+dt is the gray scale of x,y moving to pixel x+dx,y+dy. Since the foundation of the algorithm is based on gray level consistency, it is also necessary to assume that formula (7) holds, namely:(7)∂fx+dx,y+dy,t+dtdt=0.After the second-order Taylor formula expansion and simplification of formula (7), we can obtain the optical flow field calculation formula:(8)∂f∂xdxdt+∂f∂ydydt+∂f∂t=0.Among them,∂f/∂x can be understood as the gradient of the brightness of the image in the horizontal direction, dx/dt can be understood as the gradient in the vertical direction, ∂f/∂t can be understood as the gradient in time, and dx/dt and ∂f/∂t are the optical flow in the horizontal direction and optical flow in the vertical direction, respectively.


### 2.3. Eigen Image Filtering

Among various image processing methods, adjusting pixels is the most basic image processing method. It can adjust the changes of the image under different illuminations through the logarithmic conversion of the pixel value. In addition, rendering is also a kind of image processing, and reasonable rendering can make the image clearer [15, 16]. Recently, Finlayson proposed a new intrinsic image algorithm, and by calibrating the camera’s sensitive equipment, the color image is converted into one-dimensional gray-scale image, thus eliminating the influence of shadow. We use this method in this article because there are few restrictions on this method, and it is not very strict. At the same time, this paper provides a method to improve the calibration technology and expand the scope of the algorithm.Assuming that the Lambert model can be used in the imaging process of the camera photoreceptor, an integral formula can be used to describe the response of each color channel of the photoreceptor [17, 18].(9)ρkx,y=σx,y∫Eλ,x,ySλ,x,yQkλdλ,where k=BGR represents the index of the color channel, Qk is the spectral response function of the kth color sensing device, σx,y is the Lambert light dark coefficient, which is the dot product of the normal vector of the reflection plane and the direction vector of the incident light, Eλ,x,y is the spectral energy distribution function of the incident light, and Sλ,x,y is the reflection function of the object surface. If the following two conditions are met at each point of the photosensitive device: the spectral response function of each color channel is a Dirac function and the illuminance function of the incident light can use Planck model, then Qkλ and Eλ,x,y can be expressed as follows:(10)Qkλ=qkδλ−λk,(11)Eλ,T≈Icλ−5e−c2/Tλ,where Qk is the response strength of the inductor. Because every pixel needs to be considered, the pixel position parameter in the function is removed. I refers to the absolute parameter of light control c1 and c2 refer to the intensity of light, and, t refers to the absolute temperature. Substituting formulas (7) and (8) into formula (6) yields(12)Pk=σIc1λk−5e−c2/TλSλkqk.Now establish the ratio of the two channels:(13)rk=pkpp.Ifp=G, then k=R,B; take the natural logarithm for formula (10) and use two values to form a two-dimensional vector R/G:(14)x1x2=logSRSGlogSBSG+1TeR−eGeB−eG,where λ1=R/G and λ2=Brk; from (11), it can be seen that the first term on the right side of the formula is a constant, whose value is determined jointly by the reflecting surface and the camera, and the second term is determined by the incident light temperature and the camera. With the change of the temperature of the incident light, the image points of the same medium are distributed along a straight line in the two-dimensional plane, and this straight line is only related to the camera, not to the incident light and the reflection plane [19, 20].The basic idea of the interframe difference method is to obtain the shape of the moving target by performing the difference operation on two consecutive frames of the video image sequence.The change between the imagesfkx,y and fk+1x,y of frame k and frame k+1 is represented by a two-finger differential image Dx,y, as shown in the following formula:(15)Dx,y=1,iffk+1x,y−fkx,y>T,0,others.In formula (15), 0 corresponds to the area where the two frames of images have not changed and 1 corresponds to the area that has changed. The flowchart of the interframe difference method is shown in Figure 1.Figure 1
Interframe difference method flowchart.


### 2.4. Background Recognition Modeling

The common methods of background model building and updating are the statistical average method, coefficient updating method, Gauss model method, etc [21, 22]. The complexity of various methods of background model building and updating is different, and the effect of background model obtained is also different.The statistical average method is to average the continuous video sequence and take the average value as the pixel value in the current background model. Assuming that the current video sequence is thenth frame, then the current time background model is common, and the formula is as follows [23, 24]:(16)Bn−1i,j=∑k=1n−1fki,jn−1,Bn−1i,j=1−αBn−2i,j+αfni,j,μn−1i,j=1n−1∑k=1n−1fki,j,σn−12i,j=1n−1∑k=1n−1fki,j−μi,j2,where fki,j the pixel gray value at the k image coordinate i,j. When the H-th image is acquired [25, 26], the system will get the gray value. According to the above formula transformation process, the improved Gaussian function formula is as follows:(17)μn−1i,j=1−αμn−1i,j+αfni,j,σn2i,j=1−ασn−12i,j+αfni,j−μni,j2.Firstly, the first image of video sequence is used as the initial background, and the current tilt imagefn at n time in the post w sequence matrix is used with the previous moment background image F0 [27, 28]. A background model updating template is obtained by differential operation, and the common CBn−1 is obtained by binarization of the updated template with decision threshold BTn:(18)BTni,j=01Fni,j−CBn−1i,j>D.Background imageCBn is updated as follows:(19)CBni,j=CBn−1i,j,ω1CBn−1i,j+ω2Fni,j.


## 2.1. Background Modeling Based on Gaussian Mixture Model

TheK-Gaussian model is used to model every pixel in RGB color space to represent every pixel in the image. According to the priority ωI,tωI,t=1,I=2k, the K-Gaussian distribution used to describe the color distribution of each point has different weights from high to high ωI/σI.Let us say you have a low order [7, 8]. Given an appropriate background weight and threshold T, only the previous distribution within this threshold is considered as background distribution, and the other distribution is foreground distribution. At time t, Xt is the pixel value, and the probability density function can be written as a linear combination of K-Gaussian distribution.(1)Pxt=∑i=1kϖ,it2πd/2Covt,i1/2,where ωI, t, μI, t, Covi, and t are the weight, mean, and covariance matrices of the i Gaussian distribution at time t, respectively. The K-Gaussian distribution is sorted in descending order of priority ωI/σI, while the previous b Gaussian distribution is used to represent the background distribution, for example,(2)B=argmin∑i=1bwi,t>T,where t is the set background threshold. For the convenience of calculation, it is assumed that the red, green, and blue components of pixels are independent of each other.(3)xt=xhtx≤xba,μj,t=μj,ty,μj,tg,μj,tb,Covi,t=Covi,tr,Covi,tg,Covi,tb.


## 2.2. Automatic Extraction of Stadium Main Area Based on Histogram Statistics

The document used statistical information on the differences of color elements to distinguish legal areas. For the main characteristics of the green soccer field and the lawn tennis court, the extraction algorithm is used based on the difference in component color information. In the lawn area, the green element of the pixel is larger than the red and blue elements. The differences between the green component and the other two components were calculated and then the color characteristics of the lawn were obtained by threshold treatment. The grass area is extracted from the image, and the binary image is achieved by threshold processing [9, 10].(4)Ix,y=1,Gx,y−Rx,y>TandGx,y−Bx,y>Tb,0,other.Among them,Rx,y, Gx,y, and Bx,y are pixel values of color image and TR and TB are two thresholds which can be adjusted according to the position. Choosing reasonable parameters in the green football field, the extraction accuracy of the main areas of the stadium is relatively accurate [11, 12]. However, this algorithm can only be used in lawns and other places with prior knowledge and cannot be extracted adaptively.After inspection, it was found that there was a sentence segmentation phenomenon, so the incomplete sentence was deleted directly. Due to the influence of noise and other factors in the imaging process, there are many small noises or small areas in the main area of the segmented stadium, so it is impossible to remove them directly by removing small areas. According to the nature of noise, the method of eliminating block motion noise can solve this problem well [13, 14]. The blocking operation used in this paper is noise algorithm which is as follows: the image is divided into n×n blocks, and the statistical value of stadium color in each block is greater than a certain percentage; the block is regarded as stadium; otherwise, the stadium block is considered. The formula is(5)Bi,j1,if∑y=N∗jy=Nj+1∑x=N∗ix=Ni+1Gx,y>T×N2,0,other.Among them,BI,J is a binary result graph composed of n×n blocks, Gx,y is the primary extracted main area of the course, and t is the proportion of the area. In most cases, t is 0.6 and n is 36.It is assumed that the gray value of the pixel at the same point does not change significantly in two consecutive frames, so it can be considered to be approximately equal as shown in the following formula:(6)fx+dx,y+dy,t+dt=fx,y,t.Among them,fx,y,t is the gray scale of pixel x,y at time t and fx+dx,y+dy,t+dt is the gray scale of x,y moving to pixel x+dx,y+dy. Since the foundation of the algorithm is based on gray level consistency, it is also necessary to assume that formula (7) holds, namely:(7)∂fx+dx,y+dy,t+dtdt=0.After the second-order Taylor formula expansion and simplification of formula (7), we can obtain the optical flow field calculation formula:(8)∂f∂xdxdt+∂f∂ydydt+∂f∂t=0.Among them,∂f/∂x can be understood as the gradient of the brightness of the image in the horizontal direction, dx/dt can be understood as the gradient in the vertical direction, ∂f/∂t can be understood as the gradient in time, and dx/dt and ∂f/∂t are the optical flow in the horizontal direction and optical flow in the vertical direction, respectively.


## 2.3. Eigen Image Filtering

Among various image processing methods, adjusting pixels is the most basic image processing method. It can adjust the changes of the image under different illuminations through the logarithmic conversion of the pixel value. In addition, rendering is also a kind of image processing, and reasonable rendering can make the image clearer [15, 16]. Recently, Finlayson proposed a new intrinsic image algorithm, and by calibrating the camera’s sensitive equipment, the color image is converted into one-dimensional gray-scale image, thus eliminating the influence of shadow. We use this method in this article because there are few restrictions on this method, and it is not very strict. At the same time, this paper provides a method to improve the calibration technology and expand the scope of the algorithm.Assuming that the Lambert model can be used in the imaging process of the camera photoreceptor, an integral formula can be used to describe the response of each color channel of the photoreceptor [17, 18].(9)ρkx,y=σx,y∫Eλ,x,ySλ,x,yQkλdλ,where k=BGR represents the index of the color channel, Qk is the spectral response function of the kth color sensing device, σx,y is the Lambert light dark coefficient, which is the dot product of the normal vector of the reflection plane and the direction vector of the incident light, Eλ,x,y is the spectral energy distribution function of the incident light, and Sλ,x,y is the reflection function of the object surface. If the following two conditions are met at each point of the photosensitive device: the spectral response function of each color channel is a Dirac function and the illuminance function of the incident light can use Planck model, then Qkλ and Eλ,x,y can be expressed as follows:(10)Qkλ=qkδλ−λk,(11)Eλ,T≈Icλ−5e−c2/Tλ,where Qk is the response strength of the inductor. Because every pixel needs to be considered, the pixel position parameter in the function is removed. I refers to the absolute parameter of light control c1 and c2 refer to the intensity of light, and, t refers to the absolute temperature. Substituting formulas (7) and (8) into formula (6) yields(12)Pk=σIc1λk−5e−c2/TλSλkqk.Now establish the ratio of the two channels:(13)rk=pkpp.Ifp=G, then k=R,B; take the natural logarithm for formula (10) and use two values to form a two-dimensional vector R/G:(14)x1x2=logSRSGlogSBSG+1TeR−eGeB−eG,where λ1=R/G and λ2=Brk; from (11), it can be seen that the first term on the right side of the formula is a constant, whose value is determined jointly by the reflecting surface and the camera, and the second term is determined by the incident light temperature and the camera. With the change of the temperature of the incident light, the image points of the same medium are distributed along a straight line in the two-dimensional plane, and this straight line is only related to the camera, not to the incident light and the reflection plane [19, 20].The basic idea of the interframe difference method is to obtain the shape of the moving target by performing the difference operation on two consecutive frames of the video image sequence.The change between the imagesfkx,y and fk+1x,y of frame k and frame k+1 is represented by a two-finger differential image Dx,y, as shown in the following formula:(15)Dx,y=1,iffk+1x,y−fkx,y>T,0,others.In formula (15), 0 corresponds to the area where the two frames of images have not changed and 1 corresponds to the area that has changed. The flowchart of the interframe difference method is shown in Figure 1.Figure 1
Interframe difference method flowchart.


## 2.4. Background Recognition Modeling

The common methods of background model building and updating are the statistical average method, coefficient updating method, Gauss model method, etc [21, 22]. The complexity of various methods of background model building and updating is different, and the effect of background model obtained is also different.The statistical average method is to average the continuous video sequence and take the average value as the pixel value in the current background model. Assuming that the current video sequence is thenth frame, then the current time background model is common, and the formula is as follows [23, 24]:(16)Bn−1i,j=∑k=1n−1fki,jn−1,Bn−1i,j=1−αBn−2i,j+αfni,j,μn−1i,j=1n−1∑k=1n−1fki,j,σn−12i,j=1n−1∑k=1n−1fki,j−μi,j2,where fki,j the pixel gray value at the k image coordinate i,j. When the H-th image is acquired [25, 26], the system will get the gray value. According to the above formula transformation process, the improved Gaussian function formula is as follows:(17)μn−1i,j=1−αμn−1i,j+αfni,j,σn2i,j=1−ασn−12i,j+αfni,j−μni,j2.Firstly, the first image of video sequence is used as the initial background, and the current tilt imagefn at n time in the post w sequence matrix is used with the previous moment background image F0 [27, 28]. A background model updating template is obtained by differential operation, and the common CBn−1 is obtained by binarization of the updated template with decision threshold BTn:(18)BTni,j=01Fni,j−CBn−1i,j>D.Background imageCBn is updated as follows:(19)CBni,j=CBn−1i,j,ω1CBn−1i,j+ω2Fni,j.


## 3. Hyperopia Scene Detection and Adaptive Video Processing Experiment Design

### 3.1. System Design

The image acquisition subsystem divides the video information collected by the USB camera into two parts. The first part is transmitted to the real-time monitoring client through the network; the other part enters the moving target detection subsystem. When a moving target passes in the surveillance area, the system will quickly detect the target. The subsystem calls the alarm subsystem to perform alarm work and at the same time compresses and saves the video pictures and several continuous screenshots when moving objects appear in the monitoring area through the image compression subsystem and the storage subsystem and saves them locally. When a user wants to find a moving target, he can view the video or picture through the WEB subsystem of the network to quickly find the target object. The process is shown in Figure2.Figure 2
Moving target detection and tracking program structure diagram.


### 3.2. Test Subject

In order to compare the effect and processing speed of the remote scene detection system in this article, the system in this article is compared with several common systems that use other algorithms. The main comparison algorithms are GMG algorithm, GMM detection algorithm, IMBS detection algorithm, KDE detection algorithm, and VIBE detection algorithm; the algorithm in this article is an improved VIBE detection algorithm. The video images of the experimental database are used for qualitative comparison, and these experimental data are collected for data analysis to draw conclusions. In this paper, the precision rate and recall rate are used as indicators to evaluate the detection algorithm, and the processing speed is also used as the evaluation indicator. After inspection, it was found that there was a sentence segmentation phenomenon, so the incomplete sentence was deleted directly. The larger the value, the better the detection of the algorithm; the smaller the value of processing speed, the better the detection of the algorithm.


### 3.3. Experimental Method

First, it is necessary to fill the image with holes to remove small target impurities, that is, when there are disturbances in the background, such as the shaking of leaves, or the misdetection caused by changes in illumination, this will cause some false small targets in the foreground image. And there will be some defects and holes in the detected moving target, which will have an impact on the subsequent contour detection and tracking. In intelligent monitoring, some false targets will cause false alarms and incomplete targets will cause missed detection. Secondly, the circumscribed rectangle of the detected target after improvement needs to be used as the initial target of the MeanShift tracking algorithm. The contour of the final target image will be detected. After the moving target is obtained, the moving target to be tracked is selected, that is, select tracking target area, tracking the target.


### 3.4. Statistical Data Processing Method

SPSS23.0 software was used for data processing, and the count data were expressed in percentage (%);k is the number of data in this experiment, σ2 is the variance of all survey results, and P<0.05 indicates that the difference is statistically significant. The formula for calculating reliability is as follows:(20)a=kk−11−∑σi2σ2.


## 3.1. System Design

The image acquisition subsystem divides the video information collected by the USB camera into two parts. The first part is transmitted to the real-time monitoring client through the network; the other part enters the moving target detection subsystem. When a moving target passes in the surveillance area, the system will quickly detect the target. The subsystem calls the alarm subsystem to perform alarm work and at the same time compresses and saves the video pictures and several continuous screenshots when moving objects appear in the monitoring area through the image compression subsystem and the storage subsystem and saves them locally. When a user wants to find a moving target, he can view the video or picture through the WEB subsystem of the network to quickly find the target object. The process is shown in Figure2.Figure 2
Moving target detection and tracking program structure diagram.


## 3.2. Test Subject

In order to compare the effect and processing speed of the remote scene detection system in this article, the system in this article is compared with several common systems that use other algorithms. The main comparison algorithms are GMG algorithm, GMM detection algorithm, IMBS detection algorithm, KDE detection algorithm, and VIBE detection algorithm; the algorithm in this article is an improved VIBE detection algorithm. The video images of the experimental database are used for qualitative comparison, and these experimental data are collected for data analysis to draw conclusions. In this paper, the precision rate and recall rate are used as indicators to evaluate the detection algorithm, and the processing speed is also used as the evaluation indicator. After inspection, it was found that there was a sentence segmentation phenomenon, so the incomplete sentence was deleted directly. The larger the value, the better the detection of the algorithm; the smaller the value of processing speed, the better the detection of the algorithm.


## 3.3. Experimental Method

First, it is necessary to fill the image with holes to remove small target impurities, that is, when there are disturbances in the background, such as the shaking of leaves, or the misdetection caused by changes in illumination, this will cause some false small targets in the foreground image. And there will be some defects and holes in the detected moving target, which will have an impact on the subsequent contour detection and tracking. In intelligent monitoring, some false targets will cause false alarms and incomplete targets will cause missed detection. Secondly, the circumscribed rectangle of the detected target after improvement needs to be used as the initial target of the MeanShift tracking algorithm. The contour of the final target image will be detected. After the moving target is obtained, the moving target to be tracked is selected, that is, select tracking target area, tracking the target.


## 3.4. Statistical Data Processing Method

SPSS23.0 software was used for data processing, and the count data were expressed in percentage (%);k is the number of data in this experiment, σ2 is the variance of all survey results, and P<0.05 indicates that the difference is statistically significant. The formula for calculating reliability is as follows:(20)a=kk−11−∑σi2σ2.


## 4. Experimental Hyperopia Scene Detection and Adaptive Video Processing

### 4.1. Evaluation Index System Based on Index Reliability Testing

Reliability refers to the stability and reliability of the questionnaire. This article adopts theα coefficient method created by L.J. Cronbach. The α coefficient can be obtained by reliability analysis in SPSS software. It is generally believed that the α coefficient above 0.8 indicates that the effect of the index setting is very good, and above 0.7 is also acceptable. Here we analyze the reliability of each type of object, and the reliability index we choose for each type of object is slightly different. The results are shown in Table 1.Table 1
Summary of reliability test results.
CategoryIndex combinationAlpha coefficient (α)Highway sceneHeuristic rule0.8632Spatial correlationIndirect motion sceneHeuristic rule0.8447Spatial correlationScenes with similar colorsHeuristic rule0.7365Spatial correlationSmall target sceneHeuristic rule0.7746Spatial correlationHyperopia sceneHeuristic rule0.8124Spatial correlationIt can be seen from Table1 that there are certain differences in the processing results of different scenes, but these processing results can be optimized technically, so the difference between the processing effects of different scenes has an acceptable impact on this experiment (α > 0.7). In order to better illustrate the detection effect, corresponding indicators are used to evaluate the detection effect. According to the segmented real foreground image, many indicators are used to evaluate the background modeling algorithm.


### 4.2. Comparison and Analysis of Detection Algorithms

#### 4.2.1. Effect Analysis of Baseline Video Library Scene

First, we analyze the scenes of the baseline video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis: highway scene, indirect motion scene, scene with similar color, small target scene, and hyperopia scene. The results of the target scene and the hyperopia scene are shown in Table2. We make a bar graph based on this result, as shown in Figure 3.Table 2
Baseline video library scene effect analysis data.
AlgorithmHighway sceneIndirect motion sceneScenes with similar colorsSmall target sceneHyperopia sceneGMG detection algorithm1.421.61.832.392.56GMM detection algorithm1.621.852.332.453.11IMBS detection algorithm1.892.072.742.813.4KDE detection algorithm2.172.733.093.223.58VIBE detection algorithm2.762.83.163.523.71Detection algorithm of this article2.843.353.663.894.99Figure 3
Effect analysis diagram of baseline video library scene.It can be seen from Figure3 that although the GMG detection algorithm can detect a relatively complete target, the algorithm is more sensitive to illumination changes and background disturbance; the GMM detection algorithm is more obvious in the detection of the target wheel, but it is not easy to find it inside the target and when the target is hidden. When the background is more complex, the detection effect is not very good; the IMBS detection algorithm has a good detection effect, but it is very sensitive to light changes and background disturbance; the KDE detection algorithm has a bad detection effect, and the algorithm is more sensitive to the contour of the object. The detection rate is very high; the VIBE detection algorithm is more robust to illumination and background disturbance; the detection algorithm in this paper maintains the advantages of the VIBE algorithm and further improves the detection accuracy.


#### 4.2.2. Effect Analysis of Dynamic Background Video Library Scene

We analyze the scenes of the dynamic background video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis: the oar shaking scene, water wave shaking scene, leaf shaking scene, fountain scene, and hyperopia scene. The results of the fountain scene and the hyperopia scene are shown in Table3. We make a histogram based on this result, as shown in Figure 4.Table 3
Effect analysis data of dynamic background video library scene.
AlgorithmOar shaking sceneWater wave shaking sceneLeaf shaking sceneFountain sceneHyperopia sceneGMG detection algorithm1.581.351.682.322.71GMM detection algorithm2.111.572.082.333.00IMBS detection algorithm2.212.042.132.813.31KDE detection algorithm2.392.173.113.013.52VIBE detection algorithm3.182.423.043.773.79Detection algorithm of this article3.233.123.633.934.16Figure 4
Effect analysis diagram of dynamic background video library scene.It can be seen from Figure4 that the GMG detection algorithm is very sensitive to background disturbances, and background disturbances have a great influence on the detection effect; the detection effect of GMM detection algorithm is not ideal for background disturbances; the IMBS detection algorithm is very sensitive to the interference of leaf shaking, and there is a lot of false detection rate; VIBE detection algorithm still has a little false detection; the detection algorithm in this paper reduces the target of false detection for the rippling of water waves and the shaking of leaves, and it can also detect moving targets.


#### 4.2.3. Effect Analysis of Camera Shake Video Library Scene

We analyze the scenes of the camera shake video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis, namely: badminton court scene, highway scene, zebra crossing scene, road scene, and hyperopia scene. The results are shown in Table4, and we make a line chart based on this result, as shown in Figure 5.Table 4
Effect analysis data of camera shake video library scene.
AlgorithmBadminton court sceneHighway sceneZebra crossing sceneRoad sceneHyperopia sceneGMG detection algorithm5.014.123.843.454.87GMM detection algorithm1.952.193.025.524.32IMBS detection algorithm2.501.321.882.593.70KDE detection algorithm2.814.156.205.656.53VIBE detection algorithm3.413.124.835.197.03Detection algorithm of this article5.124.914.804.827.79Figure 5
Effect analysis diagram of camera shake video library scene.It can be seen from Figure5 that the GMG detection algorithm has a relatively high false detection rate for camera shake. Although the complexity of the GMM detection algorithm is reduced, its detection accuracy is not very high; although the KDE detection algorithm has a high detection rate, there are still errors, while the IMBS detection algorithm has large errors, and its detection effect needs to be further improved; the false detection rate of the VIBE detection algorithm is relatively reduced, but there will still be some false warnings. The detection algorithm in this article guarantees the detection accuracy and reduces the false detection rate.


### 4.3. Evaluation Index Analysis

#### 4.3.1. Analysis of the Accuracy Index of Dynamic Background Video Library Scene Detection

We analyze the detection accuracy index of dynamic background video library scenes and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine its accuracy. Here, five scenes are selected for comparative analysis. They are badminton court scene, basketball court scene, street scene, park scene, and hyperopia scene. The results are shown in Table5. We make a combined picture based on this result, as shown in Figure 6.Table 5
Data of accuracy index for dynamic background video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.960.350.970.830.930.98Basketball court scene0.940.240.880.720.951.00Street scene0.960.600.971.000.951.00Park scene0.890.400.870.630.860.91Hyperopia scene0.800.970.680.720.830.95Figure 6
The accuracy index map of scene detection for dynamic background video library.It can be seen from Figure6 that for the five scenes with dynamic background, there are fast-moving people or indirect-moving people, there are changes in illumination, and the leaves are slightly shaking. The improved algorithm in this paper is relatively stable in the detection accuracy index value. Compared with the original VIBE algorithm, it has increased to a certain percentage, so it verifies the effectiveness of the improved method in this paper.


#### 4.3.2. Analysis of the Recall Rate Index of Dynamic Background Video Library Scene Detection

We analyze the detection recall rate index for the scene of the dynamic background video library and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the recall rate. The results are shown in Table6. This result makes a bar graph, as shown in Figure 7.Table 6
Data of recall rate index for dynamic background video library scene detection.
Test recall rateGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.920.400.920.650.850.89Basketball court scene0.740.240.750.470.820.85Street scene0.840.600.830.900.800.82Park scene0.660.300.690.230.620.67Hyperopia scene0.790.690.590.630.730.85Figure 7
Recall rate indicator diagram for scene detection of dynamic background video library.The improved algorithm in this paper has different recall rates for different scenarios. As can be seen from Figure7, the recall rate is higher than that of the VIBE algorithm when the motion state is relatively uniform, and when there are more motion states, the recall rate is slightly better than that of the VIBE algorithm. It decreased about 0.05 or so, but the relative accuracy rate increased by about 0.12, and the increase ratio is significantly higher than the decrease ratio.


#### 4.3.3. Analysis of the Speed Index of the Dynamic Background Video Library Scene Detection

We analyze the detection speed index of the scene of the dynamic background video library and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the detection speed. The results are shown in Table7. The result is a histogram, as shown in Figure 8.Table 7
Data of speed indicators for scene detection of dynamic background video library.
Detection speedGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.090.120.070.160.050.01Basketball court scene0.160.170.090.210.130.06Street scene1.030.990.971.070.890.79Park scene0.860.791.030.940.820.66Hyperopia scene0.170.260.190.310.220.13Figure 8
Speed detection speed indicator diagram for scene of dynamic background video library.The improved algorithm in this paper has different detection speed changes for different scenarios. From Figure8, it can be seen that when the motion state is relatively uniform, the increase in detection speed is not too large. When there are more motion states, the detection speed increases. It can be clearly observed.


#### 4.3.4. Analysis of the Accuracy Index of Camera Shake Video Library Scene Detection

We analyze the detection accuracy index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine its accuracy. Here, five scenes are selected for comparison and analysis. These are subway station scene, highway scene, zebra crossing scene, road scene, and far vision scene. The results are shown in Table8. We make a histogram based on this result, as shown in Figure 9.Table 8
Data of accuracy index for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.800.600.970.940.980.98Highway scene0.570.930.850.950.950.95Zebra crossing scene0.850.300.850.800.940.97Road scene0.820.920.900.950.950.97Hyperopia scene0.430.730.890.760.830.94Figure 9
The accuracy index chart of camera shake video library scene detection.It can be seen from Figure9 and from the experimental data that for the five complex scenes of camera shake, the effect of the improved algorithm in this paper is relatively stable in the detection accuracy index value, and the false detection rate is lower than that of other algorithms. The VIBE algorithm has been improved, so for camera shake, the detection effect is better than that of other algorithms.


#### 4.3.5. Analysis of the Recall Rate Index of Camera Shake Video Library Scene Detection

We analyze the detection recall rate index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and judge the recall rate. The results are shown in Table9. This result makes a histogram, as shown in Figure 10.Table 9
Data of recall rate index for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.310.480.880.440.730.86Highway scene0.230.630.750.770.780.85Zebra crossing scene0.530.430.750.330.620.89Road scene0.400.680.900.820.910.93Hyperopia scene0.470.770.540.730.820.90Figure 10
Recall rate index graph for camera shake video library scene detection.The improved algorithm in this article has different recall rates for different scenarios. As shown in Figure10, when the motion state is relatively uniform, the recall rate is higher than that of the VIBE algorithm, and when the motion state increases, it is higher than that of the VIBE algorithm. There is only an increase of about 0.02, but the relative accuracy rate has increased by about 0.08, and the improvement ratio is significantly higher.


#### 4.3.6. Analysis of the Speed Index of Camera Shake Video Library Scene Detection

We analyze the detection speed index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the detection speed. The results are shown in Table10. The result is a histogram, as shown in Figure 11.Table 10
Data of speed indicators for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.890.761.030.880.640.37Highway scene0.360.130.190.280.150.01Zebra crossing scene0.350.230.270.650.330.06Road scene0.160.340.260.220.190.01Hyperopia scene0.170.260.190.310.220.13Figure 11
Speed detection indicators for camera shake video library scene.The improved algorithm in this paper has different detection speeds for different scenarios. From Figure11, it can be seen that when the motion state is relatively uniform, the detection speed will increase slightly due to the increase in the number of people to be detected. When the motion state increases, it will not increase because of the increase in the number of people tested.


## 4.1. Evaluation Index System Based on Index Reliability Testing

Reliability refers to the stability and reliability of the questionnaire. This article adopts theα coefficient method created by L.J. Cronbach. The α coefficient can be obtained by reliability analysis in SPSS software. It is generally believed that the α coefficient above 0.8 indicates that the effect of the index setting is very good, and above 0.7 is also acceptable. Here we analyze the reliability of each type of object, and the reliability index we choose for each type of object is slightly different. The results are shown in Table 1.Table 1
Summary of reliability test results.
CategoryIndex combinationAlpha coefficient (α)Highway sceneHeuristic rule0.8632Spatial correlationIndirect motion sceneHeuristic rule0.8447Spatial correlationScenes with similar colorsHeuristic rule0.7365Spatial correlationSmall target sceneHeuristic rule0.7746Spatial correlationHyperopia sceneHeuristic rule0.8124Spatial correlationIt can be seen from Table1 that there are certain differences in the processing results of different scenes, but these processing results can be optimized technically, so the difference between the processing effects of different scenes has an acceptable impact on this experiment (α > 0.7). In order to better illustrate the detection effect, corresponding indicators are used to evaluate the detection effect. According to the segmented real foreground image, many indicators are used to evaluate the background modeling algorithm.


## 4.2. Comparison and Analysis of Detection Algorithms

### 4.2.1. Effect Analysis of Baseline Video Library Scene

First, we analyze the scenes of the baseline video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis: highway scene, indirect motion scene, scene with similar color, small target scene, and hyperopia scene. The results of the target scene and the hyperopia scene are shown in Table2. We make a bar graph based on this result, as shown in Figure 3.Table 2
Baseline video library scene effect analysis data.
AlgorithmHighway sceneIndirect motion sceneScenes with similar colorsSmall target sceneHyperopia sceneGMG detection algorithm1.421.61.832.392.56GMM detection algorithm1.621.852.332.453.11IMBS detection algorithm1.892.072.742.813.4KDE detection algorithm2.172.733.093.223.58VIBE detection algorithm2.762.83.163.523.71Detection algorithm of this article2.843.353.663.894.99Figure 3
Effect analysis diagram of baseline video library scene.It can be seen from Figure3 that although the GMG detection algorithm can detect a relatively complete target, the algorithm is more sensitive to illumination changes and background disturbance; the GMM detection algorithm is more obvious in the detection of the target wheel, but it is not easy to find it inside the target and when the target is hidden. When the background is more complex, the detection effect is not very good; the IMBS detection algorithm has a good detection effect, but it is very sensitive to light changes and background disturbance; the KDE detection algorithm has a bad detection effect, and the algorithm is more sensitive to the contour of the object. The detection rate is very high; the VIBE detection algorithm is more robust to illumination and background disturbance; the detection algorithm in this paper maintains the advantages of the VIBE algorithm and further improves the detection accuracy.


### 4.2.2. Effect Analysis of Dynamic Background Video Library Scene

We analyze the scenes of the dynamic background video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis: the oar shaking scene, water wave shaking scene, leaf shaking scene, fountain scene, and hyperopia scene. The results of the fountain scene and the hyperopia scene are shown in Table3. We make a histogram based on this result, as shown in Figure 4.Table 3
Effect analysis data of dynamic background video library scene.
AlgorithmOar shaking sceneWater wave shaking sceneLeaf shaking sceneFountain sceneHyperopia sceneGMG detection algorithm1.581.351.682.322.71GMM detection algorithm2.111.572.082.333.00IMBS detection algorithm2.212.042.132.813.31KDE detection algorithm2.392.173.113.013.52VIBE detection algorithm3.182.423.043.773.79Detection algorithm of this article3.233.123.633.934.16Figure 4
Effect analysis diagram of dynamic background video library scene.It can be seen from Figure4 that the GMG detection algorithm is very sensitive to background disturbances, and background disturbances have a great influence on the detection effect; the detection effect of GMM detection algorithm is not ideal for background disturbances; the IMBS detection algorithm is very sensitive to the interference of leaf shaking, and there is a lot of false detection rate; VIBE detection algorithm still has a little false detection; the detection algorithm in this paper reduces the target of false detection for the rippling of water waves and the shaking of leaves, and it can also detect moving targets.


### 4.2.3. Effect Analysis of Camera Shake Video Library Scene

We analyze the scenes of the camera shake video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis, namely: badminton court scene, highway scene, zebra crossing scene, road scene, and hyperopia scene. The results are shown in Table4, and we make a line chart based on this result, as shown in Figure 5.Table 4
Effect analysis data of camera shake video library scene.
AlgorithmBadminton court sceneHighway sceneZebra crossing sceneRoad sceneHyperopia sceneGMG detection algorithm5.014.123.843.454.87GMM detection algorithm1.952.193.025.524.32IMBS detection algorithm2.501.321.882.593.70KDE detection algorithm2.814.156.205.656.53VIBE detection algorithm3.413.124.835.197.03Detection algorithm of this article5.124.914.804.827.79Figure 5
Effect analysis diagram of camera shake video library scene.It can be seen from Figure5 that the GMG detection algorithm has a relatively high false detection rate for camera shake. Although the complexity of the GMM detection algorithm is reduced, its detection accuracy is not very high; although the KDE detection algorithm has a high detection rate, there are still errors, while the IMBS detection algorithm has large errors, and its detection effect needs to be further improved; the false detection rate of the VIBE detection algorithm is relatively reduced, but there will still be some false warnings. The detection algorithm in this article guarantees the detection accuracy and reduces the false detection rate.


## 4.2.1. Effect Analysis of Baseline Video Library Scene

First, we analyze the scenes of the baseline video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis: highway scene, indirect motion scene, scene with similar color, small target scene, and hyperopia scene. The results of the target scene and the hyperopia scene are shown in Table2. We make a bar graph based on this result, as shown in Figure 3.Table 2
Baseline video library scene effect analysis data.
AlgorithmHighway sceneIndirect motion sceneScenes with similar colorsSmall target sceneHyperopia sceneGMG detection algorithm1.421.61.832.392.56GMM detection algorithm1.621.852.332.453.11IMBS detection algorithm1.892.072.742.813.4KDE detection algorithm2.172.733.093.223.58VIBE detection algorithm2.762.83.163.523.71Detection algorithm of this article2.843.353.663.894.99Figure 3
Effect analysis diagram of baseline video library scene.It can be seen from Figure3 that although the GMG detection algorithm can detect a relatively complete target, the algorithm is more sensitive to illumination changes and background disturbance; the GMM detection algorithm is more obvious in the detection of the target wheel, but it is not easy to find it inside the target and when the target is hidden. When the background is more complex, the detection effect is not very good; the IMBS detection algorithm has a good detection effect, but it is very sensitive to light changes and background disturbance; the KDE detection algorithm has a bad detection effect, and the algorithm is more sensitive to the contour of the object. The detection rate is very high; the VIBE detection algorithm is more robust to illumination and background disturbance; the detection algorithm in this paper maintains the advantages of the VIBE algorithm and further improves the detection accuracy.


## 4.2.2. Effect Analysis of Dynamic Background Video Library Scene

We analyze the scenes of the dynamic background video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis: the oar shaking scene, water wave shaking scene, leaf shaking scene, fountain scene, and hyperopia scene. The results of the fountain scene and the hyperopia scene are shown in Table3. We make a histogram based on this result, as shown in Figure 4.Table 3
Effect analysis data of dynamic background video library scene.
AlgorithmOar shaking sceneWater wave shaking sceneLeaf shaking sceneFountain sceneHyperopia sceneGMG detection algorithm1.581.351.682.322.71GMM detection algorithm2.111.572.082.333.00IMBS detection algorithm2.212.042.132.813.31KDE detection algorithm2.392.173.113.013.52VIBE detection algorithm3.182.423.043.773.79Detection algorithm of this article3.233.123.633.934.16Figure 4
Effect analysis diagram of dynamic background video library scene.It can be seen from Figure4 that the GMG detection algorithm is very sensitive to background disturbances, and background disturbances have a great influence on the detection effect; the detection effect of GMM detection algorithm is not ideal for background disturbances; the IMBS detection algorithm is very sensitive to the interference of leaf shaking, and there is a lot of false detection rate; VIBE detection algorithm still has a little false detection; the detection algorithm in this paper reduces the target of false detection for the rippling of water waves and the shaking of leaves, and it can also detect moving targets.


## 4.2.3. Effect Analysis of Camera Shake Video Library Scene

We analyze the scenes of the camera shake video library and compare the effect analysis of the algorithm used in the system with that of other algorithms. Here, five scenes are selected for comparative analysis, namely: badminton court scene, highway scene, zebra crossing scene, road scene, and hyperopia scene. The results are shown in Table4, and we make a line chart based on this result, as shown in Figure 5.Table 4
Effect analysis data of camera shake video library scene.
AlgorithmBadminton court sceneHighway sceneZebra crossing sceneRoad sceneHyperopia sceneGMG detection algorithm5.014.123.843.454.87GMM detection algorithm1.952.193.025.524.32IMBS detection algorithm2.501.321.882.593.70KDE detection algorithm2.814.156.205.656.53VIBE detection algorithm3.413.124.835.197.03Detection algorithm of this article5.124.914.804.827.79Figure 5
Effect analysis diagram of camera shake video library scene.It can be seen from Figure5 that the GMG detection algorithm has a relatively high false detection rate for camera shake. Although the complexity of the GMM detection algorithm is reduced, its detection accuracy is not very high; although the KDE detection algorithm has a high detection rate, there are still errors, while the IMBS detection algorithm has large errors, and its detection effect needs to be further improved; the false detection rate of the VIBE detection algorithm is relatively reduced, but there will still be some false warnings. The detection algorithm in this article guarantees the detection accuracy and reduces the false detection rate.


## 4.3. Evaluation Index Analysis

### 4.3.1. Analysis of the Accuracy Index of Dynamic Background Video Library Scene Detection

We analyze the detection accuracy index of dynamic background video library scenes and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine its accuracy. Here, five scenes are selected for comparative analysis. They are badminton court scene, basketball court scene, street scene, park scene, and hyperopia scene. The results are shown in Table5. We make a combined picture based on this result, as shown in Figure 6.Table 5
Data of accuracy index for dynamic background video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.960.350.970.830.930.98Basketball court scene0.940.240.880.720.951.00Street scene0.960.600.971.000.951.00Park scene0.890.400.870.630.860.91Hyperopia scene0.800.970.680.720.830.95Figure 6
The accuracy index map of scene detection for dynamic background video library.It can be seen from Figure6 that for the five scenes with dynamic background, there are fast-moving people or indirect-moving people, there are changes in illumination, and the leaves are slightly shaking. The improved algorithm in this paper is relatively stable in the detection accuracy index value. Compared with the original VIBE algorithm, it has increased to a certain percentage, so it verifies the effectiveness of the improved method in this paper.


### 4.3.2. Analysis of the Recall Rate Index of Dynamic Background Video Library Scene Detection

We analyze the detection recall rate index for the scene of the dynamic background video library and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the recall rate. The results are shown in Table6. This result makes a bar graph, as shown in Figure 7.Table 6
Data of recall rate index for dynamic background video library scene detection.
Test recall rateGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.920.400.920.650.850.89Basketball court scene0.740.240.750.470.820.85Street scene0.840.600.830.900.800.82Park scene0.660.300.690.230.620.67Hyperopia scene0.790.690.590.630.730.85Figure 7
Recall rate indicator diagram for scene detection of dynamic background video library.The improved algorithm in this paper has different recall rates for different scenarios. As can be seen from Figure7, the recall rate is higher than that of the VIBE algorithm when the motion state is relatively uniform, and when there are more motion states, the recall rate is slightly better than that of the VIBE algorithm. It decreased about 0.05 or so, but the relative accuracy rate increased by about 0.12, and the increase ratio is significantly higher than the decrease ratio.


### 4.3.3. Analysis of the Speed Index of the Dynamic Background Video Library Scene Detection

We analyze the detection speed index of the scene of the dynamic background video library and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the detection speed. The results are shown in Table7. The result is a histogram, as shown in Figure 8.Table 7
Data of speed indicators for scene detection of dynamic background video library.
Detection speedGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.090.120.070.160.050.01Basketball court scene0.160.170.090.210.130.06Street scene1.030.990.971.070.890.79Park scene0.860.791.030.940.820.66Hyperopia scene0.170.260.190.310.220.13Figure 8
Speed detection speed indicator diagram for scene of dynamic background video library.The improved algorithm in this paper has different detection speed changes for different scenarios. From Figure8, it can be seen that when the motion state is relatively uniform, the increase in detection speed is not too large. When there are more motion states, the detection speed increases. It can be clearly observed.


### 4.3.4. Analysis of the Accuracy Index of Camera Shake Video Library Scene Detection

We analyze the detection accuracy index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine its accuracy. Here, five scenes are selected for comparison and analysis. These are subway station scene, highway scene, zebra crossing scene, road scene, and far vision scene. The results are shown in Table8. We make a histogram based on this result, as shown in Figure 9.Table 8
Data of accuracy index for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.800.600.970.940.980.98Highway scene0.570.930.850.950.950.95Zebra crossing scene0.850.300.850.800.940.97Road scene0.820.920.900.950.950.97Hyperopia scene0.430.730.890.760.830.94Figure 9
The accuracy index chart of camera shake video library scene detection.It can be seen from Figure9 and from the experimental data that for the five complex scenes of camera shake, the effect of the improved algorithm in this paper is relatively stable in the detection accuracy index value, and the false detection rate is lower than that of other algorithms. The VIBE algorithm has been improved, so for camera shake, the detection effect is better than that of other algorithms.


### 4.3.5. Analysis of the Recall Rate Index of Camera Shake Video Library Scene Detection

We analyze the detection recall rate index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and judge the recall rate. The results are shown in Table9. This result makes a histogram, as shown in Figure 10.Table 9
Data of recall rate index for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.310.480.880.440.730.86Highway scene0.230.630.750.770.780.85Zebra crossing scene0.530.430.750.330.620.89Road scene0.400.680.900.820.910.93Hyperopia scene0.470.770.540.730.820.90Figure 10
Recall rate index graph for camera shake video library scene detection.The improved algorithm in this article has different recall rates for different scenarios. As shown in Figure10, when the motion state is relatively uniform, the recall rate is higher than that of the VIBE algorithm, and when the motion state increases, it is higher than that of the VIBE algorithm. There is only an increase of about 0.02, but the relative accuracy rate has increased by about 0.08, and the improvement ratio is significantly higher.


### 4.3.6. Analysis of the Speed Index of Camera Shake Video Library Scene Detection

We analyze the detection speed index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the detection speed. The results are shown in Table10. The result is a histogram, as shown in Figure 11.Table 10
Data of speed indicators for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.890.761.030.880.640.37Highway scene0.360.130.190.280.150.01Zebra crossing scene0.350.230.270.650.330.06Road scene0.160.340.260.220.190.01Hyperopia scene0.170.260.190.310.220.13Figure 11
Speed detection indicators for camera shake video library scene.The improved algorithm in this paper has different detection speeds for different scenarios. From Figure11, it can be seen that when the motion state is relatively uniform, the detection speed will increase slightly due to the increase in the number of people to be detected. When the motion state increases, it will not increase because of the increase in the number of people tested.


## 4.3.1. Analysis of the Accuracy Index of Dynamic Background Video Library Scene Detection

We analyze the detection accuracy index of dynamic background video library scenes and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine its accuracy. Here, five scenes are selected for comparative analysis. They are badminton court scene, basketball court scene, street scene, park scene, and hyperopia scene. The results are shown in Table5. We make a combined picture based on this result, as shown in Figure 6.Table 5
Data of accuracy index for dynamic background video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.960.350.970.830.930.98Basketball court scene0.940.240.880.720.951.00Street scene0.960.600.971.000.951.00Park scene0.890.400.870.630.860.91Hyperopia scene0.800.970.680.720.830.95Figure 6
The accuracy index map of scene detection for dynamic background video library.It can be seen from Figure6 that for the five scenes with dynamic background, there are fast-moving people or indirect-moving people, there are changes in illumination, and the leaves are slightly shaking. The improved algorithm in this paper is relatively stable in the detection accuracy index value. Compared with the original VIBE algorithm, it has increased to a certain percentage, so it verifies the effectiveness of the improved method in this paper.


## 4.3.2. Analysis of the Recall Rate Index of Dynamic Background Video Library Scene Detection

We analyze the detection recall rate index for the scene of the dynamic background video library and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the recall rate. The results are shown in Table6. This result makes a bar graph, as shown in Figure 7.Table 6
Data of recall rate index for dynamic background video library scene detection.
Test recall rateGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.920.400.920.650.850.89Basketball court scene0.740.240.750.470.820.85Street scene0.840.600.830.900.800.82Park scene0.660.300.690.230.620.67Hyperopia scene0.790.690.590.630.730.85Figure 7
Recall rate indicator diagram for scene detection of dynamic background video library.The improved algorithm in this paper has different recall rates for different scenarios. As can be seen from Figure7, the recall rate is higher than that of the VIBE algorithm when the motion state is relatively uniform, and when there are more motion states, the recall rate is slightly better than that of the VIBE algorithm. It decreased about 0.05 or so, but the relative accuracy rate increased by about 0.12, and the increase ratio is significantly higher than the decrease ratio.


## 4.3.3. Analysis of the Speed Index of the Dynamic Background Video Library Scene Detection

We analyze the detection speed index of the scene of the dynamic background video library and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the detection speed. The results are shown in Table7. The result is a histogram, as shown in Figure 8.Table 7
Data of speed indicators for scene detection of dynamic background video library.
Detection speedGMGGMMIMBSKDEVIBEThis articleBadminton court scene0.090.120.070.160.050.01Basketball court scene0.160.170.090.210.130.06Street scene1.030.990.971.070.890.79Park scene0.860.791.030.940.820.66Hyperopia scene0.170.260.190.310.220.13Figure 8
Speed detection speed indicator diagram for scene of dynamic background video library.The improved algorithm in this paper has different detection speed changes for different scenarios. From Figure8, it can be seen that when the motion state is relatively uniform, the increase in detection speed is not too large. When there are more motion states, the detection speed increases. It can be clearly observed.


## 4.3.4. Analysis of the Accuracy Index of Camera Shake Video Library Scene Detection

We analyze the detection accuracy index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine its accuracy. Here, five scenes are selected for comparison and analysis. These are subway station scene, highway scene, zebra crossing scene, road scene, and far vision scene. The results are shown in Table8. We make a histogram based on this result, as shown in Figure 9.Table 8
Data of accuracy index for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.800.600.970.940.980.98Highway scene0.570.930.850.950.950.95Zebra crossing scene0.850.300.850.800.940.97Road scene0.820.920.900.950.950.97Hyperopia scene0.430.730.890.760.830.94Figure 9
The accuracy index chart of camera shake video library scene detection.It can be seen from Figure9 and from the experimental data that for the five complex scenes of camera shake, the effect of the improved algorithm in this paper is relatively stable in the detection accuracy index value, and the false detection rate is lower than that of other algorithms. The VIBE algorithm has been improved, so for camera shake, the detection effect is better than that of other algorithms.


## 4.3.5. Analysis of the Recall Rate Index of Camera Shake Video Library Scene Detection

We analyze the detection recall rate index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and judge the recall rate. The results are shown in Table9. This result makes a histogram, as shown in Figure 10.Table 9
Data of recall rate index for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.310.480.880.440.730.86Highway scene0.230.630.750.770.780.85Zebra crossing scene0.530.430.750.330.620.89Road scene0.400.680.900.820.910.93Hyperopia scene0.470.770.540.730.820.90Figure 10
Recall rate index graph for camera shake video library scene detection.The improved algorithm in this article has different recall rates for different scenarios. As shown in Figure10, when the motion state is relatively uniform, the recall rate is higher than that of the VIBE algorithm, and when the motion state increases, it is higher than that of the VIBE algorithm. There is only an increase of about 0.02, but the relative accuracy rate has increased by about 0.08, and the improvement ratio is significantly higher.


## 4.3.6. Analysis of the Speed Index of Camera Shake Video Library Scene Detection

We analyze the detection speed index of the camera shake video library scene and compare the algorithm used in this paper with other algorithms to analyze the motion state of people in the video and determine the detection speed. The results are shown in Table10. The result is a histogram, as shown in Figure 11.Table 10
Data of speed indicators for camera shake video library scene detection.
Detection accuracyGMGGMMIMBSKDEVIBEThis articleSubway station scene0.890.761.030.880.640.37Highway scene0.360.130.190.280.150.01Zebra crossing scene0.350.230.270.650.330.06Road scene0.160.340.260.220.190.01Hyperopia scene0.170.260.190.310.220.13Figure 11
Speed detection indicators for camera shake video library scene.The improved algorithm in this paper has different detection speeds for different scenarios. From Figure11, it can be seen that when the motion state is relatively uniform, the detection speed will increase slightly due to the increase in the number of people to be detected. When the motion state increases, it will not increase because of the increase in the number of people tested.


## 5. Conclusions

This topic is derived from a target image search project of a certain research. It detects intrusive moving targets in the monitored warning area. The background of the video is more complicated. Since the characteristics of the moving target are unknown, the background subtraction method is used. The key step of this method is the establishment of the background model, the target extraction, and the update of the background model method; only the generated background model has good adaptability to the changes of the complex background and can reflect the real background image, and the target needs to be extracted after the background model is established. Departments need to adopt effective target extraction methods. In order to improve the accuracy of moving target detection, this paper studies the method of background model establishment and target extraction and proposes its own improvement.Afterwards, an improved detection algorithm is used to clean and delete the shadow area of the moving target in order to better track the target. Combining the improved VIBE algorithm and the shadow removal of multifeature fusion, it has been verified by experiments to effectively remove the shadow of the detected target, making the detected moving target more accurate. Finally, we detect the maximum contour of the target from which the shadow is removed, use the minimum bounding rectangle of the target as the initial window of MeanShift tracking, and combine the detection results to track the target. Through comparison and verification, the MeanShift tracking algorithm combined with the improved detection algorithm in this paper has better tracking effect than the MeanShift algorithm without combined improvement. In this paper, the improved detection and tracking methods are applied to the video images captured by the drone, and the moving targets in the video are detected and the targets are tracked. It can be seen from the experimental results that the moving targets in the video taken by the drone are clearer. The target detection and tracking effect is relatively ideal, which further proves the effectiveness of the improved method in this paper.By applying the detection and tracking system of moving objects to sports video, the system will process the collected motion information data and obtain the motion parameters of human body. It is very important to send some data to improve the quality of athletes and coaches and expand the development direction of athletes. This paper is based on the background of the research and development of sports video object detection and tracking system, through the Gauss model to separate the scene, through the eigen extraction to extract the characteristics of the players in the stadium, and finally through the difference method to identify the video content, which opens a new idea for the detection and adaptive processing of the athletes in sports video.



---

*Source: 6610760-2021-01-12.xml*