# Object-Wise Video Editing
## 3 Novel View Video Synthesis  
In our proposed Novel View Video Synthesis (NVVS) method, we create a virtual camera in 3D space near the path of the input video. To render the novel view from the manually created virtual camera, we draw the pixel ray of pixel \(p\) of the novel view which intersects with the 3D scene. Here, the first intersection in the pixel ray from point \(p\) is considered as the potential position to collect color information from neighboring frames from potential points set \(S(p)\) using Equation (1). The point \(p\) represents the entire pixel of the view from the virtual camera created in 3D space. The only difference in the NVVS method from object removal is the truncated ray segment of pixel ray. To inpaint both  
Figure 11: Sample Temporal Error Correction Results: Please see inside of yellow circles.  
foreground and background, the ray segment should cover the whole scene in 3D space which is shown in Figure 11(a) with a red line. In this figure, the pixel \(p\) need to collect color information of a smaller region from the closer object surface. On the other hand, the farther object surface in 3D space contains a bigger region for pixel \(p\). The refined potential points \(\hat{s}\) should have a smaller distance than the region created by the frustum of single pixel \(p\) and the surface of the scene. As the NND curves do not always have zero minima, the smaller fixed threshold for NDD can avoid a potential frame for collecting refined point \(\hat{s}\) which can create artifacts when very few numbers of points are selected. On the other hand, a bigger threshold for NDD distance can include multiple refined points from the truncated epipolar 2D line from a single reference frame for a closer object shown on the left side of Figure 11(a). Applying a bigger threshold on NDD causes a blur effect on the closer object and the background points near the object edge can collect foreground information. To solve this problem, we give a threshold based on the 3D distance from the novel view camera to the intersecting point between the pixel ray of \(p\) and pixel ray of \(s\). The distance can be calculated from the triangle shown in Figure 7(b). The diagonal Size of the single pixel frustum at distance from the Camera for each potential point \(s\) is considered as the threshold which forces collection of one or very few significant potential points from a single frame shown on the left side of Figure 11(a). The distance ratio of the neighboring pixel in the epipolar line (image space) and the red line is not the same. In the valid range of the red line, closer distance has dense pixels and farther have a sparse pixels. If the threshold is set as single pixel size then some potential background pixel can be omitted from the refined point set collection. To include those, we consider the sub-pixel level inside the epipolar line of the 2D image rather than increasing the pixel size in 3D for threshold. In Figure 11(b), we showed the comparison between the NVS result obtained from a fixed threshold and adaptive threshold based on the 3D distance. A fixed threshold creates a slightly blurred result when a bigger threshold is set for avoiding artifacts and our proposed threshold method based on 3D distance obtained more sharper result.