## 1 Introduction to Virtual Production with Real-Time Rendering
### Related Work  
The groundwork for VPX has been profoundly laid out through seminal works in filmmaking. Seminal films such as \"Star Wars: Episode I--The Phantom Menace\" [8], \"Avatar\" [9], \"The Lord of the Rings: The Fellowship of the Ring\" [10], and \"The Polar Express\" [11], have significantly influenced the development and understanding of Virtual Production Experiences (VPX) in the film industry. These films have set the stage for advanced VPX implementations, as seen in \"The Mandalorian\" [12], where [PERSON]'s integration of VPX from visualization to in-camera final pixel solutions has been groundbreaking, merging the realms of the real and the digital in a seamless real-time process.  
[PERSON] elaborates on VPX as a range of technologies that enable practical filmmaking tools to interact with virtual counterparts [13]. This interaction allows a camera in the physical world to control a virtual camera within a game engine, with the real-time final image displayed on an LED wall for capture. The Epic Games company has been at the forefront of this revolution, introducing key methodologies in \"The Virtual Production Field Guide\" (2019) that encompass Visualization, Chroma Virtual Production, and LED Wall Virtual Production. These techniques have revolutionized narrative development in films, providing invaluable tools for directors and creative teams.  
Visualization is pivotal in VPX, serving as the initial step in visualizing and refining creative concepts. It encompasses various phases, including Pitchviz, Shotviz, Previz, Virtual Scouting, Techviz, Stuntviz, and Postviz, each crucial for different stages of the filmmaking process (Figure 2) [14; 15; 16; 17; 18; 19; 20]. Chroma Virtual Production offers a novel approach to green screen filmmaking, allowing for the real-time incorporation of virtual elements into live-action footage, thus broadening narrative possibilities and creative flexibility [20; 21]. LED Wall Virtual Production represents a fusion of live action with real-time game engine visuals, presented on large LED screens, providing dynamic lighting and immersive production settings [13; 20].  
Recent studies further explore the advancements in VPX and real-time rendering technologies. [PERSON] et al. investigate neural rendering, a method that marries generative machine learning with traditional computer graphics, opening new avenues in virtual and  
Figure 2: Visualization Types. (**a**) Storyboard (static image); (**b**) ShotViz (static image); (**c**) PreViz (moving image sequence); (**d**) Final movie (moving image sequence).  
augmented reality applications [22]. [PERSON] discusses the impact of game engines like Unreal Engine and Unity on virtual production, emphasizing their role in real-time rendering and remote collaboration [23].  
[PERSON] et al. introduce a neural approach for reconstructing, compressing, and rendering human performances, enhancing the creation of realistic and expressive avatars for VR [24]. [PERSON] et al. delve into a VR-based design method for multi-visual animation character 3D models, integrating real-time computer graphics technologies to enrich character immersion [25]. [PERSON] et al. address the challenges in VR education through a cloud-to-end rendering and storage system, showcasing the system's ability to deliver high-quality, real-time 3D content [26].  
These integrated insights provide a comprehensive overview of the evolution and current state of virtual production and real-time rendering, illustrating their transformative impact on the film industry and beyond and driving innovation in narrative development, creative visualization, and interactive experiences.