A virtual image generation system for use by an end user, comprising: memory; a display subsystem; an object selection device configured for receiving input from the end user and selecting at least one object from a plurality of objects in a three-dimensional scene (250, 252) in response to the user input, wherein the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) comprises a real object (Ra, Rb, R1, R2); and a control subsystem configured for acquiring image data (VID-V2, VID-V3, VID-V4, VID-R2) for the at least one selected object with at least an image capturing device (112, 114); rendering the image data (VID-V2, VID-V3, VID-V4, VID-R2) of the at least one selected object as a plurality of image frames, which represents the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) as the virtual object (V1, V2, V3, V4) in the three-dimensional scene (250, 252); acquiring audio data (AUD-V1, AUD-V2, AID-V3, AUD-V4) that emanates from the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) over at least one non-selected object of the plurality of objects with an audio capturing device (116, 122); rendering spatialized audio (EFX-V1, EFX-V2, EFX-Vn) from the audio data (AUD-V1, AUD-V2, AUD-V3, AUD-V4) at least by localizing first metadata (MD-R2, MD-OUT, MD-V2, MD-V3, MD-V4) to the user (54, 50) based at least in part upon second metadata, wherein the first metadata (MD-R2, MD-OUT, MD-V2, MD-V3, MD-V4) is localized into first localized metadata to the user (50, 54) and is associated with at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) and is generated along with the audio data (AUD-V1, AUD-V2, AUD-V3, AUD-V4) by the virtual image generation system or by a different virtual image generation system having the audio capturing device (116, 122), the second metadata pertains to a positional or orientational characteristic detected by the virtual image generation system for the user; and presenting the spatialized audio (EFX-V1, EFX-V2, EFX-Vn), which has been rendered, and at least one virtual object (V2, V3, V4) representing the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) in synchrony to the user (50, 54) based at least in part upon the first metadata and the second metadata. memory; a display subsystem; an object selection device configured for receiving input from the end user and selecting at least one object from a plurality of objects in a three-dimensional scene (250, 252) in response to the user input, wherein the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) comprises a real object (Ra, Rb, R1, R2); and a control subsystem configured for acquiring image data (VID-V2, VID-V3, VID-V4, VID-R2) for the at least one selected object with at least an image capturing device (112, 114); rendering the image data (VID-V2, VID-V3, VID-V4, VID-R2) of the at least one selected object as a plurality of image frames, which represents the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) as the virtual object (V1, V2, V3, V4) in the three-dimensional scene (250, 252); acquiring audio data (AUD-V1, AUD-V2, AID-V3, AUD-V4) that emanates from the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) over at least one non-selected object of the plurality of objects with an audio capturing device (116, 122); rendering spatialized audio (EFX-V1, EFX-V2, EFX-Vn) from the audio data (AUD-V1, AUD-V2, AUD-V3, AUD-V4) at least by localizing first metadata (MD-R2, MD-OUT, MD-V2, MD-V3, MD-V4) to the user (54, 50) based at least in part upon second metadata, wherein the first metadata (MD-R2, MD-OUT, MD-V2, MD-V3, MD-V4) is localized into first localized metadata to the user (50, 54) and is associated with at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) and is generated along with the audio data (AUD-V1, AUD-V2, AUD-V3, AUD-V4) by the virtual image generation system or by a different virtual image generation system having the audio capturing device (116, 122), the second metadata pertains to a positional or orientational characteristic detected by the virtual image generation system for the user; and presenting the spatialized audio (EFX-V1, EFX-V2, EFX-Vn), which has been rendered, and at least one virtual object (V2, V3, V4) representing the at least one selected object (Ra, Rb, R1, R2, V1, V2, V3, V4) in synchrony to the user (50, 54) based at least in part upon the first metadata and the second metadata.