A method of selecting an omnidirectional image for display to a user, the method comprising: - obtaining access to: - a number of omnidirectional images of a scene, wherein each omnidirectional image represents a different viewpoint relative to the scene; - for each of the images, metadata indicative of a physical relation comprising a relative position between the respective viewpoint and a physical object present in the scene; - obtaining viewer data which is indicative of a current physical relation between a viewpoint of the user and a physical object in an environment of the user, wherein the physical object in the environment is of a same type as the physical object present in the scene, the type of physical object being one of the group of a furniture object, a floor, a wall, and a fence, the obtaining viewer data comprising: - tracking the user in an environment to obtain tracking data indicative of a position of the user in the environment; - obtaining object data indicative of a position of the physical object in the environment; and - processing the tracking data and the object data to determine the current physical relation between the user and the physical object in the environment; - comparing the viewer data to the metadata to identify one of the number of omnidirectional images of which the physical relation best matches the current physical relation in accordance with a match criterion; and - selecting the one of the number of omnidirectional images for display. - obtaining access to: - a number of omnidirectional images of a scene, wherein each omnidirectional image represents a different viewpoint relative to the scene; - for each of the images, metadata indicative of a physical relation comprising a relative position between the respective viewpoint and a physical object present in the scene; - obtaining viewer data which is indicative of a current physical relation between a viewpoint of the user and a physical object in an environment of the user, wherein the physical object in the environment is of a same type as the physical object present in the scene, the type of physical object being one of the group of a furniture object, a floor, a wall, and a fence, the obtaining viewer data comprising: - tracking the user in an environment to obtain tracking data indicative of a position of the user in the environment; - obtaining object data indicative of a position of the physical object in the environment; and - processing the tracking data and the object data to determine the current physical relation between the user and the physical object in the environment; - a number of omnidirectional images of a scene, wherein each omnidirectional image represents a different viewpoint relative to the scene; - for each of the images, metadata indicative of a physical relation comprising a relative position between the respective viewpoint and a physical object present in the scene; - obtaining viewer data which is indicative of a current physical relation between a viewpoint of the user and a physical object in an environment of the user, wherein the physical object in the environment is of a same type as the physical object present in the scene, the type of physical object being one of the group of a furniture object, a floor, a wall, and a fence, the obtaining viewer data comprising: - tracking the user in an environment to obtain tracking data indicative of a position of the user in the environment; - obtaining object data indicative of a position of the physical object in the environment; and - processing the tracking data and the object data to determine the current physical relation between the user and the physical object in the environment; - comparing the viewer data to the metadata to identify one of the number of omnidirectional images of which the physical relation best matches the current physical relation in accordance with a match criterion; and - selecting the one of the number of omnidirectional images for display.