Patent ID: 11956408
Assignee: CANON KABUSHIKI KAISHA
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 13:
14. A non-transitory computer readable storage medium storing a program for causing a computer to function as an information processing system comprising:
one or more memories storing instructions:
one or more processors executing the instructions to:
receive an input for specifying an image format from a plurality of image formats;
obtain viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint;
obtain a plurality of images based on image capturing by a plurality of imaging devices; and
generate a plurality of virtual viewpoint content according to the specified image format based on the plurality of obtained images and the obtained viewpoint information,
wherein, in a case where the specified image format is an image format that requires a plurality of virtual viewpoints, another virtual viewpoint based on the virtual viewpoint specified by the viewpoint information for the specific image format is complemented, and
a virtual viewpoint image corresponding to the specified virtual viewpoint and an image corresponding to the complemented other virtual viewpoint are generated based on the plurality of obtained images respectively,
the virtual viewpoint content is generated using the virtual viewpoint image corresponding to the specified virtual viewpoint and the image corresponding to the complemented other virtual viewpoint,

wherein in a case where a plurality of image formats is specified and any of the image formats is an image format that requires a plurality of virtual viewpoints,
wherein another virtual viewpoint based on the virtual viewpoint specified by the viewpoint information is generated, and a plurality of virtual viewpoint contents are complemented, each of the plurality of the virtual viewpoint contents corresponding to one of the plurality of image formats,
wherein the other virtual viewpoint is complemented by using an amount of movement and an amount of rotation specified according to the image format beforehand,
wherein the other virtual viewpoint is generated by using an LUT in which a plurality of positions in a three-dimensional space in which the plurality of imaging devices are to perform image capturing and the amount of movement and the amount of rotation which are specified according to the image format beforehand are associated with each other.