Patent ID: 9361731
Filing Date: 2016-06-07
CPC Classification: G06T

Claim Text:
1. A method of displaying a captured image onto a three-dimensional (3D) electronic map, the method comprising: determining a position of a virtual photographing apparatus within the 3D electronic map based on a position of a real photographing apparatus in a real world environment; determining nearest intersecting points in the 3D electronic map based on a plurality of virtual view angle vectors each of which originates from the virtual photographing apparatus and intersects with one of a plurality of polygons constituting the 3D electronic map at one of the nearest intersecting points, wherein the plurality of virtual view angle vectors are generated based on a view angle of the real photographing apparatus and the position of the virtual photographing apparatus in the 3D electronic map; selecting pixels that are within a range of coordinates of the nearest intersecting points by comparing 3D coordinates of the nearest intersecting points and 3D coordinates of a plurality of pixels constituting the plurality of polygons; converting 3D coordinates of the selected pixels to two-dimensional (2D) coordinates to display the selected pixels on a 2D display; superimposing an image captured by the real photographing apparatus on top of the selected pixels, using the converted 2D coordinates of the selected pixels; and outputting, in real-time, the 3D electronic map, including the superimposed image, on the 2D display, wherein the view angle indicates a full extent of a view which is observable by the real photographing apparatus irrespective of an object seen in the view, and the plurality of virtual view angle vectors are directed at edges of a view which is seen from the position of the virtual photographing apparatus according to the view angle.