Image enhancement using a multi-dimensional model

A method and apparatus for enhancing an image capture of a geographic area is presented. The enhancement involves receiving an image and aligning a three dimensional model to the received image. A view of the three dimensional model defined by the outline of the received image may be determined. A point of interest in the determined view of the aligned three dimensional model may be identified. A transition may be triggered between the received image to information from the three dimensional model associated with the point of interest.

FIELD

The following disclosure relates to imaging systems and image display related applications, and more specifically to enhancement of two dimensional images using three dimensional models.

BACKGROUND

Mobile device users may attempt to capture an experience by acquiring two dimensional images of the user's experience. These two dimensional image captures may be acquired using a user's mobile device camera and may be stored digitally. To review the user's experiences, the user may view the two dimensional images. Other users may also view the images. However, the two dimensional viewing experience is limited to the two dimensional objects and information captured in the image.

SUMMARY

In an embodiment, a method involves receiving an image. A three dimensional model may then be aligned to the received image. A view of the three dimensional model may be determined as defined by the outline of the received image. A point of interest in the determined view of the aligned three dimensional model may be determined. The method may then involve transitioning from the received image to information from the three dimensional model associated with the point of interest.

In an embodiment, an apparatus may have a memory configured to store an image and a three dimensional model of a geographic area represented by the image. The apparatus may also have a controller configured to align the three dimensional model to the image, wherein the geographic area comprises a point of interest. The controller may also be configure to transition from the image to information associated with the point of interest in the three dimensional model.

In an embodiment, a non-transitory computer readable medium may contain instructions that when executed are operable to receive an image and display the image in an active view. Align the received image to a model. Identify a point of interest in the received image that correlates to a point of interest in the aligned three dimensional model, and transition the active view from a the received image to the point of interest.

DETAILED DESCRIPTION

A user may create a new image or retrieve an existing image. The image may have associated image registration data that indicates when the image was taken, where the image was taken, the direction the camera was facing, and a pose of the camera indicating a camera orientation.

An image may then be positioned or aligned in a multi-dimensional world model, such as is used in Nokia's NAVTEQ True™ product, using the image registration data. A system may use the image registration data to determine a point in the model correlating to the actual location where the camera was located, and the camera's orientation, when an image was taken, thus aligning the image to the multi-dimensional model. The image may then be enhanced using information from the aligned multi-dimensional model.

Information from the three dimensional model used to enhance or augment the image may include information relating to points of interest that are included in the three dimensional model. Information from the model may be presented either in the image associated with an area correlated to a point of interest, or within the model after a transition to the point of interest in the model. This information may include the name of the point of interest, background information, internet articles about the point of interest, a selection of an alternate view, or images of the point of interest. The system may then transition between the image and the point of interest.

Methods and systems are presented for enhancing images using multi-dimensional models. Specifically, embodiments are presented for enhancing captured images with information from models and transitioning from the image based on the model information. The transition may be to the information from the model, to a specific area of the image relating to the information from the model, or a combination of both.

At act420an image410is received. The image410may be a two dimensional digital representation of a geographic area. The image410may also have associated data that indicates the location of the device used to capture the representation. The associated data may also include data indicating the direction the device was facing, as well as the orientation of the device at the time the image was captured.

At act430the received image410is displayed. The received image410may be displayed using any viewing or display device, such as a monitor, view-screen, projector, or any other known device capable of displaying an image. The received image410may be displayed in a particular view or presentation using any device. The received image410may be displayed in an active view on the device.

An active view of the received image410may involve a prominent placement of the image in the display of the display device, such as in the center of the viewable area of a display device. An active view of the received image410may also involve a presentation of the received image410that focuses the attention of a viewer on the received image410. An active view of the received image may additionally involve a full view of the entirety of the received image410. Further, an active view of the received image410can also include any accent or presentation that distinguishes the received image410from other images that may also be displayed on the display device.

At act440the received image410is aligned to a model415. The received image410may be aligned to the model415manually or automatically. The received image410may be aligned to the model415using the associated data indicating the location, forward facing direction, or orientation of the device used to capture the received image410. The received image410may also be aligned to the model415by correlating objects or reference points in the received image410and the model415.

The model415may be a three dimensional model. The model may also represent a geographic area. The geographic area may be a rural town, forest, pasture, city, or any other type of geographic area. The model may also be correlated to the actual geographic coordinates of the geographic area represented in the model. The model may contain wire-form models having corner points and forming polygons representing the features and objects in the geographic area. The wire-form models may have images of the geographic area covering the viewable surface of the wire-form models. These images may be aligned to cause the wire-form model to resemble the appearance of the geographic area the model represents. A user may be able to navigate through the model in such a way that mimics real life movement through the geographic area. The model may be manipulated to present multiple orientations or views of the model.

The aligning of act440and the image display of act430may be performed in any order or at the same time.

In act450a point of interest in the received image410is identified. The point of interest may correlate to the point of interest as represented in the aligned model415, and the identification of the point of interest in the received image410may be based on the correlation. A correlation may be determined by matching geometry between the received image410and the aligned model415. The point of interest may also be identified as existing in a view in the model415that matches the view of the received image410. The view in the model415may be a view of an area of the model representing the geographic area captured by the received image410. The view in the model415may also be bounded by a perimeter defined by the edges of the received image410.

In act460a transition is made from the received image410to a point of interest. The transitioned active view may be of the point of interest as represented in the model415or of a particular area in the received image410identified as containing the point of interest.

A transition may replace the image that is currently in an active view with a different image or view. This replacement may involve placing a different image into a position on the display that is currently occupied by the current active view image. A transition may also involve motion animations or effects to indicate the transition. A transition may involve replacing the active view of a received image410with a view of the model415that mimics the view of the received image410. In an embodiment, a transition to the model415may also involve an isolated view of a point of an identified point of interest. In such an embodiment, the isolated view of the point of interest may be from a pre-chosen vantage point within the model415. The embodiment may also present an isolated view of the point of interest in an orientation that is similar to the orientation of the point of interest represented in the received image410. In another embodiment, the transition is to an isolated view of the area of the received image410that represents the identified point of interest. An isolated view of a point of interest may involve blurring all other contents of the image, enlarging the isolated view area to the extents of the original active view image, or highlighting the point of interest in another way such as an illuminated outline or different coloring or lighting effects.

FIG. 2illustrates an exemplary networked model and mapping system120for image enhancement. The mapping system120includes a map developer system121, a mobile device122, and a network127. Additional, different, or fewer components may be provided. For example, many mobile devices122may connect with the network127.

The developer system121includes a server125and a database123. The developer system121may include computer systems and networks of a system operator such as NAVTEQ or Nokia Corporation. The geographic database123may be partially or completely stored in the mobile device122.

The developer system121and the mobile device122are coupled with the network127. The phrase “coupled with” is defined to mean directly connected to or indirectly connected through one or more intermediate components. Such intermediate components may include hardware and/or software-based components.

The database123includes geographic data used for mapping and navigation-related applications. The geographic data may include data representing a road network including road segment data and node data. The road segment data represent roads, and the node data represent the ends or intersections of the roads. The road segment data and the node data indicate the location of the roads and intersections as well as various attributes of the roads and intersections. Other formats than road segments and nodes may be used for the geographic data. The geographic data may be correlated to a three dimensional model representing a geographic area. The database123may also include, or be coupled with, the three dimensional model, as well as points of interest and the geographic locations of points of interest. These points of interest may be correlated to the three dimensional model using the geographic data. Examples of points of interest include gas stations, restaurants, lodging, entertainment and educational opportunities (such as amusement parks, water parks, movie theaters, night spots, museums, and libraries), and historical or other types of landmarks.

The mobile device122includes one or more detectors or sensors as a positioning system built or embedded into or within the interior of the mobile device122. Alternatively, the mobile device122uses communications signals for position determination. The mobile device122receives location data from the positioning system. The server125may receive sensor data configured to describe a position of a mobile device, or a controller of the mobile device122may receive the sensor data from the positioning system of the mobile device122.

The mobile device122may communicate location information via the network127to the server125. The location information may also be associated with data captured at the location, such as a digital image. The digital image with associated location information may then be communicated to the server125via the network127. The mobile device122may also communicate with the server125to transfer three dimensional model data between the mobile device122and the server125.

The computing resources for receiving, aligning, displaying, identifying, and transitioning may be divided between the server125and the mobile device122. In some embodiments, the server125performs a majority of the processing. In other embodiments, the mobile device122performs a majority of the processing. In addition, the processing is divided substantially evenly between the server125and the mobile device122.

FIG. 3illustrates an exemplary mobile device122for image enhancement. The mobile device122includes a controller200, a memory204, an input device203, a communication interface205, position circuitry207, an image capture device206, and an output interface211. The output interface211may present visual or non-visual information such as audio information. Additional, different, or fewer components are possible for the mobile device122. The mobile device122is a smart phone, a mobile phone, a personal digital assistant (PDA), a tablet computer, a notebook computer, a personal navigation device (PND), a portable navigation device, a camera, and/or any other known or later developed mobile device. The positioning circuitry207, which is an example of a positioning system, is configured to determine a geographic position of the mobile device122.

The positioning circuitry207may include suitable sensing devices that measure the traveling distance, speed, direction, orientation, and so on, of the mobile device122. The positioning system may also include a receiver and correlation chip to obtain a GPS signal. Alternatively or additionally, the one or more detectors or sensors may include accelerometers, gyroscopes, and/or magnetic sensors built or embedded into or within the interior of the mobile device122. The accelerometer is operable to detect, recognize, or measure the rate of change of translational and/or rotational movement of the mobile device122. The gyroscope is configured to generate data indicative of an angle of orientation of the mobile device122, with regards to a reference plane or horizon reference. The angle of orientation may be considered a multi-axis tilt measurement. The magnetic sensor, or a compass, is configured to generate data indicative of a heading, or cardinal direction bearing, of the mobile device122. Data from the accelerometer, the gyroscope, and the magnetic sensor may indicate orientation of the mobile device122. The mobile device122receives location data from the positioning system. The location data indicates the location of the mobile device122.

The positioning circuitry207may include a Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), or a cellular or similar position sensor for providing location data. The positioning system may utilize GPS-type technology, a dead reckoning-type system, cellular location, or combinations of these or other systems. The positioning circuitry207may include suitable sensing devices that measure the traveling distance, speed, direction, and so on, of the mobile device122. The positioning system may also include a receiver and correlation chip to obtain a GPS signal. The mobile device122receives location data from the positioning system. The location data indicates the location of the mobile device122.

Location data may have spatial and temporal elements. For example, the controller200may associate a specific time that a position of mobile device122was determined using the position circuitry207. This specific time may be associated with the determined position and saved as location data in memory204, or transmitted to server120. Location data with a temporal element may be considered time stamped.

The input device203may be one or more buttons, keypad, keyboard, mouse, stylist pen, trackball, rocker switch, touch pad, voice recognition circuit, or other device or component for inputting data to the mobile device122. The input device203and the output interface211may be combined as a touch screen, which may be capacitive or resistive. The output interface211may be a liquid crystal display (LCD) panel, light emitting diode (LED) screen, thin film transistor screen, or another type of display. The output interface211may also include audio capabilities, or speakers.

The controller200may include a general processor, digital signal processor, an application specific integrated circuit (ASIC), field programmable gate array (FPGA), analog circuit, digital circuit, combinations thereof, or other now known or later developed processor. The controller200and may be a single device or combinations of devices, such as associated with a network, distributed processing, or cloud computing.

The memory204may be a volatile memory or a non-volatile memory. The memory204may include one or more of a read only memory (ROM), random access memory (RAM), a flash memory, an electronic erasable program read only memory (EEPROM), or other type of memory. The memory204and may be removable from the mobile device100, such as a secure digital (SD) memory card.

The communication interface205may include any operable connection. An operable connection may be one in which signals, physical communications, and/or logical communications may be sent and/or received. An operable connection may include a physical interface, an electrical interface, and/or a data interface. The communication interface205and/or communication interface305provides for wireless and/or wired communications in any now known or later developed format.

In an embodiment, the memory204is configured to store an image and a three dimensional model of a geographic area represented by the image. The controller200is configured to align the three dimensional model to the image. The geographic area may contain a point of interest that would be indicated by data stored with the three dimensional model stored in the memory204. The controller200is also configured to transition from the received image to information stored on the memory204that is associated with the point of interest in the three dimensional model. The information associated with the point of interest may also be stored in the memory204as a part of the three dimensional model.

In an embodiment, the communication interface205may be configured to download an entire three dimensional model, or just a portion of the three dimensional model corresponding to the geographic area captured by the image. The communication interface205may also be configured to download the image, upload the image, or download an aligned image and three dimensional model.

In an embodiment, the transition is automatic or triggered after the passage of an amount of time. In another embodiment, there may be multiple points of interest in the geographic area represented by the image. The controller200may then be configured to transition between the multiple points of interest. The order in which the controller200transitions between the multiple points of interest may be random, based on a pre-assigned hierarchy, or determined based on information stored in memory204regarding a user's interests or background. For example, if data is stored in memory204indicating that a user is a baseball fan, and the geographic area represented by the image includes Wrigley Field in Chicago, Ill., then the controller may assign Wrigley Field a higher priority, and be transitioned to sooner, than a restaurant that may also exist as a point of interest in the same geographic area represented by the image. The controller200may also assign a basic set of priorities based on point of interest categories or point of interest characteristics, where categories and/or characteristics are associated with different priority or hierarchy levels. A user may also be prompted to select a particular point of interest from a list of multiple points of interest to trigger a transition to that point of interest.

In an embodiment, an area of the image may correlate to a point of interest in the geographic area captured by the image. The controller200may be configured to modify the image to include an area of interest the correlates to the point of interest. The controller200may be further configured to transition to an area of interest when the area of interest in the image is selected. The transition to the area of interest may also occur automatically after a period of time. An embodiment can also include multiple points of interest in the geographic area represented by the image, and multiple correlated areas of interest in the image.

In an embodiment, the mobile device122also includes an image capture device206. The image capture device206may be any device operable to record or create durable images by recording light or other electromagnetic radiation. The image capture device206may function chemically by means of light-sensitive material such as photographic film, electronically by using an image sensor, or by any other available mechanism for capturing a physical view of objects and the environment the objects are in. The image capture device may be a camera.

In an embodiment, the image capture device206captures an image, the controller200saves the image digitally with associated image registration information or data, determined from the position circuitry207, in the memory204. The image may also be displayed on the output device211, and communicated to other mobile devices122, the network125, or any other device to be stored or displayed, using the communication interface205.

FIG. 4illustrates an exemplary server125for image enhancement. The server125includes a processor300, a communication interface305, and a memory301. The server125may be coupled to a database123and a workstation310. The database123may be a geographic database. The workstation310may be used as an input device for the server125. In addition, the communication interface305is an input device for the server125. The communication interface305receives data indicative of inputs made via the mobile device122.

The processor300may include a general processor, digital signal processor, an application specific integrated circuit (ASIC), field programmable gate array (FPGA), analog circuit, digital circuit, combinations thereof, or other now known or later developed processor. The processor300may be a single device or combinations of devices, such as associated with a network, distributed processing, or cloud computing.

The memory301may be a volatile memory or a non-volatile memory. The memory301may include one or more of a read only memory (ROM), random access memory (RAM), a flash memory, an electronic erasable program read only memory (EEPROM), or other type of memory. The memory301may be removable from the mobile device100, such as a secure digital (SD) memory card.

The communication interface305may include any operable connection. An operable connection may be one in which signals, physical communications, and/or logical communications may be sent and/or received. An operable connection may include a physical interface, an electrical interface, and/or a data interface. The communication interface305provides for wireless and/or wired communications in any now known or later developed format.

In an embodiment, the memory301is configured to store an image, and a model that represents a geographic area captured by an image. This geographic area may include an area of interest, or multiple areas of interest, for a user. The model may be configured to include models and designations of areas of interest within the model. The processor300may be configured to align the image to the model. The processor300may also be configured to transition from the stored image to information associated with the point of interest in the model. The information may include historical or current information regarding the point of interest. The information may also include pictures or images of the point of interest, as well as a detailed model of the point of interest.

The communication interface305is configured to receive an image that captures a view of a geographic area. The communication interface305may also be configured to communicate a model of a geographic area to a mobile device122. The communication interface305may also be configured to communicate an image aligned with a model to a mobile device, along with any information associated with the model.

The workstation310may contain a display to display the image and/or a model aligned to the image.

In an embodiment, the model is supplemented by the geographic database123to associate points of interest from the geographic database123with specific locations of the model. The geographic database123and the model may be aligned using a common coordinate system. This coordinate system may also be aligned with a corresponding real-world geographic coordinate system.

FIG. 5illustrates an example flowchart for image enhancement. As presented in the following sections, the term controller may refer to either controller200or processor300and the following acts may be performed by mobile device122, server125, or a combination thereof. Additional, different, or fewer acts may be provided. Mobile data may refer to, image data, location information sent from a mobile unit, other location based data, or other data sent from a mobile unit. The acts are performed in the order shown or other orders. The acts may also be repeated.

At act520an image510is received. The image510may include a captured view of a geographic area. The image510may also include associated information or image registration data.

Image associated information or registration data may include geographic data indicating the location of the device that captured the image510, when the image was captured. As such, this capture location may be indicated through geographical identification metadata, or geotagging data, associated with the image510. This geotagging data may be in any form. For example, the capture location may be represented as GPS coordinates, or in other formats indicating a latitudinal and longitudinal location. Image associated information may also include information recorded at the time the image510was captured, such as angle of tilt of the image capturing device, direction the image capturing device was facing, zoom level of the image capturing device, time and date of capture, or any other information recordable at the time the image was captured.

The image510may be received from a camera, or other image generating device. The image510may also be received from a network, or other device.

At act530the image510is aligned to a three dimensional model515. The three dimensional model515may include any representation of a three dimensional surface of an object or a geographic area. The three dimensional model515may be oriented to provide two dimensional views of the model. These views may resemble actual images of the object or geographic area. These views may also use actual images of the geographic area the model represents to cover the surfaces of the three dimensional model. Using actual images of geographic features and geographical area can create a very realistic three dimensional model. The three dimensional model515may be a solid model, or a shell model. The three dimensional model515may be created using polygonal modeling, curve modeling, digital sculpting, or any other method of creating a three dimensional model. The three dimensional model515may also represent points of interest in the geographical areas that are represented by the three dimensional model515.

The image510and the three dimensional model515may be aligned using any known method. In one embodiment, image associated information is used for alignment. The image associated information may allow for the identification of a point in the three dimensional model that represents the location that the image capture device that captured image510was located, when image510was captured. The image associated information also may include information indicating what direction the capture device was facing, and at what angle relative to the horizon the capture device was tilted. This information may be used to mimic the precise pose of the capture device.

At act540a view of the three dimensional model is determined and defined by the outline of the received image. The capture pose may be used to determine a two dimensional view in the three dimensional model515that mimics the view portrayed in the image510. The boundary of the two dimensional view may be determined using a zoom level recorded in image associated information. The boundary may also be determined by matching pixels or coordinates between the three dimensional model's515two dimensional view and the image510. The boundary may also be determined using a measurement of objects in the image510compared to the three dimensional model515to determine a perspective or distance from the objects in the image510.

At act550points of interest are identified. The points of interest may be identified as existing in the two dimensional view of the three dimensional model515. The existence of a point of interest in the two dimensional view may implicate the existence of the point of interest in the image510.

In an embodiment, an area of interest in the image510may be correlated to the point of interest. The image510may be modified to include the area of interest either temporarily or permanently. The area of interest may correspond to an outline of the point of interest represented in the image, or may be an area determined to surround the point of interest. An area of interest may be set off or distinguishable from the other areas of the image510. For example, the area of interest may be bounded by a visual border, such as a colored line, that borders the area of interest. Other methods of distinguishing the area of interest may also be used, such as different lighting, resolution, color effects, or any other effect that may distinguish the area of interest.

Multiple points of interest may also be identified as existing in the two dimensional view of the three dimensional model515. Also, a user may select categories of points of interest to be identified. For example, a user may indicate that only points of interest with historical or cultural significance be selected. The categories of points of interest identified may also be limited based on associated interests of a user. For example, if a user is associated with an interest area, such as art, categories including statues and architectural significance may be identified.

At act560a transition occurs between the image510and the point of interest identified in act550. The transition may automatically occur after a period of time. The transition may also be triggered by something else, such as selecting a point of interest from a list, or selecting an area of interest in the image510that correlates or aligns with the point of interest.

The transition may be to information from the three dimensional model515associated with the point of interest. This information may include images of or relating to the point of interest. The images may be images derived from the three dimensional model from one or various views or perspectives. Such a view may be determined using image information from the image510. Information from the three dimensional model may also include audio or video information, such as a voice recording or rendition relaying information, or a video of an important event related to a point of interest515.

Image information including date and time may also be correlated to seasonal or daylight characteristic data to indicate how or what images derived from the three dimensional model515may be transitioned to. For example, if the image information indicates that the image510was captured during the winter, the information from the three dimensional model515may be a view of the point of interest, presented with snow covering all or parts of the point of interest. Similarly, if the image data indicates that the image515was captured at night, the point of interest may be presented with appropriate night lighting characteristics. Also, if the information from the three dimensional model involves alternate image captures of the point of interest, an alternate capture may be chosen to appropriately match the time and date data. Other information such as hours of operation, or significant events as they relate to the date or time of the image510capture, may also be correlated and transitioned to using the image information.

Images from the three dimensional model may also include other images of the point of interest, originating external from the three dimensional model515, but associated with locations identified with the point of interest in the three dimensional model515. The information may also include information about the three dimensional model such as a name of the point of interest, hours of operation of the point of interest, background information relating to the point of interest, or any other information relating to the point of interest. For example, if a point of interest is determined to be a restaurant, the hours of operation, menu items, or user reviews may be presented as information associated with the point of interest.

The information relating to a point of interest transitioned to may be the point of interest as represented in the three dimensional model515. The point of interest transitioned to may also be a particular view of the three dimensional model515, represented as a two dimensional image derived from the three dimensional model515. The point of interest in the three dimensional model515may also be presented from a pre-selected viewpoint of the point of interest. The point of interest may also be presented as an animation involving the point of interest as displayed in the three dimensional model515. The point of interest transitioned to may also be the area of interest of the image510. The area of interest may be augmented with information from the three dimensional model515related to the point of interest, before, during, or after the transition.

The transition may involve moving the point of interest to the center of the display device, from the position of the point of interest in the image510. The image may also involve enlarging the point of interest but maintaining an anchored center point in the image510. The transition may also involve filling the extents of the viewable display area with the point of interest.

The transition may involve motion or animation effects to signify the transition. These effects may include blurring to give the impression of motion, sliding a window of the display to a focal point, enlarging an area of interest, or any other transition effect.

The transition may involve transitioning back to a full or manipulated view of the image510after transitioning to the point of interest. This transition may occur automatically after a period of time, or may be triggered by a user.

When multiple points of interest are identified in image510, transitions may occur between the multiple points of interest. The transitions may involve transitioning back to the original image between transitions to points of interest, or transitioning directly between the multiple points of interest.

The order of transitioning between multiple points of interest may be random, determined by a user selection, or based on a point of interest hierarchy or ranking. The hierarchy may be determined using any method. The hierarchy may be determined using selected preferences of a user or determined tastes of a user. The hierarchy may also be determined based on a defined model hierarchy. A model hierarchy may be predefined to promote certain categories of points of interest, such as restaurants, landmarks, tourist interest areas, or any applicable category.

FIG. 6is an image representing a view of a three dimensional model600of a geographic area. The three dimensional model600has been partially deconstructed in this view to display the elements and assembly of the three dimensional model600. The three dimensional model600is composed of wire-form models610of buildings, structures, and other objects included in the geographic area. The wire-form models610include polygon structures630and corner points640. The polygon structures630may be fitted with masks620of the real world structure the polygon structures630represent. The masks620may be actual image captures of the represented structure, computer generated texture maps, or other surface covering image effects.

The three dimensional model600may be rotated, translated, and otherwise manipulated to mimic almost any real world view of the geographic area represented, from any perspective or vantage point. The masks620may be fitted to all sides of the polygon structures630such that as the three dimensional model600is rotated, translated, or otherwise manipulated, the masks620maintain full visible coverage of the polygon structures630. The masks620therefore enable the three dimensional model600to be oriented in any perspective to mimic specific views based on captured images of a geographic area. Two dimensional images of the three dimensional model600can be generated from the mimicked views. Portions of the three dimensional model600may also be partitioned to allow isolated viewing of specific buildings or points of interest, without the visual impediment provided by adjacent or proximate polygon structures630or other model portions.

FIG. 7is an enhanced captured image700. Image700has been aligned to a three dimensional model and points of interest730have been identified. The image700has been modified to include areas of interest720correlated to the points of interest730. Areas of interest720have been highlighted using lines to define the perimeter740of the area of interest.

FIG. 8illustrates images and points of interests displayed within the viewable area810of a display device before and after transitions to points of interest. Image700is centered in the viewable area810. After a transition820, information related to the identified point of interest is displayed more prominently in the viewable area810. The point of interest may be displayed in any fashion so as to distinguish the point of interest from the image700. Also, the image700may be displayed differently after a transition820to differentiate the image from the point of interest. For example, the image700may be presented out of focus, blurred, or with dimmer lighting effects after a transition820. Transitions820may also occur between multiple points of interest.

In an embodiment, after a transition820A, information relating to a point of interest is displayed as an area of interest720in the center of the viewable area810, enlarged so as to bring focus to the area of interest720, and obstruct a significant portion of an image700. The image700may be blurred, or otherwise also distinguished from the area of interest720.

In an embodiment, after a transition820B, an area of interest720is shown centered over the center of the original position of the area of interest in image700. The area of interest720is enlarged so as to show more detail of the area represented, to distinguish the area of interest720from the image700, and to shift the visual focus of a user to the area of interest720.

In an embodiment, after a transition820C, the area of interest720is displayed enlarged so as to fill the majority of the viewable area810. Included in the display of the area of interest720is information760from the three dimensional model relating to the correlated point of interest. The information may be any information relating to the correlated or identified point of interest. For example, the information may include historical information indicating important dates in the history of the point of interest, as well as practical information relating to tour schedules and costs for the point of interest.

The information760may also relate to other points of interest associated with the point of interest correlated with the area of interest720. The other points of interest may be presented as a list, or group of images, that may be selected by a user. This user selection may trigger a transition to the selected point of interest. The information760may also include different images and perspectives from the three dimensional model that relate to the correlated point of interest. A user may also select these images or perspectives to trigger a transition. In an embodiment, a user may select an option to transition to the three dimensional model, in an environment that may allow translational and rotational manipulation of the three dimensional model, or specifically the representation of the point of interest in the three dimensional model.

Transitions820between presentations of images700and points of interest may be performed using any transition method. For example, the area of interest720may appear to grow during a transition820A, grow and move during a transition820B, appear suddenly in a different form, window, or size during a transition820C. The translation may have an associated sound that signifies the transition. Any other form of transition including animations or other effects may be used.

FIG. 9illustrates images and points of interests displayed within the viewable area810of a display device before and after transitions920to points of interest. The information associated with the point of interest presented may include an alternate image capture930A of the point of interest, textual or other information930B relating to the point of interest, or a two dimensional view930C of three dimensional model of the point of interest. The information relating to the point of interest may also be any other information, such as a transition920to an animation of the point of interest created from the three dimensional model of the point of interest.

In an embodiment, after transition920A, and alternate image capture930A is displayed prominently in the viewing area810. The alternate image capture930A may be a capture associated with a time of year, such as winter, that may be indicated by the image information associated with an image700.

In an embodiment, after transition920, textual information930B relating to the point of interest may be presented prominently in the viewing area810. The textual information930B may present historical or current facts relating to the point of interest.

In an embodiment, after transition920C, a two dimensional view930C of three dimensional model of the point of interest may be presented prominently within the viewable area810. The two dimensional view930C may be taken from any orientation, and may be taken from an orientation similar to the view presented of the point of interest in the image700. The two dimensional view930C may also be presented with various lighting effects. For example, information associated with the image700may indicate that the image was captured at night, and the lighting effects may then allow the two dimensional view930C to represent a night-time image.