Abstract:
Embodiments of the present invention provide improved systems and methods for providing a virtual terrain display. In one embodiment, a method comprises identifying a location within an enclosure. The location is referenced against an external environment containing the enclosure. The method also comprises identifying a portion of a structure of the enclosure. The portion of the structure exists between the location and the external environment and blocks a view of the external environment. The method also comprises generating a display depicting a view of the external environment from the location; and applying a translucent structure representation to the display. The structure representation is a visual depiction of the portion of the structure and appearing in front of the depicted view without blocking the depicted view of the external environment.

Description:
BACKGROUND 
       [0001]    Aircraft cabins commonly include virtual displays to show passengers the view from the side or front windows of the aircraft. One way to display these views includes showing as much of the outside environment of the aircraft as can fit on a display screen. Alternatively, a display can provide a virtual window that is overlaid onto the image of the external environment, the virtual window framing the view to match the view through the real windows of the aircraft. However, when the display screen shows as much of the external environment as can fit on the display screen, the display lacks visual cues that aid users when looking for specific landmarks through a real window. While the virtual window provides visual cues to a user, the virtual window also conceals information behind the virtual frame, potentially hiding desired points of interest from the view of a passenger. 
       SUMMARY 
       [0002]    The Embodiments of the present invention provide systems and methods for a virtual terrain display and will be understood by reading and studying the following specification. 
         [0003]    Embodiments of the present invention provide improved systems and methods for providing a virtual terrain display. In one embodiment, a method comprises identifying a location within an enclosure. The location is referenced against an external environment containing the enclosure. The method also includes identifying a portion of a structure of the enclosure. The portion of the structure exists between the location and the external environment and blocks a view of the external environment. The method also includes generating a display depicting a view of the external environment from the location; and applying a translucent structure representation to the display. The structure representation is a visual depiction of the portion of the structure and appears in front of the depicted view without blocking the depicted view of the external environment. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0004]    Understanding that the drawings depict only exemplary embodiments and are not therefore to be considered limiting in scope, the exemplary embodiments will be described with additional specificity and detail through the use of the accompanying drawings, in which: 
           [0005]      FIG. 1  is a block diagram of one embodiment of a system for displaying a virtual terrain within an enclosure. 
           [0006]      FIG. 2  is an illustration of a display on a display device according to one embodiment. 
           [0007]      FIG. 3  is an illustration of a display on a display device with a variably translucent structure representation according to one embodiment. 
           [0008]      FIG. 4  illustrates multiple displays according to one embodiment. 
           [0009]      FIG. 5  illustrates a display showing multiple references features according to one embodiment. 
           [0010]      FIG. 6  illustrates a display from the inside of a building according to one embodiment. 
           [0011]      FIG. 7  is a flow chart diagram describing the application of a structure representation to a display according to one embodiment. 
       
    
    
       [0012]    In accordance with common practice, the various described features are not drawn to scale but are drawn to emphasize specific features relevant to the exemplary embodiments. 
       DETAILED DESCRIPTION 
       [0013]    In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which is shown by way of illustration specific illustrative embodiments. However, it is to be understood that other embodiments may be utilized and that logical, mechanical, and electrical changes may be made. Furthermore, the method presented in the drawing figures and the specification is not to be construed as limiting the order in which the individual acts may be performed. The following detailed description is, therefore, not to be taken in a limiting sense. 
         [0014]      FIG. 1  is a block diagram of one embodiment for a system  100  for displaying a virtual terrain within an enclosure. The term “enclosure,” as used herein, refers to an enclosed space within an environment where the structure of the enclosure blocks the view from within the enclosure. For example, an enclosure is an aircraft cabin, a building, a car, a spacecraft, a boat and the like. The term structure as used herein refers to an object that is part of the enclosure or an object that is outside the enclosure. For example, a structure includes a wall of the enclosure, a wing, an engine nacelle, a building, a tower, a cloud, moving vehicles, and the like. A structure blocks the view if it prevents a person inside the enclosure from viewing the external environment. The external environment is the environment that contains the enclosure that is outside of the enclosure. System  100  includes a location device  102  for determining the location of the enclosure in relation to an external environment that contains the enclosure. For example, location device  102  determines the location of an airplane in relation to the Earth. In some implementations, location device  102  determines the position, attitude, and heading of the enclosure. For example, location device  102  includes a navigation unit like a GPS, an Inertial Measurement Unit, and the like. When location device  102  determines the location of the enclosure within the external environment, system  100  processes the location information on a processing unit  104  and uses data stored in a memory  108  to display a virtual view of the environment on a display device  106 . 
         [0015]    Processing Unit  104  includes at least one electronic device that accepts data and performs mathematical and logical operations. Processing unit  114  includes or functions with software programs, firmware, or other computer readable instructions for carrying out various methods, process tasks, calculations, and control functions used in implementing the functionality described below. These instructions are typically stored on any appropriate computer or machine readable medium used for storage of computer readable instructions or data structures, such as memory  108 . 
         [0016]    Memory  108  includes at least one device that can hold data in a machine readable medium. The computer readable medium is accessed by a general purpose or special purpose computer or processor, or other programmable logic device. Suitable computer or processor readable media includes storage/memory media such as magnetic or optical media. For example, storage/memory media includes conventional hard disks, Compact Disk—Read Only Memory (CD-ROM), volatile or non-volatile media such as Random Access Memory (RAM) (including, but not limited to, Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate (DDR) RAM, RAMBUS Dynamic RAM (RDRAM), Static RAM (SRAM), etc.), Read Only Memory (ROM), Electrically Erasable Programmable ROM (EEPROM), and flash memory, etc. Suitable processor-readable media also includes transmission media such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network and/or a wireless link. The computer-readable medium together with instructions embodied thereon comprise a program product. 
         [0017]    Memory  108  stores a terrain database  110 . The phrase “terrain database,” as used herein, refers to a database that stores information describing the terrain through which an enclosure is traveling. For example, terrain database  110  stores information that describes the terrain of the Earth. In one implementation, terrain database  110  includes satellite imagery of the world. Alternatively, terrain database  110  includes a digital representation of the Earth&#39;s terrain like a digital elevation model, a digital terrain model, a vertical obstruction database, and the like. Further, terrain database  110  stores descriptive information that identifies and describes features that are recognizable when the terrain represented by the terrain database is shown on display device  106 . Descriptive information describes landmarks, points of interest, geographical features, and the like. For example, descriptive information describes the location of mountains, historical sites, rivers, canyons, cities, political borders, roads, and the like. Also, terrain database  110  can include a weather database that stored weather information associated with a particular terrain. Terrain database  110  can reside on memory  108  stored in the enclosure or on a memory located away from the enclosure. When terrain database  110  is stored in a memory away from the enclosure, processing unit  104  acquires the information stored in terrain database  110  by communicating through a wireless network or other form of communication. 
         [0018]    In some implementations, memory  108  stores terrain display instructions  114 . The phrase “terrain display instructions,” as used herein, refers to computer instructions that direct processing unit  104  to access terrain database  110  and create displayable information representing the view of the external environment based on the location of the enclosure received from location device  102 . For example, when the enclosure is an aircraft, the location received from location device  102  includes altitude, position, heading, and attitude. Alternatively, processing unit  104  receives location information from other vehicles. For instance, when the enclosure is part of an aircraft equipped with ADS-B, the aircraft can receive location information from other nearby aircraft. Processing unit  104  uses the altitude, position, heading, and attitude to produce displayable information representing the view of the Earth&#39;s terrain from the aircraft. The phrase “displayable information”, as used herein, refers to machine readable information that directs a display device to render a recognizable image. Processing unit  104  transmits the displayable information to display device  106 . Upon reception of the displayable information, display device  106  displays an image to a viewer based on the displayable information. For example, when processing unit  104  transmits information to display device  106  associated with the external environment of the enclosure, display device  106  renders the displayable information as a virtual view of the external environment from the location of the enclosure. In some implementations, display device  106  renders the displayable information as a three dimensional view of the external environment. Alternatively, display device  106  renders the displayable information as a two dimensional view of the external environment. 
         [0019]    In a further implementation, memory  108  stores overlay instructions  112 . The phrase “overlay instructions”, as used herein, refers to computer instructions stored in memory  108  that direct processing unit  104  to alter the displayable information associated with a view of the external environment by including overlay information in the displayable information. Display device  106  renders the overlay information as a virtual representation of a portion of the enclosure structure overlaid on the virtual view of the external environment. For example, when the enclosure is an airplane, overlay instructions  112  direct processing unit  104  to alter the displayable information to include overlay information representing a structure of the airplane, such as cabin walls, the bulkhead, and the like. When display device  106  renders the displayable information, a virtual representation of the airplane structure appears to lie in front of the virtual view of the terrain. Further, overlay instructions  112  instructs processing unit  104  to identify portions of the structure that obstruct the view of the external environment from within the enclosure, and then virtually represent the identified portion of the structure in the displayable information. For example, when the virtual view of the terrain depicted on display device  106  represents the view through the right side of an airplane, overlay instructions  112  causes processing unit  104  to overlay the virtual view of the terrain with a virtual representation of the right side of the airplane. 
         [0020]    In a further embodiment, when overlay instructions  112  instructs processing unit  104  to augment the displayable information with overlay information, the overlay information represents a translucent depiction of the enclosure structure. The term “translucent,” as used herein, refers to a depiction that allows details of other images to be seen through the depiction. When the overlay information representing the translucent depiction is displayed on display device  106 , display device  106  depicts the represented structure such that a viewer can recognize the virtual view of the external environment through the overlaid translucent structure. For example, on an aircraft, overlay instructions  112  instruct processing unit  104  to overlay a translucent representation of a cabin wall over the virtual view of the external environment. When the representation that includes the translucent cabin walls overlaid on the representation of the external environment is transmitted to display device  106 , a passenger could look through a window in the cabin wall while knowing where to look for points of interest shown in the representation of the external environment. By overlaying the external environment with a translucent representation of the structure of the enclosure, a passenger can use depicted images as a guide to identify points of interest when looking at the actual external environment after viewing the virtual depiction of the external environment on display device  106 . 
         [0021]    Display device  106  receives displayable data from processing unit  104 . Display device  106  is any device capable of rendering a visual display. For example, display device  106  is at least one of a projector, a television screen, a monitor, a flexible display, a personal electronic device and the like. Further, display device  106  includes a single display or multiple displays. For instance, in an airplane, display device  106  provides a single display at the bulkhead of the cabin for viewing by all of the passengers in the airplane. The single display provides a single constant view from a predetermined location of the aircraft or the single display periodically changes the depicted view to represent the view from different locations from within the enclosure. 
         [0022]    In an alternative implementation, display device  106  includes multiple displays. For instance, display device  106  provides individual displays for each passenger in the airplane by providing images on screens mounted on the back of each seat in a cabin. In a further implementation, display device  106  includes two displays representing different sides of an enclosure. Alternatively, display device  106  provides a wireless local area network whereupon personal electronic devices connect to the network to access the displayable information. In at least one embodiment, display device  106  includes a flexible display attached to the walls of the airplane. The flexible display depicts a virtual view of the external environment as if the structure of the enclosure did not separate the viewer from the external environment. Display device  106  provides a display such that the viewers of the display within the enclosure can relate the position and orientation of a view from a particular location to features contained in the external environment. 
         [0023]    System  100  also includes a user interface  116 . User interface  116  allows a user to interface with processing unit  104  to control what is displayed on display  106 . For example, user interface  116  allows a user to select a view from a particular location in the enclosure along with the accompanying translucent overlay representing the structure of the enclosure at the particular location. For example, a passenger sitting in the back of an airplane may desire to see the view from the seats in the front of the airplane. User interface  116  allows the passenger to switch views from the back of the airplane to the front of the airplane, thus allowing the passenger to see the view from different locations from the enclosure. Further, when a user desires the optimal view of a point of interest in the virtual depiction of the external environment, a user can enter the desired point of interest on user interface  116  and display  106  directs the user to the location in the enclosure that will provide the best view of the point of interest. In another implementation, user interface  116  provides the option of viewing weather patterns in various degrees of translucency to aid a user in finding the location of a point of interest when weather interferes with the view from within the enclosure. 
         [0024]    In certain embodiments, system  100  is a mobile device such as a tablet computer, a cellular phone, and the like. Further, user interface  116  interacts with the user via the user interface of the mobile device. For example, when the mobile device is a tablet computer, user interface  116  interacts with the user via a touchscreen, a keyboard, a mouse, a microphone, and the like. Also, in some embodiments, the mobile device contains an internal location unit  102 . For example, the mobile device includes an internal GPS and attitude sensor, where the attitude sensor includes at least one gyroscope and at least one accelerometer. Internal location unit  102  enables the device to display a view of an external environment that corresponds to the position of the mobile device. In some embodiments, the mobile device communicates with a location unit within the enclosure to provide a representation of a structure of the enclosure on the mobile device. 
         [0025]    System  100  aids users in orienting themselves within an enclosure with respect to a virtual depiction of the environment outside of the enclosure. System  100  provides relational markers representing translucent representations of the structure of the enclosure applied to the depiction of the external environment. The translucency of the relational markers allows a user to view the virtual depiction while providing a reference to locations within the enclosure. 
         [0026]      FIGS. 2-5  illustrate different depictions of the external environment from within an enclosure on a display device  106 .  FIG. 2  is an illustration of a display  200  on a display device  106 . In some implementations, a user within an enclosure views the external environment through a window. Display  200  provides a depicted scene  204  of the external environment from within the enclosure along with a virtual window  202  to aid the user in orienting his position in respect to the external environment. In some implementations, depicted scene  204  includes information that helps a user identify points of interest that are viewable from the enclosure. For example, depicted scene  204  includes labels identifying a mountain, a river, and a city as points of interest. However, frequently the points of interest are hidden from the view of the user by the structure of an enclosure, such as the cabin wall of an airplane. To orient the user to the location of the obscured points of interest, processing unit  104  alters depicted scene  204  by adding a translucent representation of the structure of the enclosure. For example, processing unit  104  alters depicted scene  204  by adding a translucent representation of the walls surrounding virtual window  202  as depicted by the dashed lines. In a further embodiment, a flexible display is applied to the wall surrounding a window. The flexible display depicts the external environment as seen around the window. For example, when the display is a flexible display, depicted scene  204  shows a view of the external environment as seen from the enclosure, while window  202  functions as a normal window through which a user can view the actual external environment. 
         [0027]      FIG. 3  is an illustration of displays  300   a - 300   f  where a user interface  116  allows a user to control the translucency of the depicted structure representation. For example, in displays  300   a - 300   f,  the depicted structures have varying degrees of translucency between transparent and opaque. In depicted scene  300   a,  a user may set the depicted structure  302   a  of the enclosure to be transparent permitting an unobstructed view of the virtual external environment  304   a  on display  300   a.  In displays  300   b - 300   e,  a user may progressively increase the opacity of the depicted structure  302   b - 302   e  to hide the depicted scene or find a desired level of translucency for the depicted structure  302   b - 302   e  in relationship to the depicted external environment  304   b - 304   e.  In some implementations, user interface  116  provides the user with preset levels of translucency. Alternatively, user interface  116  allows the user to set the translucency to any setting between transparent and opaque. Further, user interface  116  allows a user to make the depicted structure representation  302   f  opaque as shown in display  300   f,  such that the depicted structure  302   f  hides the depicted external environment  304   f  on display  300   f.  In some implementations, user interface  116  allows a user to adjust the size of the depicted structure  302   b - 302   e,  by zooming in and out on the depicted structure  302   b - 302   e.  In some examples, when you zoom out to a substantial distance, display device  106  shows multiple views from within the enclosure. 
         [0028]      FIG. 4  illustrates multiple displays  400   a - 400   b  capable of showing the view from different locations in an enclosure. Multiple displays  400  include a first location display  400   a  and a second location display  400   b.  First location display  400   a  includes first location structure representation  402   a  and a first location depicted scene  404   a  illustrating the view from the first location within the enclosure. Second location display  400   b  includes second location structure representation  402   b  and a second location depicted scene  404   b  illustrating the view from the second location within the enclosure. By providing displays that show the view of the external environment from different locations within an enclosure and providing structure representations for orienting the view in relation to the enclosure, a viewer can select viewing location within the enclosure to acquire a desired view of the external environment. For example, display  400   b  indicates to a viewer sitting next to the structure displayed as structure representation  402   b  that the landmarks visible from that structure are a forest and a factory. Further, display  400   a  indicates to the same viewer that if the viewer were to move next to the structure represented in display  400   a  as structure representation  402   a,  the viewer would be able to see a mountain, a river, and a city. If the user desired a view of the mountain, the user could move next to structure representation  402   a.    
         [0029]      FIG. 5  illustrates a display  500  showing multiple references features. Display  500  includes multiple internal structure representations  502   a - c.  Multiple internal reference structures  502   a - c  allow a viewer to select their view from within the enclosure. For example, a viewer near the structure represented by structure representation  502   c  can look at the display  500  and realize that the view of the river is better if the viewer were standing next to the physical structure represented by structure representation  502   a.  The viewer can then move next to the physical structure represented by structure representation  502   a  to see the view of the river from the enclosure near the physical structure depicted as structure representation  502   a.  In some implementations, display  500  includes external structure representation  506 . External structure representation  506  shows the position of an external feature of the enclosure in reference to the depicted scene  504  and internal structure representations  502   a - c.  For example, when the enclosure is an airplane, display  500  includes a visual depiction of a wing as an external structure representation. The depiction of the external structure representation indicates to viewers within the enclosure that an external structure representation blocks the view of depicted scene  504  at certain locations within the enclosure. In some implementations, the depiction of the external structure representation  506  is translucent to allow a viewer to know what points of interest are obscured by external structure representation  506 . Alternatively, external structure representation  506  is opaque to more accurately represent the view from within the enclosure. 
         [0030]    In some implementations, display  500  includes an instruction panel  508 . Instruction panel  508  provides instructions, aiding a user in finding locations within the enclosure from which to view desired points of interest. For example, if a user desires to see a city from a window in the enclosure, instruction panel  508  indicates to the user that the best location within the enclosure to see the city is the front window of the enclosure. Alternatively, if a user desires to see a river from a window in the enclosure, instruction panel  508  indicates to the user that the best location within the enclosure to see the river is the rear window of the enclosure. Further, user interface  116  allows user-entry of desired points of interest, in which instruction panel  508  responds by providing instructions about how to view the desired points of interest. The display  500  in conjunction with instruction panel  508  further aid a user in orienting themselves within an enclosure in relation to an external environment. 
         [0031]      FIG. 6  illustrates a display  600  showing embodiments of the present invention when viewed from a building. In certain applications, a display  600  provides a view from a building. The view from a building can aid a viewer in determining the location in the building that provides a desired view of the external environment of the building. For example, display  600  includes a virtual window  602  that depicts the view from outside a building. In display  600 , a building  604  immediately obscures the view outside the window. However, the viewer may desire to see a view of beach  606  from the building. As display  600  shows a translucent depiction of the walls surrounding the virtual window, the viewer can see that the view from a different location within the building offers a better view of beach  606  than the view from the location associated with virtual window  602 . In some implementations, a hotel provides the virtual windows to a future client when the client is making reservations. In a further embodiment, a virtual display is used by emergency personnel such as police, border patrol agents, Medevac, and the like to aid the emergency personnel in identifying desired locations to perform emergency duties. For example, a police officer performing surveillance on a house uses a virtual display to identify ideal locations to watch a suspected criminal. 
         [0032]      FIG. 7  is a flow chart diagram describing a method  700  for applying a structure representation to a display. Method  700  can be performed by system  100  described above. At block  702 , a location within an enclosure is identified. At block  704 , a portion of the structure of the enclosure is identified. The identification of both the location within the enclosure and the structure of the enclosure allows a processing unit to identify a portion of the structure that interferes with the view of the external environment from within the enclosure. The identified portion of the enclosure that interferes with the view of the external environment is used for display purposes. 
         [0033]    At block  706 , a display depicting a view of the external environment from the location is generated. For example, when the enclosure is the body of an airplane, a two dimensional or three dimensional image from satellite photos is used to represent the view of external environment of the airplane. At block  708 , a translucent structure representation is applied to the display. For example, a translucent structure representation of the structure is overlaid onto the depicted view of the environment. In some embodiments, the translucency can be adjusted. 
         [0034]    Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that any arrangement, which is calculated to achieve the same purpose, may be substituted for the specific embodiments shown. Therefore, it is manifestly intended that this invention be limited only by the claims and the equivalents thereof.