Patent Publication Number: US-2016227098-A1

Title: Information Presentation System

Description:
CROSS REFERENCE TO RELATED APPLICATION 
     The present application claims priority to Japanese Patent Application No. 2013-200958 filed Sep. 27, 2013, incorporated by reference in its entirety. 
     TECHNICAL FIELD 
     The present invention relates to an information presentation system which presents information about an image around a vehicle. 
     BACKGROUND 
     With regard to this kind of apparatus, a drive assist apparatus is known which displays a back view image of a vehicle when the shift lever of the vehicle is operated to the reverse position (See JP 2012-0162130). 
     However, when a portable terminal apparatus which is not incorporated in an onboard apparatus acquires an image captured by an onboard camera via wireless communication and presents the acquired captured image, a delay occurs in the wireless communication, so that the timing of presenting the captured image also delays, which may be problematic. 
     SUMMARY 
     A problem to be solved by the present invention is to present image information which represents a real-time state around a vehicle even when a delay occurs in the wireless communication between the onboard apparatus and the terminal apparatus. 
     In the present invention, a predicted image to be captured at an existing position of the vehicle at a timing after a delay time passes is generated and presented using a captured image has been captured by an onboard camera, in accordance with a delay state, which includes the delay time of wireless communication between an onboard apparatus and a terminal apparatus, and state information of the vehicle. The above problem is thus solved. 
     According to the present invention, the terminal apparatus presents the predicted image being assumed to be captured by the onboard camera at a timing after the delay time of the wireless communication passes, and can therefore be prevented from presenting a captured image at a past time, when a delay occurs in the wireless communication. The driver can recognize a real-time state around the vehicle even when a delay occurs in the communication between the onboard apparatus and the terminal apparatus. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  is a block diagram of an information presentation system according to an embodiment of the present invention; 
         FIG. 2  is a view showing an example of image information presented on a terminal apparatus; 
         FIG. 3  is a chart for explaining a delay with wireless communication; 
         FIG. 4  is a view for explaining a method of generating a predicted image in accordance with a delay of the wireless communication; and 
         FIG. 5  is a flowchart showing a control procedure of an information presentation process. 
     
    
    
     DETAILED DESCRIPTION OF THE EMBODIMENTS 
     Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present embodiments will be described for a case in which the present invention is applied to an information presentation system  1000  comprising: an onboard apparatus  200  having one or more cameras provided on a vehicle; and a portable terminal apparatus  100  in wireless communication with the onboard apparatus  200 . 
       FIG. 1  is a block diagram of the information presentation system  1000  according to an embodiment of the present invention. The information presentation system  1000  comprises the onboard apparatus  200  and the terminal apparatus  100 . 
     First, the onboard apparatus  200  of the present embodiment will be described with reference to  FIG. 1 . The onboard apparatus  200  comprises one or more cameras la to ld, a communication device  2 , a vehicle controller  3 , and various types of onboard devices  4  (also referred to as “modules  4 ” in a collective term). 
     The one or more cameras  1   a  to  1   d  (also referred to as a “camera  1 ” or “cameras  1 ” in a collective term, here and hereinafter) are configured using imaging elements, such as CCD (Charge Coupled Devices). In the present embodiment, the cameras  1  are disposed at predetermined positions of a rear (rearward) portion of the vehicle, such as a rear finisher portion and roof spoiler portion. These cameras  1  capture images of an object or road surface which is present in a space behind the vehicle (rearview or back view images). The term “behind” the vehicle as used in the present embodiment encompasses not only the meaning of “just behind the vehicle,” but also the meaning of “diagonally backward right” or “the diagonally backward left.” In particular, the onboard apparatus  200  of the present embodiment includes a plurality of cameras la to ld which are disposed at different positions outside the vehicle V. More specifically, the onboard apparatus  200  of the present embodiment includes cameras la to ld which are each mounted on (provided at) a frontward predetermined position of the vehicle, such as a front grille portion, at a left-side predetermined position of the vehicle, such as a left-side mirror portion, or at a right-side predetermined position of the vehicle, such as a right-side mirror portion. Each camera  1  captures an image in a different direction around the vehicle. In the present embodiment, wide-angle cameras capable of imaging a wide-angle image are used as the cameras  1 . 
     The communication device  2  of the onboard apparatus  200  transmits the images captured by the cameras  1  to the terminal apparatus  100 , which will be described later. In an alternative embodiment, at least one of the cameras  1  may have a wireless communication function to transmit the captured images to external. The terminal apparatus  100  acquires the images captured by the cameras  1 , via a wireless communication network. An image captured by each camera  1  is assigned with an identifier corresponding to the location (address) of the camera  1 , and the terminal apparatus  100  can identify each of the images captured by each camera  1 , on the basis of the identifier. 
     The vehicle controller  3  acquires information from each module of the vehicle and collectively manages the operation of the vehicle. The vehicle controller  3  of the present embodiment acquires state information which represents a state of the vehicle. The vehicle controller  3  acquires steering information from a steering control device  41  of the vehicle as the state information, acquires acceleration information or speed information from an acceleration sensor  42  as the state information, and acquires shift position information of a transmission  44  of the vehicle as the state information. The vehicle controller  3  transmits the acquired steering information and/or acceleration information (speed information) to the terminal apparatus  100 . The terminal apparatus  100  includes a control device  10  which acquires a traveling direction (traveling angle) of the vehicle from the steering information. The control device  10  acquires a traveling direction also from the shift position information. The latter traveling direction is information which represents whether the vehicle is traveling forward or backward. The control device  10  further acquires a traveling amount of the vehicle from the acceleration information (speed information) and a traveling time. Thus, the control device  10  can calculate an existing position of the vehicle after a predetermined time passes, from the traveling direction and traveling amount of the vehicle. 
     The cameras  1 , communication device  2 , vehicle controller  3 , and modules  4  of the onboard apparatus  200  are connected with one another via a CAN (Controller Area Network) or other onboard LAN and mutually exchange information. 
     Next, the terminal apparatus  100  will be described with reference to  FIG. 1 . The terminal apparatus  100  of the present embodiment is a portable terminal device, such as a smart-phone and tablet computer, which has a communication function. The terminal apparatus  100  of the present embodiment comprises a control device  10 , a communication device  20 , and a display  30 . 
     The communication device  20  of the present embodiment exchanges information mutually with the communication device  2  of the onboard apparatus  200  separated from the terminal apparatus  100 . The communication device  20  acquires the captured images, information about the state of the vehicle, and other information from the onboard apparatus  200 . 
     The display  30  of the present embodiment presents information about the captured images captured by the cameras  1  of the vehicle, a predicted image to be described later, and a delay state of the wireless communication.  FIG. 2  is a view showing an example in which the display  30  of the terminal apparatus  100  presents an overhead image of the vehicle and a captured image behind the vehicle. As shown in  FIG. 2 , the overhead image viewed from a viewpoint above the vehicle is presented in a left-side screen area  30 L of the display  30  of the onboard apparatus  200 , while the captured back view image of the vehicle is presented in a right-side screen area  30 R of the display  30 . Guide lines are also superimposed on the captured back view image of the vehicle shown in the right-side screen area  30 R. The guide lines are along a trajectory on which the vehicle is predicted to travel, and include predicted route lines P, vehicle width guide lines Q 1 , and distance guide lines Q 2 . The terminal apparatus  100  may be placed in a holder attached to an instrument panel or in the vicinity of a steering wheel of the vehicle so that the driver of the vehicle can easily recognize the terminal apparatus  100 . 
     The control device  10  of the terminal apparatus  100  of the present embodiment comprises: a ROM (Read Only Memory)  12  which stores a program to present a predicted image in accordance with a delay time of the wireless communication; a CPU (Central Processing Unit)  11  as an operation circuit which executes the program stored in the ROM  12  thereby to function as the terminal apparatus  100  of the present embodiment; and a RAM (Random Access Memory)  13  which functions as an accessible storage. 
     The control device  10  of the terminal apparatus  100  of the present embodiment is a computer which coordinates the above-described hardware with software to achieve an image acquisition function, delay state determination function, moving object detection information acquisition function, predicted image generation function, guide line generation function, and presentation function, thereby executing these functions. 
     Descriptions below will be directed to each function achieved by the control device  10  of the terminal apparatus  100  according to the embodiment of the present invention. The image acquisition function of the control device  10  will first be described. The control device  10  of the present embodiment acquires captured image(s) around the vehicle captured by the onboard camera(s)  1  from the onboard apparatus  200  via the communication device  20 . Although not particularly limited, in the present embodiment, the control device  10  acquires captured back view image(s) of the vehicle. In addition or alternatively, the control device  10  may acquire captured front view image(s) or captured sideward view image(s). In an embodiment, the control device  10  may acquire a monitoring image around the vehicle, which is generated by the onboard apparatus  200 , and in which the vehicle is viewed from a virtual viewpoint above the vehicle. The monitoring image is generated using a plurality of images captured by the cameras  1  which are disposed at different positions on the vehicle. The monitoring image is an overhead image generated by projecting these captured images onto a projection plane in which the vehicle is viewed from a virtual viewpoint above the vehicle. The control device  10  uses the acquired captured images and/or monitoring image as information to be presented on the display  30  in a specific situation, such as when parking the vehicle and reversing the vehicle. 
     The delay state determination function of the control device  10  will be described. The control device  10  of the present embodiment determines a delay state including a delay time of the wireless communication between the onboard apparatus  200  and the terminal apparatus  100 . The delay time is obtained from a difference between a reference communication time under a predetermined good communication environment and an actually measured communication time under a communication environment in which the transmission and reception are actually performed. Although not particularly limited, the control device  10  refers to a clock  45  of the onboard apparatus  200  and a clock  112  of the terminal apparatus  100  to synchronize them with each other and then measures the actual communication time required for information to be exchanged between the onboard apparatus  200  and the terminal apparatus  100  via the wireless communication and thereby the control device  10  calculates the delay time. Specifically, the onboard apparatus  200  transmits information to which the transmission timing is appended to the terminal apparatus  100 . When acquiring the information, the terminal apparatus  100  returns acknowledgement information to the onboard apparatus  200 . The onboard apparatus  200  calculates half the time from the transmission timing when transmitting the information to the terminal apparatus  100  to the reception timing when receiving the acknowledgement information transmitted from the terminal apparatus  100 , as the communication time required for the wireless communication. Similarly, the reference communication time can be calculated as a communication time for the wireless communication under a predetermined communication environment without communication load. The actually measured communication time varies from moment to moment in accordance with various factors, such as the number of terminal apparatuses accessing the wireless communication line network and the volume of information to be exchanged. Therefore, the control device  10  acquires the communication time at a predetermined period and continuously calculates the delay time which is the difference from the reference communication time. According to the present embodiment, an accurate delay time can be calculated because the delay time is calculated after preliminarily synchronizing the onboard apparatus  200  and the terminal apparatus  100  with each other. 
     The delay time includes a regular time which is preliminarily determined in accordance with the capability of the communication facilities and a variable time which is caused by various factors, such as the communication volume. The regular time can be preliminarily stored in the onboard apparatus  200  or the terminal apparatus  100 . In view of reducing the processing load, the regular delay time stored may be read out to determine the delay state. 
     Causes of occurrence of the delay state in presenting the images captured by the cameras  1  are not only the previously-described delay time of the wireless communication. The causes of the delay state include, as shown in  FIG. 3 , the first to third time periods as described below which are required to complete some processes from an image capturing process to an image presentation process. The first time period as referred to herein is a time from tO to tl during which the onboard apparatus  200  performs a process to capture images around the vehicle and a process to compress (encode) the captured images. The second time period is a time from t 1  to t 2  which is required for the wireless communication. The third time period is a time from t 2  to t 3  which is required for a process to decompress (decode) the compressed captured images and a process to present the decompressed captured images on the display  30 . Thus, the delay state with the wireless communication occurs when a long period of time is taken for the processes performed at the onboard apparatus  200  from the time of capturing images to the time of transmitting the captured images, or for the communication between the onboard apparatus  200  and the terminal apparatus  100 , or for the processes performed at the terminal apparatus  100  from the time of receiving the captured images to the time of presenting the captured images. 
     According to the technique of communication at the time of filing the present application, when no delay occurs in the wireless communication, a time of about 100 to 500 milliseconds is required from the timing of capturing images to the timing of completing the presentation process for the images. Even during such a short period of delay time, it is not preferred that the image information captured at a past time is presented as if it is the image information captured at the real time. It is particularly undesirable if the communication delay occurs to prolong the time from the image capturing to the image presentation. When the captured images are exchanged via an internal communication network (such as CAN) in the onboard apparatus  200 , the time from the image capturing to the image presentation is substantially constant and can therefore be controlled uniformly. In contrast, when the captured images obtained by the onboard apparatus  200  are transmitted to the terminal apparatus  100  via public wireless communication and presented using the display  30  of the terminal apparatus  100 , the delay of communication may have to be taken into consideration. In addition, the above-described third time period is highly dependent on the processing ability of the terminal apparatus  100 . It is therefore difficult to uniformly define the delay time because the terminal apparatus  100 , which may be individually and personally owned, has different performance or state. 
     With regard to the second time period, the control device  10  of the present embodiment measures the delay time of the wireless communication between the terminal apparatus  100  and the onboard apparatus  200  using the above scheme. 
     With regard to the above-described third time period, the control device  10  of the present embodiment acquires a terminal apparatus-side processing time required for the terminal apparatus  100  to present a predicted image after acquiring the captured images, and adds the terminal apparatus-side processing time to the delay time of the wireless communication and then calculates a delay time of information presentation processing. This delay time can be used to determine the delay state. Although not particularly limited, it is preferred that the terminal apparatus-side processing time is experimentally calculated in advance and stored in the terminal apparatus  100  in a readable manner. The delay state can be correctly determined by not only calculating the delay of the wireless communication but also calculating a delay time through addition of the time required for the processes at the terminal apparatus  100 . 
     With regard to the above-described first time period, the control device  10  of the present embodiment may calculate a delay time through addition of the time required for the processes performed at the onboard apparatus  200  from the time of acquisition of the captured images (image capturing) to the time of transmission of the captured images. The delay state can be further correctly determined by not only calculating the communication delay time of the wireless communication but also calculating a delay time through addition of the time required for the processes at the onboard apparatus  200 . 
     In addition, the control device  10  of the present embodiment determines whether the wireless communication with the communication device  2  is disrupted. When the wireless communication is disrupted, the control device  10  causes the display  30  to present that the wireless communication is disrupted. In a situation in which the wireless communication with the communication device  2  is disrupted, it is difficult to acquire in real time the captured images at the present moment. In other words, in a situation in which the wireless communication with the communication device  2  is disrupted, it is highly possible that the captured images presented on the display  30  are images captured at a past time. According to the present embodiment, by presenting that the wireless communication with the communication device  2  is disrupted, it is possible to inform the driver that the presented captured images are not real-time images. 
     The control device  10  of the present embodiment determines a degree of reliability of the wireless communication in accordance with the delay state. When the delay time is long and the delay state of the wireless communication is bad, the control device  10  determines that the degree of reliability of the wireless communication is low. On the other hand, when the delay time is short and the delay state of the wireless communication is not bad (communication state is good), the control device  10  determines that the degree of reliability of the wireless communication is high. The degree of reliability of the wireless communication can be defined in accordance with the communication time in the wireless communication. As the communication time becomes longer, the degree of reliability of the wireless communication can be set lower. The control device  10  presents the determined degree of reliability of the wireless communication on the display  30 . In a situation in which the communication time (delay time) in the wireless communication is long and the degree of reliability of the wireless communication is low, it is difficult to acquire in real time the captured images at the present moment. In other words, it is highly possible that the captured images presented on the display  30  are images captured at a past time. In this case, according to the present embodiment, the degree of reliability of the wireless communication is presented to be low. This can inform the driver that the presented captured images are not real-time images. 
     The moving object detection information acquisition function will then be described. The control device  10  of the present embodiment acquires detection information whether a moving object is present around the vehicle. The control device  10  acquires the information whether a moving object is present, from the onboard apparatus  200 . The onboard apparatus  200  includes a moving object detection device  43 . The moving object detection device  43  determines whether a moving object is present around the vehicle, on the basis of a change in time of features which are extracted from the images captured by the onboard cameras  1 . The scheme of detecting a moving object by using the captured images is not particularly limited, and it is possible to appropriately utilize a scheme which has been known at the time of filing the present application. When acquiring the detection information that a moving object is present, the control device  10  determines the delay state. There may be a case in which a moving object does not appear in the captured images even though the moving object is present around the vehicle, because the timing of presenting the captured images is delayed if a delay occurs in the wireless communication. When a moving object is present around the vehicle, the delay of the wireless communication may have to be particularly taken into consideration. The control device  10  of the present embodiment determines the delay state of the wireless communication when a moving object is present around the vehicle, and a predicted image can therefore be presented in accordance with the delay state of the wireless communication. 
     The predicted image generation function of the control device  10  will then be described. The control device  10  acquires state information of the vehicle and calculates an existing position of the vehicle after the delay time on the basis of the state information of the vehicle. The control device  10  of the present embodiment acquires a steering angle and vehicle speed (or acceleration) of the vehicle as the state information of the vehicle. The control device  10  calculates an existing position of the vehicle after a predetermined time (after the delay time) when the vehicle travels with the acquired state information (in state values such as steering angle and speed). The scheme of calculating an existing position of the vehicle when the vehicle travels in a certain state for a predetermined time is not particularly limited, and it is possible to appropriately employ a scheme which has been known at the time of filing the present application. 
     The control device  10  generates a predicted image using the captured image(s) that has been acquired so as to obtain the predicted image to be captured by the camera at a calculated (or estimated) position of the vehicle, a predicted image which is an image to be captured at the calculated (or estimated) position of the vehicle. In other words, the control device  10  takes account of the traveling direction and traveling amount of the vehicle and predicts and generates a predicted image which is an image to be captured by a camera  1  at an existing position of the vehicle after traveling when the delay time passes.  FIG. 4  is a view which shows a captured back view image of the vehicle as displayed in the screen area  30 R of  FIG. 2 . As shown in  FIG. 4 , a predetermined first reference point P 0  is set at timing tx 0 . As the vehicle travels with the steering angle and speed in the state information, the first reference point P 0  on the captured image moves to a second reference point P 1  at timing tx 1  after a delay time ty. In this example, the control device  10  calculates a reverse traveling amount (traveling amount) on the basis of the state information of the vehicle and the delay time ty. In a captured image which the onboard camera  1  captures at an existing position after the vehicle travels, the second reference point P 1  corresponds to the second reference point P 0 . The control device  10  calculates image information at the second reference point P 1 . That is, the control device  10  foresees (predicts) an image which will be captured by the onboard camera  1  at the timing tx 1  after the delay time ty. 
     The control device  10  obtains a traveling direction of the vehicle from the steering angle and obtains a traveling speed of the vehicle from the speed information. The control device  10  predicts an image being assumed to be captured by the onboard camera  1  at an existing position of the vehicle after the delay time passes, on the assumption that the vehicle travels with the present traveling direction and traveling speed. In other words, the control device  10  calculates where the first reference point P 0  of the captured image by the onboard camera  1  at the timing tx 0  is positioned in an image captured at the timing tx 1  after the delay time ty passes from the timing tx 0 . The control device  10  sets coordinates of the image captured by the camera  1  at the timing tx 1  after the delay time ty passes from the timing tx 0 , using the traveling direction and traveling amount of the vehicle. The control device  10  performs coordinate conversion so that the images captured by the camera(s)  1  at the timing tx 0  (camera coordinates at timing tx 0 ) are arranged on the newly set coordinates (camera coordinates at timing tx 1 ). The same coordinate conversion is executed for each point on coordinates. Through this process, the control device  10  generates, from the acquired captured images, a predicted image which is an image captured at the calculated existing position of the vehicle after the delay time ty passes. Thus, the control device  10  generates a predicted image being an image which is assumed to be captured by the onboard camera  1  at a position at which the vehicle is present after traveling with the direction and speed of the state information during the delay time ty, i.e. during the period of time from the timing tx 0  to the timing tx 1 . 
     In  FIG. 4 , it is assumed that the first reference point P 0  on the image captured by the onboard camera  1  at the timing tx 0  corresponds to the second reference point P 1  at the timing tx 1  after the delay time ty passes. The predicted image is an image when the first reference point P 0  on the captured image shown in  FIG. 4  has converted into the second reference point P 1 . In this example, the vehicle travels in the left-rear direction (with respect to the forward direction of the vehicle traveling). The predicted image, which reflects the back view of the vehicle, is shifted rightward (in the image of the figure) with respect to the captured image. In a practical scene, the camera  1  captures an image area wider than an image area that shown in  FIG. 4 . In particular, if a wide-angle camera is employed as the camera  1 , a captured image including a wide-angle image will be acquired. The control device  10  performs the coordinates conversion for a necessary region of the captured image to generate a predicted image, and clips (cut and copy) the predicted image from the captured image in accordance with the display region of the display  30 . Through this process, the control device  10  can generate a predicted image without deficiency. 
     The presentation function of the control device  10  will be described. The control device  10  presents the generated predicted image on the display  30 . As shown in  FIG. 2 , the control device  10  presents an overhead image, which is an image viewed from a viewpoint above the vehicle, in the left-side screen area  30 L of the display  30 , and presents a captured image or predicted image in the right-side screen area  30 R of the display  30 . 
     The information presentation system  1000  of the present embodiment has a feature of generating a predicted image being an image which is assumed to be captured by the onboard camera after the delay time of the wireless communication. According to this feature, even when a delay occurs in the wireless communication between the onboard apparatus  200  and the terminal apparatus  100 , it is possible to present a predicted image which shows the real-time state around the vehicle. If a communication delay occurs when presenting the captured image captured by the onboard camera  1  on the terminal apparatus  100 , the terminal apparatus  100  will present a captured image at a past time. 
     It is assumed a situation in which an object is approaching the own vehicle but does not appear in an image which is clipped from a captured image of a past time to match the display frame of the display  30 . In this situation, if a delay occurs in the wireless communication, the captured image of the past time will be displayed, from which the driver cannot recognize the object approaching. To this problem, the control device  10  of the present embodiment generates the predicted image by clipping an image from a captured image with reference to the position of the camera  1  of the vehicle after the delay time when the vehicle travels in accordance with the state information of the vehicle. Even a moving object, which was not (displayed) within the display frame at the past timing but is within the display frame at the present timing with consideration for the delay time, is displayed in the predicted image. The driver can recognize the presence of the moving object from the predicted image. In the present embodiment, when a delay occurs in the wireless communication, the terminal apparatus  100  presents the foreseeing (or projection) predicted image being assumed to be captured after the delay time passes rather than a captured image at a past time. Therefore, it is possible to notify the driver of the presence of a moving object which was not included in an image based on a captured image at a past time but is approaching. 
     The control device  10  of the present embodiment further has a guide line generation function to generate one or more guide lines along a trajectory on which the vehicle is predicted to travel on the basis of the state information of the vehicle. More specifically, the control device  10  generates guide lines including: “predicted route lines P” which represent a trajectory on which the vehicle is predicted to travel; “vehicle width guide lines Q 1 ” which represent positions of the side surfaces of the vehicle when the vehicle travels; and “distance guide lines Q 2 ” which represent positions along the traveling direction of the vehicle when the vehicle travels. The control device  10  superimposes the generated guide lines on the predicted image, as shown in  FIGS. 2 and 4 . 
     During this operation, in the present embodiment, the control device  10  changes a display form of the guide lines in accordance with the delay state determined by the previously-described delay state determination function. For example, when the delay time is long and the delay state is bad, i.e., when the degree of reliability of the wireless communication is low, the guide lines are displayed in a different display form than the default display form which is used when the degree of reliability of the wireless communication is not lower than a standard value. Displaying the guide lines in a different display form than the normal (default) display form can call the driver&#39;s attention. When the degree of reliability of the wireless communication is low, changing the display form of the guide lines allows the driver to pay great attention to the surroundings even though the accuracy of the guide lines may possibly deteriorate. 
     Specifically, the display form of the guide lines to be displayed when the delay time is long and the delay state is bad may be set such that, for example, the color, transparency, line width, and/or mode (dashed-dotted line, dashed-two dotted line) are different from those of the guide lines to be displayed when the delay time is short and the delay state is not bad (the state of the wireless communication is good). As an example, when the delay time is short and the delay state is not bad (the state of the wireless communication is good), the guide lines may be displayed as lines of a retreating color, such as blue, green and blue-violet, which is relatively not distinguishable, broken lines, and/or relatively thin lines. On the other hand, when the delay time is long and the delay state is bad, the guide lines may be displayed as lines of an advancing color, such as red, orange and yellow, which is relatively distinguishable, solid lines, and/or relatively wide lines. 
     The examples of  FIGS. 2 and 4  are described as an example of presenting a predicted image from captured back view images of the vehicle. In an alternative embodiment, the control device  10  can generate and present a predicted image obtained by projecting predicted images, which are images captured by a plurality of cameras  1  at a calculated position of the vehicle, onto a projection plane in which the vehicle is viewed from a virtual viewpoint above the calculated position. In other words, the predicted image after the delay time passes can be displayed in a form of an overhead image as shown in the left-side region  30 L of the display  30  of  FIG. 2 . In an embodiment, the control device  10  can generate the predicted image only in the traveling direction of the vehicle, while it can generate an images in the direction other than the traveling direction by using past images. When the vehicle travels backward, the control device  10  can generate the predicted image only in the backward direction and an overhead image by using the predicted image in the backward direction and captured images ahead and at a side or sides. According to this embodiment, the generated predicted image can be usefully used not only to confirm the situation in the traveling direction but also to confirm the whole situation around the vehicle. 
     Descriptions will then be directed to a processing procedure in the information presentation system  1000  of an embodiment of the present invention.  FIG. 5  is a flowchart which shows a control procedure performed in the information presentation system  1000  according to the present embodiment. 
     In step  101 , the control device  10  of the terminal apparatus  100  of the present embodiment confirms whether the wireless communication is established. If the wireless communication is not established, i.e., if the wireless communication is disrupted, the control device  10  displays this fact on the display  30 . 
     If the wireless communication is established, the process proceeds to step  102  in which the control device  10  initiates a delay countermeasure process. In the delay countermeasure process, the control device  10  generates a predicted image being assumed to be captured after the delay time passes, and the control device  10  displays the predicted image on the display  30 . In the present embodiment, when acquiring detection information that a moving object is present, the control device  10  initiates the delay countermeasure process. Trigger for the delay countermeasure process is not limited to this. The delay countermeasure process may be initiated if the communication delay time of the wireless communication comes to a predetermined value or longer. Of course, this process may be repeated at a predetermined period. 
     Step  102  is followed by step  103  in which the control device  10  determines the delay state. The delay state is determined using the delay time. The delay time may be measured at the onboard apparatus  200  or at the terminal apparatus  100 . The terminal apparatus  100  of the present embodiment synchronize itself with the onboard apparatus  200  and calculates, as the communication time, half the time required for round-trip communications from when transmitting some information to the onboard apparatus  200  to when acquiring an acknowledgement signal from the onboard apparatus. The control device  10  calculates a time difference between the actually measured communication time and the communication time measured in a standard state to obtain the delay time at the time of actual measurement. The obtained delay time is used to determine the degree of reliability of the wireless communication in accordance with the delay state. As the delay time becomes longer, the delay state is worse and the degree of reliability of the wireless communication is lower. In this operation, the delay time and delay state are determined in consideration of the time associated with the decompression and presentation processes for the image information acquired at the terminal apparatus  100 . The control device  10  presents the determination result regarding the delay state on the display  30 . Thus, the control device  10  provides the driver with the degree of reliability of the wireless communication, i.e. advice about the accuracy of the information to be presented. 
     In step  104 , the control device  10  acquires the captured images captured by the cameras  1  and the state information of the vehicle from the onboard apparatus  200 . 
     In the following step  105 , the control device  10  generates a predicted image. The control device  10  calculates an existing position of the vehicle after the delay time on the basis of the state information of the vehicle and generates a predicted image so as to predict the predicted image to be captured by a camera  1  at the calculated existing position of the vehicle using the captured images that has been acquired. 
     In step  106 , the control device  10  generates guide lines along a trajectory on which the vehicle is predicted to travel on the basis of the state information of the vehicle. 
     In step  107 , the control device  10  superimposes the generated guide lines on the captured image or predicted image and presents the image on the display  30 . 
     The terminal apparatus  100  and information presentation system  1000  according to the embodiment of the present invention, which are configured and operate as described above, have advantageous effects as below. 
     (1) The information presentation system  1000  of the present embodiment generates a predicted image so as to predict (or project, or foresee) the predicted image to be captured by the onboard camera after the delay time of the wireless communication. The information presentation system  1000  presents the predicted image which shows a real-time (or present time, or without time lag) state around the vehicle even when a delay occurs in the communication between the onboard apparatus  200  and the terminal apparatus  100 . When a delay occurs in the wireless communication, the information presentation system  1000  can prevent the terminal apparatus  100  from presenting a captured image at a past time. 
     (2) The information presentation system  1000  of the present embodiment calculates the delay time after preliminarily synchronizing the onboard apparatus  200  and the terminal apparatus  100  with each other, and can therefore calculate an accurate delay time. 
     (3) The information presentation system  1000  of the present embodiment not only calculates the delay of the wireless communication but also calculates a delay time through addition of the time required for the processes at the terminal apparatus  100 , and can therefore determine the delay state correctly. 
     (4) The information presentation system  1000  of the present embodiment presents that the wireless communication via the communication device  2  is disrupted, and can thereby inform the driver that the presented captured images are not real-time images. 
     (5) The information presentation system  1000  of the present embodiment presents that the degree of reliability of the wireless communication via the communication device  2  is low, and can thereby inform the driver that the presented captured images are not real-time images. 
     (6) When the delay time is long and the delay state is bad, i.e., when the degree of reliability of the wireless communication is low, the information presentation system  1000  of the present embodiment displays the guide lines in a different display form than the default display form, and thereby calls the driver&#39;s attention. When the degree of reliability of the wireless communication is low, changing the display form of the guide lines allows the driver to pay attention to the surroundings even though the accuracy of the guide lines may possibly deteriorate. 
     (7) The information presentation system  1000  of the present embodiment determines the delay state of the wireless communication when a moving object is present around the vehicle. The information presentation system  1000  can present a predicted image in accordance with the delay state of the wireless communication in a situation to be paid great attention. 
     (8) The information presentation system  1000  of the present embodiment presents a generated, predicted overhead image, and therefore not only can confirm the situation in the traveling direction but also can confirm the whole situation around the vehicle. 
     In the present description, the terminal apparatus  100  and information presentation system  1000  are described as examples of an aspect of the information presentation system according to the present invention, but the present invention is not limited thereto. 
     In the present description, the information presentation system  1000  comprising the onboard apparatus  200  and the terminal apparatus  100 , which comprises the control device  10  including the CPU  11 , ROM  12  and RAM  13 , is described as an example of an aspect of the information presentation system according to the present invention, but the present invention is not limited thereto. 
     In the present description, the terminal apparatus  100  comprising the control device  10  which executes the image acquisition function, delay state determination function, predicted image generation function, presentation function, guide line generation function, and moving object detection information acquisition function, the communication device  20 , and the display  30 , is described as an aspect of a terminal apparatus comprising an image acquisition unit, delay state determination unit, predicted image generation unit, presentation unit, guide line generation unit, and moving object detection information acquisition unit, but the present invention is not limited thereto. 
     In the present description, the onboard apparatus  200  comprising the cameras  1 , communication device  2 , vehicle controller  3 , and modules  4  is described as an aspect of an onboard apparatus comprising a camera and having a communication function, but the present invention is not limited thereto.