Patent ID: 9613459
Date: 2017-04-04
CPC Classifications: B60K,G06F,G06K,G06T

Claim:
1. A method for interaction in a vehicle, comprising: establishing a bi-directional interaction session via a communication link between a heads-up display operated by a driver and a passenger display operated by a passenger, wherein the heads-up display and the passenger display are communicatively coupled to the vehicle, and wherein the passenger display is physically separate from the heads-up display; upon receiving a first interaction input from the driver associated with a point of interest in a real-time point of view of the driver viewed through the heads-up display, generating a first augmented reality object based on the first interaction input, the point of interest, and the real-time point of view of the driver, and displaying the first augmented reality object on the heads-up display; transmitting via the communication link the first augmented reality object to the passenger display for displaying the first augmented reality object on the passenger display; upon receiving a second interaction input from the passenger at the passenger display, determining if the point of interest is visible by the driver in an updated real-time point of view of the driver viewed through the heads-up display; generating a second augmented reality object based upon the second interaction input, the first augmented reality object, and the determination of whether the point of interest is visible by the driver; and transmitting via the communication link the second augmented reality object to the heads-up display for displaying the second augmented reality object on the heads up display in accordance with the determination of whether the point of interest is visible by the driver; wherein upon determining the point of interest is visible by the driver in the updated real-time point of view of the driver viewed through the heads-up display, transmitting via the communication link the second augmented reality object includes transmitting via the communication link the second augmented reality object to the heads-up display for displaying the second augmented reality object on the heads-up display at a location corresponding to the point of interest in the updated real-time point of view of the driver; wherein upon determining the point of interest is not visible by the driver in the updated real-time point of view of the driver viewed through the heads-up display, generating the second augmented reality object includes generating the second augmented reality object based on a local view perceivable to the passenger on the passenger display and transmitting via the communication link the second augmented reality object to the heads-up display.