Vehicle content projection

In an example, a content projecting system includes a communication module configured to receive an instruction to project content. The content projecting system further includes a projector configured to be affixed to a vehicle. The projector is further configured to project the content onto a projection surface separate from the vehicle.

FIELD

The embodiments discussed herein are related to externally projecting content from a vehicle.

BACKGROUND

When operating an automobile, a driver may be focused on the automobile's surroundings. For example, the driver may focus on the road, signs, signals, other cars, people near or on the road, and the like. The driver may also have access to a great deal of information that may be of interest to the driver while operating the automobile.

Some of the information may be provided by the automobile itself and may deal with the state of the automobile. For example, the automobile may provide information to a driver about the automobile's speed, heading, fuel level, system warnings, maintenance reminders, and the like.

The automobile may also provide information concerning entertainment media being delivered within the automobile. For example, the automobile may provide information about entertainment media provided by a radio station, compact disk (CD), digital versatile disk (DVD), or the like. Information about the media may include a performer name, song or program name, volume level, and/or other information about the particular media. Many automobiles may also provide navigation information, including turn-by-turn directions, weather and traffic notices, and the like.

In addition to information from the automobile, the driver may have access to information from other devices as well. In particular, a driver may have a mobile phone, smartphone, laptop computer and/or tablet computer in the automobile. In addition to providing information stored on the device, these mobile devices may allow the driver to make or receive phone calls, send or receive short message service (SMS) or multimedia messaging service (MMS) messages. These mobile devices may further communicate with radio-access networks, including cellular networks and/or wireless local area networks (WLANs) while located in the automobile. The mobile device may also provide the driver with access to vast amounts of information via the internet, including information such as news headlines, sports scores, social media, games, instant messaging, email, and the like. The mobile device may also provide navigation information and/or deliver entertainment media.

In addition to providing the driver with information, the automobile and/or mobile devices may require input from the driver to perform some actions. For example, a stereo system may require the driver to interact with an interface to change the volume, change the radio station, or switch between CDs. Similarly, a mobile phone may require the driver to interact with a touchscreen or keypad to view or respond to a text message, receive a phone call, and/or access an application.

These applications and services require the driver's attention, some more than others. For example, changing the volume on a radio can be done without taking one's eyes off the road, but selecting a contact to call from a mobile phone address book requires looking at the phone, not the road. This sort of “distracted driving” has caused accidents and many states now have laws forbidding interacting with a mobile phones while driving. The National Highway Traffic Safety Administration (NHSTA) has provided guidelines to automakers to make sure that new cars discourage distracted driving. For example, the NHSTA guidelines attempt to discourage distracted driving by directing that new cars disable some feature of the navigation system such as blocking access to the address input screen in a navigation system while the car is in motion.

The focus of the NHSTA guidelines is to encourage drivers to keep their eyes on the road rather than being distracted with the interface of a mobile device or the car infotainment system. The NHSTA guidelines are often in direct conflict with drivers' desired behavior.

SUMMARY

Thus, a system that allows a driver to interact with a mobile device or car infotainment system while focusing on the road may discourage distracted driving while improving driver satisfaction. Accordingly, some embodiments described herein generally relate to projecting content in front of a vehicle, such as onto a road in front of the vehicle or onto the back of another vehicle. By projecting the content in front of the vehicle, the driver can see the content without taking his/her eyes off of the road. In some embodiments, the content may be projected a sufficient distance in front of the vehicle such that the driver does not have to shift focus from the projected content to the road ahead and vice versa. While the content may be projected in front of and apart from the vehicle, the driver may be able to provide input to select or otherwise interact with the content within the vehicle via, e.g., buttons on the steering wheel and/or voice input. Optionally, threat analytics may be applied to determine whether it is safe to project the content or whether the projection of the content should be at least temporarily suppressed.

In an example embodiment, a content projecting system that may be used in a vehicle includes a communication module configured to receive an instruction to project content. The content projecting system further includes a projector configured to be affixed to a vehicle. The projector is further configured to project the content onto a projection surface separate from the vehicle.

In another example embodiment, a vehicle includes a communication module, an imaging module, a projector, and a safety module. The communication module is configured to receive an instruction to project content configured to convey information to a driver of the vehicle. The imaging module is configured to pre-distort the content such that the content appears substantially undistorted from a perspective of the driver when projected onto a projection surface separate from the vehicle. The projector is configured to project the content onto the projection surface such that the content is at least partially viewable by the driver of the vehicle. The safety module is configured to suppress the projector from projecting the content when a threat analytic exceeds a threshold.

DESCRIPTION OF EMBODIMENTS

Although an automobile's driver may have access to vast amounts of information that may be of interest to the driver, accessing the information while operating the automobile may be dangerous. For example, the driver may be required to look at a media system, navigation system, dashboard, and/or mobile device to receive information from the devices. In some instances, the driver may be further required to interact with the system or device to prompt it to display the information or to perform an action. For example, to read an SMS message received on a mobile device, a driver may be required to retrieve the mobile device and navigate through the mobile device's interface. In doing so, the driver may be required to stop focusing on the road for a time. When focusing on something inside the automobile, the driver may be less likely or slower to notice and/or react to dangerous situations developing outside of the automobile.

Some automobiles attempt to counteract this danger by projecting information onto a portion of the automobile's windshield. However, such systems may prompt the driver to focus on the windshield and not on the road ahead. Doing so may still leave the driver less likely or slower to notice and/or react to dangerous situations developing outside of the automobile.

To overcome these and other problems, some embodiments described herein include a content projecting device that allows a driver to receive information while keeping his/her eyes on the road and without shifting focus to the inside of the vehicle. The content projecting system may project content onto a surface separate from the vehicle to communicate information to the vehicle's driver. The content projecting system may modify/update the projected content in response to input from the driver. Projecting the content onto a surface separate from the vehicle may allow the driver of the vehicle to navigate and operate the user interface without requiring the driver to take his/her eyes off the road or shift focus to the inside of the vehicle. The content projecting system may also be used to project content to be viewed by other occupants of the vehicle, occupants of other vehicles, pedestrians, and the like. In some instances, the system may project content such as an image as a personalized expression or may be used to provide information to people outside of the vehicle.

Reference will now be made to the drawings to describe various aspects of some example embodiments of the invention. The drawings are diagrammatic and schematic representations of such example embodiments, and are not limiting of the present invention, nor are they necessarily drawn to scale.

FIG. 1illustrates an example vehicle102including a content projecting system104. Although illustrated as an automobile, the vehicle102may more generally include any vehicle in which it may be desirable to project content onto a path of travel of the vehicle such that a driver of the vehicle can view the content without taking his/her eyes off the path of travel and without substantially shifting his/her focus. Generally, for example, the vehicle102may include a motorized vehicle such as a car, a truck, a motorcycle, a tractor, a semi-tractor, an airplane, a motorized boat, or the like, or even a non-motorized vehicle such as a bicycle, a wheelchair, a sailboat, or the like—provided a suitable power supply for the content projecting system104is provided.

The content projecting system104projects content106onto a projection surface108that is generally in a path of travel of the vehicle102. The content106may be visible to the driver of the vehicle102and may convey information to a driver of the vehicle102such that the driver may view the information without shifting focus into the vehicle102. Accordingly, the content projecting system104may include a projector as described with respect toFIG. 2. Alternately or additionally, the content projecting system104may include a camera coupled via a feedback loop to the projector as described with respect toFIG. 2. The feedback from the camera may be used to determine where to project the content106to maximize legibility of the content106to occupants of the vehicle102, for instance.

The content106may also be visible to other occupants of the vehicle102and/or to people outside of the vehicle, such as occupants of other vehicles, pedestrians, and the like. As such, the content106may convey information to other occupants of the vehicle102and/or to observers outside of the vehicle102. In some embodiments, the content106acts as a personalized expression of the driver and/or occupants of the vehicle. Alternately or additionally, the content106may include an advertisement or the like.

Information conveyed by the content106may be provided by any of a wide variety of sources, such as the vehicle102itself, a component such as a radio or navigation system of the vehicle102, a mobile device such as a mobile phone, a laptop computer, or a tablet computer associated with the driver or an occupant of the vehicle102, or the like or any combination thereof. Accordingly, information conveyed by the content106may include or relate to a state of the vehicle102. For example, the information may include a heading, a speed, a fuel level, an interior or exterior temperature, a maintenance reminder, and/or other state of the vehicle102.

Alternately or additionally, the content106may convey safety alerts concerning operation of the vehicle102. For example, the content106may alert the driver if the vehicle102is drifting out of a designated lane, may alert the driver of other automobiles in the driver's blind spots, and the like.

As another example, the content106may convey navigation information as illustrated inFIG. 1. For example, the content106may convey information corresponding to turn-by-turn directions generated by a navigation system. Examples of navigation systems may include navigation systems built into the vehicle102, standalone navigation systems, and navigation applications installed on mobile devices. In these and other embodiments, the content106may include arrows, text, distance indications, highlight a lane or turn, landmark identifiers, road identifiers, business logos, and/or other content that may assist a driver and/or an occupant of the vehicle102with navigation.

The content106may convey information from a mobile device located within the vehicle102. For example, the content106may convey information about a phone call received on a mobile phone. The content106may indicate that the mobile phone is receiving a phone call, and/or may display a phone number of a caller, a name of a caller, or the like. Alternately or additionally, the content106may indicate that the mobile phone has received an SMS message, an MMS message, an email message, an instant message and/or may display all or a portion of the received message.

Information provided by an application of a mobile device may be conveyed by the content106. For example, the content106may display social media such as posts from Facebook®, Twitter®, or other social networks. Mobile device applications may provide information via the content106to perform other functions, such as warning the driver of known speed traps, providing coupon offers for nearby businesses, displaying news headlines, and the like. The content projecting system104may optionally be used to facilitate automobile-based games for mobile devices.

The content106may convey information about entertainment media playing within the vehicle102. For example, the content106may convey information identifying a radio station, an album name, a performer name, a track or program name, or the like. Such information may originate with a media system installed in the vehicle102, and/or with a mobile device located within the vehicle102.

In some embodiments, the content106may assist the driver of the vehicle102in controlling the vehicle, a component of the vehicle, or a mobile device. The content106may display options for the driver to “browse,” “select,” and/or “confirm” a selection or otherwise control the vehicle, component, or mobile device. For example, in response to receiving a spoken destination, a navigation system may display content106including a set of destination addresses representing the best guesses of what was spoken. The driver may select the correct address from the group of addresses via a suitable input device.

The content projecting system104may generally be coupled to a front end of the vehicle102to allow the content106to be projected in front of the vehicle102. For example, the content projecting system104may be affixed to a front grille of the vehicle102as shown inFIG. 1. Alternately or additionally, the content projecting system may be located in, under, beside, and/or on a bumper, a hood, a fender, a roof, or the like. In some embodiments, the content projecting system104may be located in a headlamp of the vehicle102. In the illustrated embodiment ofFIG. 1, the content projecting system104is located under the hood of the vehicle102.

The content projecting system104may be configured to be installed in a previously manufactured vehicle102. For example, the content projecting system104may be added to an automobile102as an aftermarket add-on. In other embodiments, the vehicle102may be manufactured to include the content projecting system104.

FIG. 2is a block diagram of an embodiment200of the content projecting system104ofFIG. 1(hereinafter “content projecting system200”). The content projecting system200may receive power from a vehicle and/or may include or be coupled to a power source such as a battery, a solar panel or the like.

The content projecting system200includes a projector204. The projector204generally includes a device capable of projecting content. In some embodiments, the projector204may be a laser imaging device configured to project content using a laser. For example, a laser-based projector204may form line-based content from one or more beams of laser light. Alternately or additionally, the projector204may include a digital light processing (DLP) projector, a light emitting diode (LED) projector, a liquid crystal display (LCD) projector, a liquid crystal on silicon (LCOS) projector, or the like.

Although not required, the content projecting system200may include a movement stabilizer205as illustrated inFIG. 2. The movement stabilizer205may be configured to dampen movement of the projector204during operation of a vehicle. For example, the movement stabilizer205may resist vibration generated by the vehicle's engine, the road, or the like. Dampening movement of the projector204may lessen or eliminate a perception that the content is shaking during operation of the vehicle. The movement stabilizer205may include one or more gyroscopes, springs, dampers, or the like or any combination thereof.

Optionally, the content projecting system200may include an orientation control207as illustrated inFIG. 2. The orientation control207may be configured to adjust an orientation of the projector204. The orientation of the projector204may be adjusted to allow content to be projected onto a desired surface at a desired location. For example, the orientation of the projector204may be adjusted to display content closer to or farther from a vehicle. The orientation of the projector204may be adjusted to move the content laterally. For example, the content may be moved laterally to follow the curve of a road so that the content remains on the surface of the road as the vehicle travels along the curve. Alternately or additionally, the orientation of the projector204may be adjusted to allow content to be projected on surfaces other than a road. For example, content may be projected on billboards, signs, buildings, earth, vegetation, other vehicles, and the like.

In the illustrated embodiment ofFIG. 2, the content projecting system200additionally includes a communication module206. The communication module206is configured to receive instructions for the content projecting system200to project content. The communication module206may receive the instructions over a communication interface208. The communication interface208may be wired to systems within a vehicle in which the content projecting system200is installed. Alternately or additionally, the communication interface208may be wireless. For example, the communication module206may include hardware and/or software configured to allow communication with systems within a vehicle over WLAN, Bluetooth®, ZigBee®, and/or other suitable wireless communication interfaces208.

Although not required, the content projecting system200may additionally include an imaging module210as illustrated inFIG. 2. The imaging module210may create, format, pre-distort and/or pass along content for the projector204to project based on instructions, information, and/or content received by the communication module206. The imaging module210may provide the projector204with pre-distorted content such that the projected content appears undistorted from the perspective of a target observer of the projected content to account for the angle of the projection surface with respect to the target observer. For example, if content appears undistorted when projected onto a surface such as the back of a trailer that is normal to the line of sight of the target observer, the same content will appear distorted when projected onto a surface such as a road that is at an acute angle with respect to the line of sight of the target observer. Accordingly, the imaging module210can pre-distort the content to compensate for the angle of the projection surface with respect to the target surface so that the content appears undistorted to the target observer. Pre-distorting content to appear undistorted from the perspective of a target observer is described in further detail with reference toFIGS. 3A and 3B.

The content projecting system200may additionally include a camera211as illustrated inFIG. 2, although not required in all embodiments. The camera211may be configured to monitor the appearance of the content on the projection surface. The appearance of content projected onto a projection surface by the projector204may be affected by a number of factors, including levels of ambient light in the environment, as well as the shape, color(s) and reflectivity of the projection surface. The camera211may provide feedback concerning the appearance of the content to the imaging module210. The imaging module210may consider feedback from the camera211to format and/or pre-distort the content to account for those factors affecting the appearance of the content. For example, the imaging module210may consider feedback from the camera211to adjust the color, intensity, and/or proportions of the content.

Optionally, the content projecting system200may further include a safety module212as illustrated inFIG. 2. The safety module212may be configured to suppress the projector204from projecting content during times when projecting the content may be unsafe. In some embodiments, the safety module212is configured to selectively instruct the imaging module210to ignore content from the communication module206and to instead provide the projector204with content that provides the target observer with a warning, an indication that the content has been suppressed, and/or a blank image to effectively turn off the projector204.

Alternately or additionally, the safety module212may be configured to identify surfaces that may safely receive projected content without harming a person and/or distracting other drivers. In some embodiments, the safety module212may consider threat analytics performed by the vehicle. For example, a vehicle may perform threat analytics through sensors and systems for detecting distractions and/or potential dangers such as pedestrians, animals, other automobiles, foreign objects on or near the road, stationary objects, road damage, signals, known areas of road safety such as busy intersections, traveling in excess of the speed limit, signs, and the like. The vehicle may include such systems as part of self-driving and/or driver assistance systems. In some embodiments, the content projecting system200may include similar sensors and systems for detecting distractions and/or potential dangers, and for performing threat analytics.

As illustrated, the safety module212includes a communication interface214over which threat analytics information may be received from the vehicle and/or any sensors and systems for detecting distractions and/or potential dangers and for performing threat analytics. The communication interface214may include a wired and/or a wireless interface similar to the communication interface208described above.

Although illustrated as discrete modules and components, the projector204, the communication module206, the imaging module210, and/or the safety module212may be divided into additional modules and components, combined into fewer modules and components, or eliminated, depending on the desired implementation.

FIG. 3Aillustrates example content302that may be projected by the content projecting system200ofFIG. 2from the perspective of a driver of a corresponding vehicle in which the content projecting system200is installed. The content302may generally correspond to the content106as described with reference toFIG. 1. As shown, the content302is projected onto a projection surface304so as to have an undistorted appearance from the perspective of the driver.

FIG. 3Billustrates a top view of the example content302ofFIG. 3A. To cause the content302to be undistorted from the perspective of the driver, the content302may be pre-distorted by the content projecting system such that the content appears undistorted from the driver's perspective. The content302may be pre-distorted to compensate for the angle of the projection surface304with respect to the line of sight of the driver. In the example ofFIGS. 3A-3B, the content302may be pre-distorted so as to appear from directly above as illustrated inFIG. 3B. The pre-distortion of the content302may be accomplished by an imaging module generally corresponding to the imaging module206described with reference toFIG. 2. Alternately or additionally, pre-distortion of the content302may be accomplished by one or more lenses.

The position of the content302relative to the driver, the angle of the projection surface304with respect to the line of sight of the driver, the position of the content projecting system, and the perspective of the driver may determine how the content302is pre-distorted so as to appear undistorted from the driver's perspective. In some embodiments, the position of the projection surface304may be determined by the content projecting system and considered in pre-distorting the content302. For example, the content projecting system may include one or more range finders for measuring one or more distances to the projection surface304for use in determining how the content302may be pre-distorted. Alternately or additionally, the content projecting system may receive and consider information about the position of the driver within the vehicle. For example, the content projecting system may receive information about the position of the driver's seat for use in determining how the content302may be pre-distorted.

In some embodiments, the intensity of the content302may also be altered such that the intensity of the content302appears to be uniform from the driver's perspective. For example, portions of the content302projected farthest from the driver may be altered to be brighter (not shown) than portions of the content302projected closer to the driver such that brightness of the content302appears to be uniform from the perspective of the driver.

FIG. 4illustrates example content402that may be projected by the content projecting system200ofFIG. 2on a back surface404of a semi-trailer406. The content402may generally correspond to the content106as described with reference toFIG. 1. As illustrated inFIG. 4, projection surfaces are not limited to roads but can include the backs of vehicles in front of the vehicle in which the content projection system is installed. Alternately or additionally, the content402may be projected on other surfaces, such as billboards, buildings, earth, vegetation, and the like (not shown).

In some embodiments, the content projecting system may avoid projecting content402onto particular surfaces. For example, the content projecting system may avoid projecting content onto windows, minors, people, and/or other surfaces to the extent that doing so may harm and/or distract other people, including other drivers. To this end, the content projecting system may include cameras and/or sensors to identify surfaces to be avoided when projecting content402. Alternately or additionally, the content projecting system may use information collected by the safety module212as described with reference toFIG. 2to identify surfaces to be avoided when projecting content402.

FIGS. 5A-5Billustrate other example content502A,502B that may be projected by the content projecting system200ofFIG. 2from the perspective of a driver of a corresponding vehicle.FIGS. 5A-5Billustrate how the content projecting system may create a user interface that the driver may interact with without requiring the driver to focus on a user interface inside of the vehicle.

In more detail, the content502A ofFIG. 5Amay be changed in response to an input from an occupant and/or a driver of the vehicle. The content502A is projected onto a projection surface508. The content502A may display information relating to an option available to the driver. In some embodiments, the driver may provide input at an input interface affixed to a steering wheel of the vehicle. The input interface may include an input that may allow the driver to select the option relating to the content502A. For example, if the driver selects the option displayed inFIG. 5A, the vehicle's radio may tune to 88.3 FM and the station's audio broadcast may be played over the vehicle's audio system.

The content502A may include a down-facing arrow504to indicate to the driver that a down input may present the driver with additional options. If the driver selects the down input, e.g., by pressing a corresponding button on the steering wheel of the vehicle, the content502A may change. Although shown as a down-facing arrow504, other indicators may be used to indicate that additional options may be available to the driver.

In response to the driver's input, the content502A ofFIG. 5Amay be changed to the content502B ofFIG. 5Band to a new option for the driver to potentially select. As illustrated inFIG. 5B, the content502B includes an up-facing arrow506, which may indicate to the driver that an up input allows the driver to return to the previous content502A and the previous option ofFIG. 5A. The content502B may also include the down-facing arrow504.

The embodiments described herein may include the use of a special purpose or general-purpose computer including various computer hardware or software modules, as discussed in greater detail below.

Embodiments described herein may be implemented using computer-readable media for carrying or having computer-executable instructions or data structures stored thereon. Such computer-readable media may be any available media that may be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media may include tangible computer-readable storage media including random-access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other storage medium which may be used to carry or store desired program code in the form of computer-executable instructions or data structures and which may be accessed by a general purpose or special purpose computer. Combinations of the above may also be included within the scope of computer-readable media.