Digital windshield information system employing a recommendation engine keyed to a map database system

Disclosed is a method and system for recommending locations keyed to a map database system and providing navigation instructions to the recommended locations to a driver of a vehicle by gathering actual statistics about the preferences of the user and/or by comparing the user to population data to create recommendations in accord with the preferences of the population.

BACKGROUND OF THE INVENTION

It is well known that windshield lighting systems on airplanes and superimposed over pilot helmet masks can give illuminated cues as to conditions that the pilot or co-pilot should be aware of. These systems may also be translated to an automobile windshield to give the same sort of information, safety and car maintenance information to a driver. It is also well known that Global Positioning Satellite (GPS) and computer based systems now exist on vehicles to pass information beyond immediate, navigational and maintenance information onto drivers and passengers alike.

Currently, the use of GPS and in-vehicle recommendation systems use voice activation or mounted screen on the dashboard to display useful information about goods, services and directions. Certain services also hold a user's favorite selections and history to make them easily accessible to the user via the system interface. Services, such as OnStar®, have made this practice increasingly popular among drivers and passengers by providing useful directions, recommendations about goods, food, entertainment and services and suggested maintenance. Windshield display systems have functioned solely for directional, gauge monitoring, maintenance info and warning systems related to external and internal conditions.

Conventional models address the windshield system and the recommendation elements of services such as the OnStar®; system separately. The two elements do not merge in any current deployments in the marketplace. Vehicle recommendation systems use history and preferences input by the user to generate recommendations, but those recommendations are communicated to the user only when the user requests the recommendations. There is no implied preference or collaborative filtering utilized to generate additional recommendations based upon trends of the user or a relatable community of data to the user's data. As stated previously, recommendation systems such as OnStar® and the windshield guidance and warning system displays have not merged in the field. Conventional models of the windshield system utilize data and sensors, which may also appear on the dashboard, to provide the driver and or co-pilot with data fed through the sensor and gauge system to a microprocessor which transmits the corresponding data to lighted displays deployed on or within the windshield glass. These displays are coded to represent the data obtained by the gauges and sensors in useful ways to the driver/pilot and or co-pilot.

Unfortunately, the existing conventional uses have certain limitations in distribution and deployment. First of all, the OnStar® systems and the windshield interface communications systems run in completely separate formats and are not integrated to display non-critical driving information upon the windshield. Secondly, the display of OnStar® type recommendations and preferences does not provide a collaborative filtering or advanced data analysis tool utilizing research trend information to generate additional recommendation for the user to generate additional information which could be deployed upon the windshield interface system.

Accordingly, there is a need for an integrated system that combines all functions of the windshield warning system with all functions of the OnStar® driver navigation, assistance and recommendation systems. Additionally, the OnStar® style system needs to integrate user recommendations based upon external data and fuse that service into the windshield interface deployment. Further, updated sensor and lighting technology need to be integrated into the windshield system to maximize the effectiveness and durability of the windshield interface system.

SUMMARY OF THE INVENTION

The present invention relates to the creation of a windshield visual and audio system that reflects safety instructions, GPS data of interest and the utilization of input and learned data to create real time alerts and recommendations for the user.

DETAILED DESCRIPTION OF THE INVENTION

The present invention, in accordance with one embodiment relates to the creation of a windshield-displayed guidance system10that incorporates safety, guidance and GPS information along with recommendations for the vehicle specific populations based upon user input, history, research and collaborative filtering techniques. The system10may be automated, voice activated or controlled by a switch that is installed in the vehicle or as an external add-on or wireless control. The system10also allows for the operator(s) to initiate contact with parties outside the vehicle based upon operator command or system recommendation.

FIG. 1illustrates one embodiment of the present invention.FIG. 1illustrates the typical environment in the front seat of an automobile, including a windshield100, rear view mirror102, steering wheel108, and dashboard114. The embodiment illustrated inFIG. 1includes a GPS110, a control panel112, speakers104, a voice activation microphone106, and a system display area116located at the windshield.

The system display area116may be formed in several ways. The system display area116may be formed of transparent and organic light-emitting diodes (OLED) formed on the windshield100or projected from the dashboard114onto the windshield100. The system display area116may alternatively be formed by a fiber optic lighting display screen embedded in the windshield or projected from the dashboard onto the windshield. The system display area116may receive power from the car battery118or from an alternative power source (not shown) such as hand crank, solar power, wind power, or regenerative braking.

The hardware of the system10utilizes either a hardwired relay from a CPU into the dashboard114or utilizes tiny wireless transmitters embedded in, or on the external or internal surface of the windshield100in tandem with the lighting system. The system10illuminates either color coded lights or lighted messages in text or graphical symbols based upon information transferred from the CPU and software logic stored in the memory and hard drive or storage area of the system10. The illuminated LED lights are powered to light by the system10in a logical method based upon the words or lighted advisory to be deployed. The lighted LED lights reside in a grid that makes it possible for all messages or coded advisories to be lighted in the appropriate color based upon the installed grid of lights in the windshield100. This data may be immediately transferred upon receipt from an external sensor, internet, virtual private network, wireless internet or local vehicle information or other similar system data.

FIGS. 2 through 9illustrate various exemplary embodiments of messages that may be provided to a driver through the system display area116and the speakers104.FIG. 2shows a general alert200on the system display area116, which may be accompanied by more detailed information via the speakers104.FIG. 3illustrates a more specific warning related to a detected object in the road and an advisory to slow down300on the system display area116and an accompanying message being broadcast via the speakers104. The display ofFIG. 3uses sensors1000—described below—located on the vehicle1002to detect the object or road hazard in the path of the vehicle.FIG. 4illustrates another embodiment in which the system display area116and speakers104provide a visual warning400and an audio warning402regarding an approaching emergency vehicle and an advisory to move to the side of the road. The display ofFIG. 4uses sensors1000—described below—located on the vehicle1002to detect the presence of the emergency vehicle.FIG. 5illustrates an embodiment in which the system display area116provides a warning about approaching traffic500. The display ofFIG. 5uses sensors1000—described below—located on the vehicle1002to detect the oncoming vehicle.FIG. 6illustrates a warning related to excessive speed600on the system display area116. The visual warning600may be accompanied by an audio warning from the speakers104. The warning illustrated inFIG. 6could either be triggered by sensors1000—described below—located on the vehicle1002or by the GPS110referencing map data related to speed limits for the roadway.FIG. 7illustrates a warning700related to the operating condition of the automobile displayed on the system display area1116and also provided in audio form (warning message702) via the speakers104.FIG. 8illustrates the presentation of directions to a place and an advertisement for the place800,802on the system display area116and speakers104respectively. The advertisement800,802alternatively could provide only the advertisement or only the directions to the location.FIG. 9illustrates the presentation of a generalized alert900in the lower corner of the windshield100that prompts the driver to get further information. The generalized alert900can be varied by color, intensity, or by flashing on and off at different rates. For example, an important alert, such as an upcoming sudden stop in traffic, may result in a red alert prompt900being placed on the windshield100. On the other hand, a green alert prompt900being placed on the windshield100may result when the system is recommending a “leister” location (e.g., McDonalds®) to the driver.

The data that is relayed to the windshield arrives from different sources with different priorities. For example in one embodiment immediate safety issues are displayed before maintenance issues which are displayed before vehicle directions (unless an immediate action is needed), which are displayed before system recommendations.

FIG. 10illustrates one possible way in which sensors1000(such as standard sensors or the new IEEE 1451.4 sensors that offer a standard interface and protocol by which a sensor can describe itself over a network) provide information on road traffic and road hazards. This makes the sensor not only a calibrated gauge or reader of information but also a part of the communication pipeline that enables a wireless infrastructure to be implemented without local components for communication or function in a wired infrastructure with fewer components to be implemented.

Safety information, such as road hazards, information on other vehicles, or icy conditions, are transferred from the sensors1000to the CPU. In the CPU, the sensor data is processed and sent to the invention program10to determine if the sensor data merits a warning to the driver. Other safety information can be filtered into the invention system10from GPS110, the internet (a global computer network) or via satellite including road conditions, local, regional, specific destination, national or global safety warnings depending on the system settings and thresholds. Destination directions can also be sent to the vehicle via global computer network (e.g. the internet), GPS or other wireless communication system. The invention system10can provide directions in accord with the driver's request, and in cases where the driver has not requested directions, destinations that the user frequently travels to that are matched up by the system because of the route the user is traveling may be presented to the user, by the system10, as destination options along the way.

Recommendation programming software enhances the invention system10function in a variety of ways. Recommendations can be based upon direct user requests1102(FIG. 11) that are input into the system by the user which identifies both the user's specific favorite locations, such as Regina's Pizzeria on Thatcher Street in Boston and Maxie's Art Gallery, as well as category favorites, such as seafood restaurants and art galleries. The system10is built upon a four pronged recommendation engine in a preferred embodiment.

The first prong is based upon user requests1102that are stored and accounted for by the system10in accordance with driver-requested locations and the time of the requests. This data is stored on a hard drive1112of the system10or can be stored in an ancillary remote server1106, accessible via wireless transmission1104, called upon by the system10. This data is then configured with the database programming software rules, which are custom programming rules dedicated to presenting the user with the content they want, at the time the user wants it, without the user having to ask for the content before it is displayed. Driver location requests are logged via a tagging system to note in the recommendation database1108what content is requested by the user at what time. After some number of requests, the driver's request habits become recommendations. For example, if a user requests directions to the nearest McDonalds® between 7-7:30 AM, or simply visits a McDonalds®, three times in a row during the week, then under a database rule, a request made more than three times could become a recommendation default setting. The user request model could use any number of repeated requests to trigger the creation of a recommendation default setting. The recommendation program then queues the software to find the nearest McDonalds® every morning at 7 AM. By using a user's behavior as a primary source, the invention system10begins to automatically recommend destinations to the user.

The second prong is based on alternate user data obtained by user consent, such as credit card bills that describe user patterns, demographic information supplied by the driver (user), questionnaire(s) filled out by the user, data and cookies that may be used to glean, update, and store the user's online usage patterns. For example, if the driver purchases McDonalds® coffee every morning with a credit card at 7:00 AM, the invention system10may recommend a nearby coffee retailer location to the user at 7 AM based on the authorized credit card data.

The third prong uses research data to infer the driver's preferences, (i.e., a user likes restaurant A; research shows that people who like restaurant A also like restaurant B, so the invention system10recommends restaurant B to the user). Based upon research model recommendation engines, a sample of driver data is utilized to generate location matches in the system10based upon the research of industry professionals. This is a server based platform1204(FIG. 12) that may be updated based upon new content being made available to the overall system10. This content may be searchable by the vehicle system10via wireless transmission1104.

The fourth prong uses collaborative filtering where drivers using the same service may permit their data to be anonymously gathered in a central database to infer the driver's preferences. This system harnesses anonymous user demographics and location information stored on one set of hard drives1302(FIG. 13such as a multi-terabyte raid array. Another set of load balancing servers1304queues incoming and outgoing queries to the system10. A third set of servers1306assigns and matches drivers and queries and assigns location recommendations based upon theories of collaborative filtering for users with a certain number of content matches, such as a 25% overall content match rate, as logged in the database1306between each other from projector system10use. Resultant locations are then recommended to the driver-user by the collaborative filtering software. This is accomplished by a programming engine presenting location recommendations that the user does not have in his list of requested content1108within the system10from another user's list of preferred locations based upon their usage of the projector system10. For example, if a driver has repeatedly requested directions to McDonalds® where he orders coffee, then collaborative filtering may show that other individuals in the database1306(i.e., collaborators) who like McDonalds® coffee also tend to like shopping for clothing at The Gap®. As a result, the system10may recommend The Gap® to the driver. Before presenting the driver-user with a match, the system10scans available locations to make sure that the match is available.

While the four prongs of the recommendation engine have been described separately, several prongs may be used concurrently to offer recommendations to the user. For example, locations the user has requested or visited (the first prong) and purchasing habits of the user (the second prong) may be combined to provide data to a collaborative filtering model (the fourth prong). Furthermore, the recommendation engine may cycle through each of the four prongs.

FIG. 16illustrates one operating system or processor program10embodying the present invention and implementing the foregoing features. Input16includes sensor data (object motion, detected audio, detected hazards, etc.) from sensors1000, user data (search request pattern, demographic profile, shopping/purchasing patterns, preferences)1102,1202which is input explicitly or implicitly by the user, and GPS110location data (from a supporting map database). The combination of GPS110data and sensor1000data form vehicle implicit or explicit actions that trigger certain search requests as shown at1110inFIGS. 11-13discussed above and at step14inFIG. 16.

From input16, invention system10determines (at step12) a user requested search as explicitly input (e.g. via voice activation microphone106) by the user and/or as implicitly formed by system10tracking user requests and driving/location patterns over time and determining patterns to search. At step18, system10determines search requests based on other user activity and information collected such as described above in the second through fourth prongs of the recommendation engine ofFIGS. 11-13.

Next, at step20, invention system10performs the determined search requests from Steps12,14, and18using database servers1108,1204,1302and1306described above. From the results of searches by step20, step22generates and prioritizes warnings, alerts, related indicators, and/or recommendations which are output in a manner suitable for rendering on windshield display area116and/or through speakers104as described above inFIGS. 1-9. The output recommendations include details of recommended locations such as:

geographic information sufficient to provide driving directions;

a respective telephone number per location;

logos related to the locations; and

events related to the locations.

FIG. 14illustrates a computer network or similar digital processing environment in which the present invention may be implemented.

Client computer(s)/devices50and server computer(s)60provide processing, storage, and input/output devices executing application programs and the like. Client computer(s)/devices50can also be linked through communications network70to other computing devices, including other client devices/processes50and server computer(s)60. Communications network70can be part of a remote access network, a global network (e.g., the Internet), a worldwide collection of computers, Local area or Wide area networks, and gateways that currently use respective protocols (TCP/IP, Bluetooth, etc.) to communicate with one another. Other electronic device/computer network architectures are suitable.

FIG. 15is a diagram of the internal structure of a computer (e.g., client processor/device50or server computers60) in the computer system ofFIG. 14. Each computer50,60contains system bus79, where a bus is a set of hardware lines used for data transfer among the components of a computer or processing system. Bus79is essentially a shared conduit that connects different elements of a computer system (e.g., processor, disk storage, memory, input/output ports, network ports, etc.) that enables the transfer of information between the elements. Attached to system bus79is I/O device interface82for connecting various input and output devices (e.g., keyboard, mouse, displays, printers, speakers, etc.) to the computer50,60. Network interface86allows the computer to connect to various other devices attached to a network (e.g., network70ofFIG. 14). Memory90provides volatile storage for computer software instructions92and data94used to implement an embodiment of the present invention (e.g., recommendation engine and processor program10detailed above). Disk storage95provides non-volatile storage for computer software instructions92and data94used to implement an embodiment of the present invention. Central processor unit84is also attached to system bus79and provides for the execution of computer instructions.

For example, computer architecture ofFIGS. 14 and 15are for purposes of illustration and not limitation. Other configurations are suitable. Likewise the term “user” may be the driver or a passenger or a combination in the subject vehicle.