Vehicle control panel with passenger detection for function enablement

The invention is an apparatus used for providing control of functions of a vehicle in response to touch commands of an authorized passenger. The functions for which the authorized passenger is provided control are disallowed to the driver when the vehicle is moving. The passenger is authorized with two-factor authentication. The first of the two factors is the fingerprint of the passenger which is enrolled before vehicle movement. The second factor is the location of the passenger. The first factor is used when an occupant attempts to control disallowed functions. The second factor is used when an occupant attempts to enroll a fingerprint. A display panel displays a prompt to enroll a fingerprint before vehicle movement, uses a fingerprint interface to enroll an original fingerprint, and instantaneously captures fingerprints of those attempting to control disallowed functions and compares them to enrolled fingerprints.

CROSS REFERENCE TO RELATED APPLICATIONS

Not Applicable.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH

Not Applicable.

BACKGROUND OF THE INVENTION

Touchscreen display panels in vehicles provide centralized controls which respond to touching of the screen in order to access menus for adjustments and/or data entry. Accessing or adjusting certain systems and functions of vehicles have been disabled to drivers when the vehicle is moving in order to reduce distractions. For example, a vehicle navigation system using GPS locations and maps to provide route planning and guidance include user actions that can be taken by a driver while moving, such as adjusting a map view. However, other actions such as inputting an address for a route destination usually requires that the vehicle be motionless to ensure that a driver does not perform this task while moving.

When a passenger is present, it may be desirable to enable the functions which are denied to the driver to be accessible to the passenger. However, a determination of which vehicle occupant is operating the touchscreen display panel needs to be made. An existing method for detecting which occupant is touching the touchscreen display panel uses proximity sensors, such as ultrasonic detectors. However, incorporating a system to use proximity sensors in the vehicle interior may not have the desired reliability and accuracy by themselves. Another method uses signal modulation devices which pass unique signals from the occupant seats through the occupants to the touchscreen display which can be detected to identify where the active user is seated. However, these may have disadvantages relating to system cost, long term reliability, and consistency of performance.

Fingerprint sensors associated with a touchscreen display screen have been used to limit access to touchscreen functions according to specifically identified individuals, but knowing the identity of a person accessing the touchscreen would usually not ensure that the person was not in the driver seat.

SUMMARY OF THE INVENTION

The present invention relates in general to passenger availability of driver-restricted functions via a vehicle display panel. More specifically, the invention provides control of vehicle functions, operated by use of a display panel, to a vehicle passenger (i.e., non-driver) that has been identified and localized to the passenger seat before vehicle motion.

The present invention uses two-factor authentication in order to authorize an occupant and ensure this occupant is not the driver. The first of the two factors depend on a fingerprint of an occupant. The invention is equipped with a fingerprint interface integrated into the display panel which captures fingerprints for enrollment before vehicle movement and, thereafter, captures instantaneous fingerprint data as anyone is operating the display panel. The second factor in the two-factor authentication is a detection sensor which ensures that the occupant attempting to enroll their fingerprint (or subsequently attempting to access a restricted menu function) is sitting in a passenger seat. The detection sensor does this by detecting the seat location of an active user during fingerprint enrollment. Enrollment is completed before the vehicle is moving.

When the vehicle starts moving, functions that have been predetermined to be disabled for the driver become operational when accessed using the enrolled fingerprint. Any finger may potentially interact with the display panel when the vehicle is moving. However, the predetermined functions will only respond if a passenger fingerprint was enrolled, and an instantaneous fingerprint data matches the enrolled fingerprint. The enrolled fingerprint will unenroll when the passenger leaves the passenger seat, or the vehicle is turned off.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

The invention involves providing control of functions of a vehicle to an authorized passenger. These functions are disallowed to a driver while the vehicle is moving. To control the predetermined disallowed functions, a fingerprint in contact with a display panel must match an enrolled fingerprint. This fingerprint is enrolled before vehicle motion, ensuring that the driver is not using the disallowed functions. A detection sensor monitors fingerprint enrollment to ensure that an occupant seated in a passenger seat is the source of the fingerprint. The option to enroll will not present itself unless an occupant is detected in the passenger seat. The enrolled fingerprint is unenrolled when the passenger exits the passenger seat. An array of layers is present on an exterior face of the display panel. One of these layers is a fingerprint interface which allows fingerprint enrollment as well as the collection of instantaneous fingerprint data for comparison during normal operation.

FIG.1shows an interior of a vehicle10which has a driver seat13and a passenger seat14. Driver seat13is occupied by a driver11and passenger seat14is occupied by a passenger12. An occupant sensor18in passenger seat14determines when passenger12is sitting or has exited the seat. Also, within the interior of the vehicle, a controller15is connected to a touchscreen display panel16and data memory17. Display panel16includes a fingerprint interface31(FIG.3) capable of scanning a fingerprint. These scans can be transferred by controller15to data memory17. A right arm/hand of driver11is typically used to manipulate touchscreen display panel16, and a left arm/hand of passenger12is typically used to manipulate touchscreen display panel16. In any event, the arm/hand of driver11approaches touchscreen16from a driver side of vehicle10and the arm/hand of passenger12approaches touchscreen display panel16from a passenger side of vehicle10, which can be monitored using various kinds of known sensor arrangements.

FIG.2shows display contents on touchscreen display panel16. A main menu for accessing controllable functions may include static selection areas21in order to continuously provide shortcuts for accessing main systems or accessories. Touchscreen display panel16further provides sub-menu selection areas22which may change dynamically by navigating through the menus. When the vehicle is in motion, movement through the menu functions may depend upon groupings of functions into those that may be always available and those that can be operated only by the enrolled passenger. In order to operate these restricted functions while moving, fingerprint interface31(FIG.3) will capture instantaneous fingerprint data of any finger touching touchscreen display panel16and compare it to enrolled fingerprint data. A request for a restricted function will only be executed if the instantaneous fingerprint data matches enrolled fingerprint data. Unrestricted functions will not have any authentication requirements and therefore can be used freely.

FIG.3depicts a finger34interacting with display panel16. Display panel16has an array of layers including a cover layer33, a touch sensitive layer35(e.g., a capacitive matrix), a fingerprint detection layer36(e.g., an image capture layer), and a light emitting (e.g., LCD OR OLED) display matrix layer37. Touch sensitive layer35is connected to a touch interface32, and fingerprint detection layer36is connected to a fingerprint interface31. Cover layer33can be comprised of a transparent material including glass or plastic. Touch interface32determines a point of contact where a finger touches the screen in order to activate menu functions21and sub-menu functions22as well as other functions such as scrolling. Fingerprint interface31may utilize an optical detector or method, a capacitive detector or method, or an ultrasonic detector or method to capture fingerprint data of a finger interacting with display panel16as known in the art using commercially available devices. Other methods may also be used to detect fingerprints. Touch interface32, fingerprint interface31, and a display driver30are connected to controller15. Display driver30drives the presentation of the menu selections and other information onto touchscreen display panel16.

FIG.4depicts interactions of controller15with other vehicle components. The controller15can receive stored data signals from memory17, touch signals from touchscreen display panel16, occupant location signals from a detection sensor40, occupancy sensor signals from occupant sensors18, and vehicle and/or wheel speed signals from a powertrain control module (PCM)42or other module (i.e., to determine a moving or stationary state of the vehicle). Controller15is also connected to controlled functions and/or actuators23which carry out the commanded actions selected by a user via the touchscreen menus. Detection sensor40performs occupant sensing in a manner that determines whether a finger interacting with touchscreen display panel16corresponds to the driver or the passenger. For example, detection sensor40may be comprised of a camera, interior radar sensors, or ultrasonic sensors. Since differentiation between the driver and passenger may be subject to occasional errors or deception, the two-factor authentication of the invention using fingerprint enrollment may provide a more robust determination of the seating position of a user that accesses the touchscreen.

When the vehicle is started and occupant sensor18in the passenger seat detects a seated occupant, fingerprint enrollment is initiated prior to vehicle movement by prompting the passenger to contact the touchscreen with a fingerprint. When the passenger contacts touchscreen display panel16with a finger, detection sensor40is used to detect whether the origin of the finger is via an arm/hand which corresponds to the passenger. Thus, a finger contacting touchscreen display panel16can be traced by detection sensor40back to an origin point corresponding to either the driver seat or passenger seat. If the origin point of the fingerprint is the passenger seat, then fingerprint data received via fingerprint interface31(FIG.3) is saved into data memory17by controller15as enrolled fingerprint data. When the vehicle is turned off, or when occupant sensor18in the passenger seat no longer senses an occupant, any enrolled fingerprint data will be deleted from data memory17.

FIG.5shows a flowchart describing one preferred method. Step50is the beginning of passenger detection. In step51, an occupant sensor in the passenger seat is used to determine whether a passenger is in the seat. If a passenger is not detected in the passenger seat, step52bindicates no action will be taken. If a passenger is detected in the passenger seat, then the display panel will display a message in step52ato prompt the passenger to touch the touchscreen in order to enroll their fingerprint. An audio prompt can also be played using an audio system of the vehicle. The message may include a reminder to the passenger that enrollment of a fingerprint will no longer be available when the vehicle starts moving. In step53, the fingerprint interface monitors for a fingerprint. If a fingerprint is obtained from a finger that is in contact with the display panel, the detection sensor is utilized as a second factor of authentication in order to ensure that the fingerprint being received corresponds to the occupant of the passenger seat. In step54, a determination is made as to whether a response in the form of a fingerprint was received from the passenger before timeout and that the fingerprint has been recorded. Timeout occurs when the vehicle starts moving or after a predetermined amount of time lapses after the prompting message. If no response was received before timeout, step55bensures that touch functions for disallowed functions remain disabled for all occupants while the vehicle is moving. When the vehicle stops, however, the method may return to step52ato provide another opportunity for the seated passenger to perform fingerprint enrollment.

When step54determines that the fingerprint of the passenger has been enrolled, then the functions that are disallowed to the driver while the vehicle is moving can be made available to the passenger with the enrolled fingerprint in step55a. In step56, the occupant sensor is used to determine whether the passenger is no longer in the passenger seat. If the passenger is no longer seated, the recorded fingerprint is deleted from enrollment in the memory in step57.

FIG.6shows a flowchart describing one preferred method for operating the touchscreen display panel and control system. In step60, a determination is made as to whether a finger press is detected. If not, the touch interface will remain alert for potential finger presses. Once the touch interface detects a finger press, a determination is made in step61as to whether the vehicle is moving. If the vehicle is not moving step62bshows that all functions are available. If the vehicle is moving, then a determination is made in step62aas to whether a touch request corresponds to a restricted function. If the function that is requested for use is not a potentially disallowed function, then the corresponding action is performed in step63bsince there is no authentication required in order to operate that function. If the request is for a disallowed function, then a determination is made in step63aas to whether the fingerprint of the requestor matches the enrolled fingerprint of the passenger. To determine this, the instantaneous fingerprint data of the requester will be compared to enrolled fingerprint data. If there is no match, then no action is taken in step64b(e.g., the action is skipped). If there is a match, then the requester is determined to be the authorized passenger with a fingerprint enrolled in accordance with the two-factor authentication of this invention. Therefore, the vehicle will proceed with the action that the passenger requested. Finally, a return is made to step60to process additional user actions.

Fingerprint enrollment may be adapted to be performed at various times or circumstances. Each time the vehicle is started up, any enrolled fingerprints from previous trips are already deleted from memory, and the apparatus prompts a passenger to enroll a fingerprint, if desired. A fingerprint can also be enrolled by the passenger at later times when the vehicle stops. A vehicle stop may be detected by the powertrain controller. For example, if the vehicle comes to a temporary stop while the transmission remains in drive, enrollment of a fingerprint by the passenger may be prompted for and accepted. If the driver and passenger were to switch seats during a temporary vehicle stop, the enrolled fingerprint of the person moving from the passenger seat to the driver seat would be deleted in response to the passenger seat going empty. A new passenger enrollment inFIG.5would start when a new passenger sat down.