MONITORING SYSTEM WITH DYNAMIC USER MENU FEATURES

A monitoring system for a vehicle communicates with a user interface and includes a vision system that has a sensor configured to capture a presence of at least one vehicle occupant. A control system includes a processor configured to determine that the at least one vehicle occupant is attempting to interface with a user menu and determine a seating location of a first vehicle occupant attempting to interface with the user interface. The processor is further configured to categorize the first vehicle occupant attempting to interface with the user interface by the seating location and transmit an instruction to generate the user menu on the user interface specific to the categorization.

FIELD OF THE DISCLOSURE

The present disclosure generally relates to a monitoring system and, more particularly, to a monitoring system configured to categorize a vehicle occupant and generate a user menu based on the categorization of the vehicle occupant.

SUMMARY OF THE DISCLOSURE

According to one aspect of the present disclosure, a monitoring system for a vehicle communicates with a user interface and includes a vision system that has a sensor configured to capture a presence of at least one vehicle occupant. A control system includes a processor that is configured to determine that the at least one vehicle occupant is attempting to interface with a user menu and determine a seating location of the first vehicle occupant attempting to interface with the user interface. The processor is further configured to categorize the first vehicle occupant attempting to interface with the user interface by the seating location and transmit an instruction to generate the user menu on the user interface specific to the categorization.

According to another aspect of the present disclosure, a monitoring system for a vehicle communicates with a user interface and includes a vision system that has at least one imaging device configured to capture a first image type of at least one vehicle occupant. A control system includes a processor that is configured to determine that the at least one vehicle occupant is attempting to interface with a user interface and determine a seating location of the vehicle occupant attempting to interface with the user interface with the first image type. The processor is further configured to categorize the vehicle occupant attempting to interface with the user interface by the seating location and transmit an instruction to generate a user menu on the user interface specific to the categorization.

According to yet another aspect of the present disclosure, a monitoring system for a vehicle communicates with a user interface and includes a vision system that has at least one imaging device configured to capture at least one image type of a vehicle occupant. A control system includes a processor that is configured to extrapolate a 3-dimensional (“3D”) representation of the vehicle occupant from the at least one image type and categorize the vehicle occupant by a seating location of the 3D representation. The processor is further configured to identify that the vehicle occupant is reaching for the user interface and transmit an instruction to generate a user menu on the user interface specific to the categorization.

DETAILED DESCRIPTION

The present illustrated embodiments reside primarily in combinations of method steps and apparatus components related to a monitoring system configured to categorize a vehicle occupant and generate a user menu based on the categorization of the vehicle occupant. Accordingly, the apparatus components and method steps have been represented, where appropriate, by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein. Further, like numerals in the description and drawings represent like elements.

Referring toFIGS.1-7D,10, and11, reference numeral10generally designates a monitoring system for a vehicle12that communicates to a user interface14within the vehicle12. The monitoring system10includes a vision system15A that has a sensor16(FIG.2) configured to capture a presence of at least one vehicle occupant18A-18D. A control system100includes a processor104configured to determine that a first vehicle occupant18A of the at least one vehicle occupant18A-18D is attempting to interface (i.e., touch interface) with the user menu and determine a seating location20A-20D of the first vehicle occupant18A attempting to interface with the user interface14. The processor104is further configured to categorize the first vehicle occupant18A attempting to interface with the user interface14by the seating location20A-20D and transmit an instruction to generate a user menu22(FIG.2) on the user interface14specific to the categorization.

With continued reference toFIGS.1-7D,10, and11, the categorization may include a passenger categorization and a driver categorization. More particularly, the user menu22generated specific to the driver categorization may be different than the user menu22generated specific to the passenger categorization. In this manner, based on the categorization, different options may be generated on the user menu22that relate to controlling features specific to the region (e.g., seating location20A-20D) of the at least one vehicle occupant18A-18D and/or additional features that are appropriate to only one of the passenger categorization or the driver categorization. For example, features specific to the region of the at least one vehicle occupant18A-18D may include features related to adjusting a seat24A-24D specific to the seating location20A-20D, a temperature regulation specific to the seating location20A-20D, and/or additional features that are specific to a region in the vehicle12that will be described in greater detail below. The features that are appropriate to only one of the passenger categorization or the driver categorization, on the other hand, may be appropriate on the basis of safety, driving rules and regulations (e.g., regionally specific), and/or the like. For example, if the vehicle12is in motion, certain features may not be accessible to the first vehicle occupant18A with a driver categorization because the features are inappropriate, such as the availability of pairing a mobile device26(FIG.10), obtaining GPS directions, video calls, exploring media, and/or the like. Because features that are appropriate on the basis of categorization are generated by the control system100(e.g., the processor104), the control system100can be updated on the basis of safety concerns, updated driving rules and regulations, regionally specific driving rules and regulations (e.g., on the basis of GPS coordinates of the vehicle12), and/or the like. As will be described in greater detail below, the processor104may be configured to determine that the at least one vehicle occupant18A-18D is attempting to interface (i.e., touch interface) with the user interface14by one of proximity of the at least one vehicle occupant18A-18D reaching for the user interface14or by the at least one vehicle occupant18A-18D directly interfacing with the user interface14.

With reference now toFIGS.1-5, the sensor16may be configured as an imaging device, such as a camera that is configured to capture an image type28(e.g., a first image type28). The control system100(e.g., the processor104) may be configured to determine the seating location20A-20D with the image type28when categorizing the at least one vehicle occupant18A-18D. In some embodiments, the image type28may include two-dimensional (“2D”) information (FIG.5) about an interior cabin30of the vehicle12. For example, the 2D information may include a 2D representation31(e.g., a 2D skeletal representation) of the at least one vehicle occupant18A-18D. In some embodiments, the image type28may include a plurality of image types28captured in a sequence32. The control system100(e.g., the processor104) may be configured to identify that the at least one vehicle occupant18A-18D is reaching for the user interface14based on the sequence32or an individual image type28and generate the user menu22specific to the categorization before the at least one vehicle occupant18A-18D interfaces with the user interface14. In some embodiments, the monitoring system10may include a flood illumination source34that projects a flood illumination36within the interior cabin30. The flood illumination36may include light in the visible and/or infrared spectrum such that the sensor16(e.g, imaging device) captures the flood illumination36in the image type28. In this manner, the image type28can include 2D information about the interior cabin30in low light conditions.

With reference now toFIGS.3A-3C, a sequence32of the first image types28are illustrated sequentially. More particularly, inFIG.3A, none of the vehicle occupants18A-18D are interfacing with the user interface14. InFIG.3B, a vehicle occupant18B that has a passenger categorization is attempting to interface (i.e., touch interface) with the user interface14. In this manner, the control system100(e.g., the processor104) may determine that the vehicle occupant18B is attempting to interface (i.e., touch interface) with the user interface14(e.g., through direct interfacing), categorize the vehicle occupant18B, and transmit an instruction to generate the menu22. InFIG.3C, two vehicle occupants18A,18B that have different categorizations are attempting to simultaneously interface with the user interface14. In this manner, the control system100(e.g., the processor104) may determine that the vehicle occupants18A,18B are both attempting to interface (i.e., touch interface) with the user interface14(e.g., through direct interfacing), categorize the vehicle occupants18A,18B, and transmit an instruction to generate the menu22with a region controllable by one of the vehicle occupants18A and a region controllable by the second vehicle occupant18B. As will be described in greater detail below, a menu22may be generated for more than one of the vehicle occupants18A-18D.

With reference now toFIGS.1-6, the control system100(e.g., the processor104) may be configured to measure a depth of the 2D representation31(e.g., the 2D skeletal representation) and extrapolate a 3-dimensional (“3D”) representation33(e.g., a 3D skeletal representation) of the at least one vehicle occupant18A-18D interfacing with the user interface14by reviewing the captured presence obtained by the sensor16. Based on the 3D representation33, the control system100(e.g., the processor104) may be configured to categorize the at least one vehicle occupant18A-18D interfacing with the user interface14by the seating location of the 3D representation33(e.g., the 3D skeletal representation). The control system100(e.g., the processor104) may be configured to identify that the 2D representation31(e.g., 2D skeletal representation) and/or the 3D representation33(e.g., the 3D skeletal representation) is reaching for the a user interface14based on the sequence32of the image types28or a specific one of the image types28and generate the user menu22specific to the categorization before the at least one vehicle occupant18A-18D touch interfaces with the user interface14.

With reference now toFIG.4, the vision system15A is configured under a first construction and may include a structured light source38and operates under the principles of structured light. Under the principles of structured light, the structured light source38projects a structured light illumination39substantially within the infrared spectrum. The structured light illumination39may be captured in a structured image type40. In some embodiments, the structured light illumination39is distributed as a light spot array with a plurality of light spots41(FIG.5). More particularly, the structured light source38may include a least one laser diode (e.g., a plurality of laser diodes) and an optical lens42. The optical lens42may include a collimation element44and a diffractive element46. The collimation element44and the diffractive element46may be integrally or separately formed.

In some embodiments, the sensor16(e.g, imaging device) includes a single imaging device that captures the first image type28and the structured image type40such that the sequence32includes capturing the first image type28and the structured image type40within alternating periods of time as designated by reference numeral48. The periods of time48between capturing the first image type28and the structured image type40may be less than a centisecond, less than 75 milliseconds, between 75 milliseconds and 25 milliseconds, about 50 milliseconds, or less than 50 milliseconds. In this manner, the sensor16(e.g, imaging device) may capture a plurality of the first image type28and the structured image type40in accordance with the sequence32. However, it should be appreciated that the at least one sensor16(e.g, imaging device) may include two or more imaging devices such that the first image type28and the structured image type40are captured simultaneously in the sequence32. In some embodiments, the 2D representation31of the at least one vehicle occupant18A-18D may be extracted from the structured image type40rather than the first image type28.

The control system100(e.g., the processor104) may be configured to process the 2D representation31of the at least one vehicle occupant18A-18D to detect locations within the structured image type40that correspond to body parts (e.g., arms49and hands51) of the at least one vehicle occupant18A-18D to extract the 2D skeletal representation. In this manner, the process of extrapolating the 3D skeletal representation from the 2D representation31and, more particularly, the 2D representation31may be entirely on the basis of the structured image type40. In this manner, it is contemplated that the operation of the vision system15A may be completed with only the structured image type40(e.g., the structure light illumination39) such that the flood illumination source34may be absent or otherwise not utilized for extracting the 2D representation31and, consequently, the 3D representation33. By detecting body parts, such as arms49and hands51, the control system100(e.g., the processor104) may be configured to accurately identify that the at least one vehicle occupant18A-18D is reaching for the user interface14and generate the user menu22specific to the categorization before the at least one vehicle occupant18A-18D interfaces with the user interface14.

With continued reference toFIG.4, under the principles of structure light, the control system100(e.g., the processor104) may be configured to measure a depth of the 2D representation31with the depth information. The depth information may be obtained based on the principles of triangulation and known geometries between sensor16(e.g, imaging device), the structured light source38, and the distribution of the structured light illumination39(e.g., the light spot array). For example, the processor104may be configured to determine movement based on an outer perimeter or a center of gravity of each light spot41. The sensor16(e.g, imaging device) and the structured light source38may be closely and rigidly fixed on a common optical bench structure (e.g., within a rearview mirror assembly50or other shared location within the interior cabin30) and, based on the known spacing between the sensor16(e.g, imaging device) and the structured light source38(e.g., the laser diodes) and distribution of the structured light illumination39, the light spot41is reflected from the at least one vehicle occupant18A-18D and captured along an epipolar line, which, in turn, can be triangulated to extract a depth of the at least one vehicle occupant18A-18D.

With reference now toFIGS.4-6, the depth of the at least one vehicle occupant18A-18D (e.g., arms49and hands51) at each light spot41can then be used to extrapolate the 3D representation33(e.g., the 3D skeletal representation). Likewise, changes in depth of the at least one vehicle occupant18A-18D can be used to extrapolate the present skeletal posture, and movement of the 3D representation33to identify that the at least one vehicle occupant18A-18D is attempting to interface (i.e., touch interface) with the user interface14. It should be appreciated that, in some embodiments, the monitoring system10may not include the flood illumination source34and may instead rely on ambient lighting received from an environment. In this manner, in some embodiments, the at least one sensor16(e.g, imaging device) may be configured to capture red, green, and blue (“RGB”) information (e.g., light captured substantially in the visible spectrum) in the first image type28and the 2D representation31can be extracted from the RGB information.

With reference now toFIGS.1-3C and7A-7C, the menu22generated includes options58A-58C specific to the categorization. In this manner, it should be appreciated that the user interface14may be a touch screen device or a display device with control buttons59. In some embodiments, there may be additional categorizations other than the passenger categorization and a driver categorization. For example, the user interface14may include a pair of user interfaces14,54with the user interface14(e.g., a first user interface14) in a front portion52(e.g., a dashboard) and a second user interface54in a rear portion56(e.g., behind a front row arm rest). In this manner, some options58A-58C may be available to only the passengers, only some of the passengers, and/or only the driver. Moreover, in some embodiments, the options58A-58C may be customizable. For example, if one or more of the at least one vehicle occupant18B-18D other than the first vehicle occupant18A are children, it may be preferable to prevent opportunities to those vehicle occupants18B-18D to control certain features of the vehicle12, such as speaker volume, emergency calls, seat adjustments, and/or the like.

With reference now specifically toFIGS.1,2and7A, the menu22is shown generated on the user interface14with a first set of options58A corresponding to the driver categorization of the first vehicle occupant18A (e.g., the driver). The first set of options58A may control features that are specific to a first seating location20A corresponding to a first seat24A (e.g., the driver's seat) and/or features that are appropriate for the driver to control. While the first vehicle occupant18A (e.g., the driver) is illustrated as being seated to the left of the user interface14, it should be appreciated that because the control system100(e.g., the processor104) includes instructions for which of the options58A-58C are generated, the instructions (e.g., software) can be updated in regions where the driver's seat24A is to the right side of the user interface14. By way of non-limiting examples, features that are specific to a first seating location20A may include a volume of speakers60, radio channel selection, temperature regulation by means of a heat, ventilation, and air conditioning (“HVAC”) system62, a seat warmer located within the first seat24A, adjustment of the first seat24A, and the ability to customize settings (e.g., which options58A-58C are generated based on categorization). As it relates to features that are appropriate for the first vehicle occupant18A to control, these features may vary based on a condition of the vehicle12(e.g., whether or not it is in motion), locality of the vehicle12(e.g., what local rules and regulations require), and/or other safety parameters. For example, if the vehicle12is in motion, certain features, such as a direction search with a global positioning system (“GPS”)64, pairing a mobile device26, games/media access, and video calls, may be unavailable until the vehicle12is parked or, otherwise, autonomously controlled. Similarly, the GPS64provides location information of the vehicle12that can impact what local rules and regulations require to further modify which of the first options58A are available. For example, certain regions may permit certain features to be used by the first vehicle occupant18A that other locations do not, for example, the direction search on the GPS64, video calls, and/or the like.

With reference now specifically toFIGS.1,2,3B, and7B, the menu22is shown with a second set of options58B corresponding to the passenger categorization of a second vehicle occupant18B (e.g., a front seat passenger). The second set of options58B may control features that are specific to a second seating location20B corresponding to a second seat24B (e.g., a front passenger seat) and/or features that are appropriate for the second vehicle occupant18B to control. The second set of options58B may be the same as the first set of options58A but differ in respect to features that are specific to the second seating location20B (e.g., a seat warmer in the second seat24B, temperature regulation by means of the HVAC system62specific to the second seating location20B, adjustment of the second seat24B, and/or the like. The second set of options58B may also not be limited to the condition of the vehicle12(e.g., whether or not it is in motion) like the first set of options58A. For example, those features that can only be controlled by the first vehicle occupant18A when the vehicle12is not in motion may be controlled by the second vehicle occupant18B (e.g., the front seat passenger) without limitation (e.g., other than customized settings).

With reference now specifically toFIGS.1,2, and7C, the menu22is shown with a third set of options58C corresponding to the passenger categorization of a third and fourth vehicle occupant18C,18D (e.g., rear seat passengers). The third set of options58C may control features that are specific to a third and fourth seating location20C,20D corresponding to a third and fourth seat24C,24D (e.g., integral or non-integral rear passenger seats) and/or features that are appropriate for the third and fourth vehicle occupants18C,18D to control. The second set of options58C may be the same as the first set of options58A, but differ in respect to a passenger sub-category (e.g., an adult passenger or a child passenger) and/or unique options on the second user interface54. For example, the third set of options58C may control heating the rear portion56of the vehicle12, volume of speakers60, radio channel selection, and/or the like. When one or more of the third and fourth vehicle occupants18C,18D have a passenger sub-category of a child, the third set of options58C to control certain features of the vehicle may be further limited. For example, it may not be preferable to provide access in the third set of options58C for children to control features, such as volume of speakers60, emergency calls, radio channel selection, videos calls, pairing a mobile device26, and/or the like. On the other hand, if the passenger sub-category is an adult passenger, providing access in the third set of options58C to control these features may be allowed. In some embodiments, the passenger sub-category may be obtained by extrapolating a size of the 2D representation31(e.g., the 2D skeletal representation) and/or the 3D representation33(e.g., the 3D skeletal representation) in absolute scale with the vision system15A.

With reference now toFIGS.1,2,3C, and7D, in some embodiments, more than one set of options58A-58C may be generated on the same menu22. For example, if the first vehicle occupant18A and the second vehicle occupant18B are interfacing with the user interface14or identified as reaching for the a user interface14, simultaneously, the first and second set of user options58A and58B may be generated on the menu22. In this manner, certain features can be controlled individually and simultaneously by the first and second vehicle occupants18A and18B.

With reference now toFIGS.7A-7D, the features controlled in the set of options58A-58C can eliminate the need to have separate human-user-interface mechanisms, such as traditional seat warming toggles, seat adjustment control mechanisms, and/or the like. However, it should be appreciated that these human-user-interface mechanisms may still be present in the vehicle12without departing from the subject disclosure.

With reference now toFIGS.8and9, the monitoring system10may include other vision systems15B,15C that utilize components other than the structured light source38to obtain the 3D representation33(e.g., the 3D skeletal representation). The methodologies described in reference toFIGS.4,8, and9are exemplary in nature and other methodologies can be utilized without departing from the scope of the subject disclosure, such as Radio Detection and Ranging (RADAR applications) and other methodologies.

With reference now toFIG.8, a vision system15B is configured under a second construction and operates under the principles of Time-of-Flight (“ToF”). Unless otherwise explicitly indicated, the vision system15B may include all of the components, functions, materials, and may be implemented in the same structures of the vehicle12as the other constructions. However, the vision system15B may include a beam illumination source66(e.g., at least one laser diode and/or LED) that is configured to emit a beam illumination68(in modulated pulses or continuously emitted). The vision system15B includes the sensor16and a second imaging device70. The second imaging device70is configured to capture the flood illumination36from the flood illumination source34in the first image type28, and the sensor16is configured to capture the beam illumination68in a beam image type72. The control system100(e.g., the processor104) is configured to extract the 2D representation31(e.g., the 2D skeletal representation) of the at least one vehicle occupant18A-18D from the first image type28, measure a depth of the 2D representation31with the beam image type72, and extrapolate the 3D representation33(e.g, the 3D skeletal representation) of the at least one vehicle occupant18A-18D. However, in some embodiments, the second imaging device70may be configured to capture the 2D representation31. In this manner, the processor104may be configured to extract the 2D representation31from the beam image type72rather than requiring additional sensors, imaging devices, image types.

With continued reference toFIG.8, the control system100(e.g., the processor104) may be configured to extract the 2D representation31in accordance with the locations in the first image type28of the body parts (e.g., arms49and hands51) of at least one vehicle occupant18A-18D. The beam image type72, on the other hand, includes depth information that can be overlaid on the 2D representation31. More particularly, under the principles of ToF, the control system100(e.g., the processor104) may be configured to measure a depth of the 2D representation31with the depth information. The depth information may be obtained based on the principles of a time difference between the emission of the beam illumination68in modulated pulses and the return of the beam illumination68back to the sensor16, after being reflected from the at least one vehicle occupant18A-18D. The depth information may also be obtained by measuring the phase shift of the emission of the beam illumination68in continuous emission. In this manner, the sensor16and the second imaging device70may capture the first image type28and the beam image type72simultaneously in a sequence74. It should be appreciated that, in some embodiments, the vision system15B may not include the flood illumination source34and may, instead, rely on ambient lighting received from an environment. By detecting body parts, such as arms49and hands51, the control system100(e.g., the processor104) may be configured to accurately identify that the at least one vehicle occupant18A-18D is reaching for the user interface14and generate the user menu22specific to the categorization before the at least one vehicle occupant18A-18D interfaces with the user interface14.

With reference now toFIG.9, a vision system15C is configured under a third construction and operates under the principles of stereo vision. Unless otherwise explicitly indicated, the vision system15C may include all the components, functions, and materials, and may be implemented in the same structures of the vehicle12as the other constructions. However, the vision system15C may include only the flood illumination source34, the sensor16(e.g., an imaging device) and a second imaging device76. The sensor16and the second imaging device76are both configured to capture the flood illumination36. More particularly, the sensor16is configured to capture the first image type28and the second imaging device76is configured to capture a shifted image type80that is different from the first image type28in orientation. In this manner, the control system100(e.g., the processor104) may be configured to extract first and second orientations of the 2D representation31in accordance with the locations in the first image type28and the shifted image type80of the body parts of the at least one vehicle occupant18A-18D. More particularly, under the principles of stereovision, the control system100(e.g., the processor104) may be configured to obtain depth information of the 2D representation31by measuring the position of the 2D representation31in the first image type28against the position of the 2D representation31in the shifted image type80along epipolar lines. The depth information may be obtained based on the principles of triangulation and known geometries between sensor16and the second imaging device76to extrapolate the 3D representation33(e.g., the 3D skeletal representation). In this manner, the sensor16and the second imaging device76may capture the first image type28and the shifted image type80simultaneously in a sequence82. It should be appreciated that, in some embodiments, the vision system15C may not include the flood illumination source34and the flood illumination36may be ambient lighting received from an environment.

With reference now toFIG.10, the control system100of the monitoring system10may include at least one electronic control unit (ECU)102. The at least one ECU102may be located in rearview mirror assembly50and/or other structures in the vehicle12. In some embodiments, components of the ECU102communicate with one another and are located in both the rearview mirror assembly50and other structures in the vehicle12. The at least one ECU102may include the processor104and a memory106. The processor104may include any suitable processor104. Additionally, or alternatively, the ECU102may include any suitable number of processors, in addition to or other than the processor104. The memory106may comprise a single disk or a plurality of disks (e.g., hard drives) and includes a storage management module that manages one or more partitions within the memory106. In some embodiments, memory106may include flash memory, semiconductor (solid state) memory, or the like. The memory106may include Random Access Memory (RAM), a Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), or a combination thereof. The memory106may include instructions that, when executed by the processor104, cause the processor104to, at least, perform the functions associated with the components of the monitoring system10. The vision systems15A-15C may, therefore, be controlled by the control system100. The memory106may, therefore, include a series of captured first image types28and a series of second image types (e.g., structured image type40, beam image type72, or shifted image type80). The memory106may further include modules (e.g., instructions) that include a body part identifying module108, a depth extraction module110, a reach identifier module112, a categorization module114, a menu generation module116, and a regulation module118. The control system100may further include a communication module120that transmits the instruction to generate the menu22to the user interface14.

The vehicle12may include one or more vehicular system controllers150communicating with the control system100. In some embodiments, the vehicular system controller150includes a global memory152which receives information from the control system100and may receive information from an external database154(e.g., a cloud) that includes regionally specific driving rules and regulation data156. The regionally specific driving rules and regulation data156may be received by the global memory152and stored locally in the memory106(e.g., the regulation module118). In some embodiments, the global memory152may, alternatively or likewise, include a menu generation module116(e.g., which options58A-58C are generated for a categorization) and a regulation module118. In this manner, it should be appreciated that the processor104may be configured to transmit the instruction to generate the menu22directly to the user interface14or through the vehicular system controller150. Similarly, the vehicular system controllers150may be in communication with an audio system158of the vehicle12, a heating and cooling system160of the vehicle12, and a seat adjustment system162of the vehicle12.

With reference now toFIGS.1-10, the components of the monitoring system10(e.g., the control system100and vision system15A-15C) may be implemented into a variety of structures within the vehicle12. For example, components of the vision system15A-15C may be located within a rearview mirror assembly50, an overhead console84(FIG.2), the front portion52(e.g., the dashboard), and/or other locations within an interior cabin30of the vehicle12. In some embodiments, the rearview mirror assembly50may include an electro-optic device (not shown). For example, the electro-optic device may be a single-layer component, a single-phase component, a multi-layer component, and/or a multi-phase component that can be switched between a partially transmissive state and a partially reflective state. In some embodiments, the rearview mirror assembly50may include a display. However, it should be appreciated that the monitoring system10may be incorporated into other structures with multiple user interfacing with a user interface. For example, the monitoring system10may be incorporated into an aircraft, a rail vehicle, a water vessel, and other structures.

With reference now toFIG.11a method200of operating the monitoring system10includes, at step202, capturing a presence of at least one vehicle occupant18A-18D in a vehicle12. For example, a vision system15A-15C may be located in or around an interior cabin30of the vehicle and be configured to capture the presence of the at least one vehicle occupant18A-18D with a first image type28or a second image type40,72,80. At step204, the method200includes determining that the at least one vehicle occupant18A-18D is attempting to interface (i.e., touch interface) with a user interface14. For example, the processor104may receive a signal (e.g., from the user interface14) that the at least one vehicle occupant18A-18D is interfacing with the user interface14. In other examples, the processor104may be configured to determine (e.g., with a reach identifier module112) that the at least one vehicle occupant18A-18D is reaching for the user interface14. More particularly, the processor104may be configured to utilize a body part identifying module108to determine that the at least one vehicle occupant18A-18D is reaching for the user interface14(e.g., with a 2D representation31) and/or further utilize a depth extraction module110to determine that the at least one vehicle occupant18A-18D is reaching for the user interface14(e.g., a 3D representation). At step206, the method200includes categorizing the at least one vehicle occupant18A-18D by seating location20A-20D. For example, the seating location20A-20D of the at least one vehicle occupant18A-18D may be obtained by the vision system15A-15C in conjunction with the processor104executing the categorization module114. At step208, the method200includes transmitting an instruction to generate a user menu22on the user interface14specific to the categorization. For example, the menu22may be generated with a variety of options58A-58C (e.g., with the menu generation module116) that include controlling features locally within the vehicle12(e.g., speaker60controls, temperature regulation localized to the seating location20A-20D). In addition, the variety of options58A-58C may control features that are appropriated for the categorization of the at least one vehicle occupant18A-18D based on a condition of the vehicle12(e.g., whether or not it is in motion), locality of the vehicle12(e.g., a regulation module118that includes local rules and regulations), and/or other safety parameters. The processor104may generate an instruction directly to the user interface14or the vehicular system controller150.

According to one aspect of the present disclosure, a monitoring system for a vehicle communicates with a user interface and includes a vision system that has a sensor configured to capture a presence of at least one vehicle occupant. A control system includes a processor configured to determine that the at least one vehicle occupant is attempting to interface with a user menu and determine a seating location of the first vehicle occupant attempting to interface with the user interface. The processor is further configured to categorize the first vehicle occupant attempting to interface with the user interface by the seating location and transmit an instruction to generate the user menu on the user interface specific to the categorization.

According to another aspect of the present disclosure, a categorization includes a passenger categorization and a driver categorization.

According to yet another aspect of the present disclosure, an instruction to generate a user menu specific to a driver categorization is different than the instruction to generate the user menu specific to a passenger categorization.

According to still another aspect of the present disclosure, a sensor is configured as an imaging device to capture a presence of at least one vehicle occupant in an image.

According to yet another aspect of the present disclosure, a processor is configured to determine that a first vehicle occupant is attempting to interface with a user interface by one of proximity of a first vehicle occupant reaching for a user interface or by the first vehicle occupant directly interfacing with the user interface.

According to another aspect of the present disclosure, a user menu specific to a categorization includes temperature regulation specific to a seating location.

According to yet another aspect of the present disclosure, temperature regulation includes activating at least one of a seat warmer or air circulation specific to a seating location.

According to still another aspect of the present disclosure, a user menu specific to a categorization includes an option to pair a mobile device that is only generated with a passenger categorization upon a determination by a processor that a vehicle is in motion.

According to another aspect of the present disclosure, a user menu specific to a categorization includes a GPS directions option that is only generated with a passenger categorization upon a determination by a processor that a vehicle is in motion.

According to yet another aspect of the present disclosure, a processor is configured to transmit an instruction to a vehicle control system that operates a user interface.

According to still another aspect of the present disclosure, a processor is further configured to determine that a second vehicle occupant is attempting to interface with a user interface simultaneously with a first vehicle occupant, determine a seating location of the second vehicle occupant, categorize the second vehicle occupant attempting to interface with the user interface by a seating location, and transmit an instruction to generate a user menu on the user interface with a first region of the user menu specific to a categorization of the first vehicle occupant and a second region specific to the categorization of the second vehicle occupant.

According to another aspect of the present disclosure, a monitoring system for a vehicle communicates with a user interface and includes a vision system that has at least one imaging device configured to capture a first image type of at least one vehicle occupant. A control system includes a processor that is configured to determine that the at least one vehicle occupant is attempting to interface with a user interface and determine a seating location of the vehicle occupant attempting to interface with the user interface with the first image type. The processor is further configured to categorize the vehicle occupant attempting to interface with the user interface by the seating location and transmit an instruction to generate a user menu on the user interface specific to a categorization.

According to another aspect of the present disclosure, a categorization includes a passenger categorization and a driver categorization. An instruction to generate a user menu specific to the driver categorization is different than the instruction to generate the user menu specific to the passenger categorization.

According to yet another aspect of the present disclosure, a user menu specific to a categorization includes temperature regulation specific to a seating location.

According to still another aspect of the present disclosure, a flood illumination source is configured to emit a flood illumination captured by at least one imaging device in a first image type.

According to another aspect of the present disclosure, a structured illumination source is configured to emit a structured light illumination captured by at least one imaging device in a structured image type.

According to still another aspect of the present disclosure, a processor is configured to extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant attempting to interface with a user interface from a first image type, measure a depth of the 2D skeletal representation with a structured image type, extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant attempting to interface with the user interface, and categorize the vehicle occupant attempting to interface with the user interface by a seating location of the 3D skeletal representation.

According to yet another aspect of the present disclosure, a monitoring system for a vehicle communicates with a user interface and includes a vision system that has at least one imaging device configured to capture at least one image type of a vehicle occupant. A control system includes a processor that is configured to extrapolate a 3-dimensional (“3D”) representation of the vehicle occupant from the at least one image type and categorize the vehicle occupant by a seating location of the 3D representation. The processor is further configured to identify that the vehicle occupant is reaching for the user interface and transmit an instruction to generate a user menu on the user interface specific to the categorization.

According to still another aspect of the present disclosure, at least one image type includes a first image type from a first orientation and a shifted image type from a second orientation. A 3D representation of a vehicle occupant is obtained by stereovision.

According to another aspect of the present disclosure, at least one image type includes depth information used in extrapolating the 3D representation with at least one of a time-of-flight process or a structured light process.