Patent Description:
Embodiments of the invention relate to autonomous vehicles, in particular, controlling the trajectory of an autonomous vehicle to minimize motion sickness of passengers in the autonomous vehicle.

A self-driving car, also known as an autonomous vehicle (AV), a connected and autonomous vehicle (CAV), a driverless car, or a robotic car (robo-car), is a vehicle that is capable of sensing its environment and moving safely with little or no human input. Self-driving cars combine a variety of sensors to perceive their surroundings, such as video, radar, lidar, sonar, GPS, odometry and inertial measurement units. Control systems interpret sensory information to identify appropriate navigation paths, as well as obstacles and relevant signage.

Autonomous vehicles can make their passengers motion sick. Motion sickness has been linked to the frequency, level, and direction of external accelerations imparted upon the passenger, as well as a passenger's lack of anticipation of a maneuver performed by the autonomous vehicle. Part of the passenger's lack of anticipation is based on how an autonomous vehicle performs a maneuver, i.e. , the shape of the velocity vs. time graph forming the autonomous vehicle's acceleration and the attitude (i.e., the three-dimensional orientation) of the autonomous vehicle. Time optimal paths and constant curvature turns, both used in autonomous vehicles, are not the way people maneuver vehicles. What is needed is a "passenger comfort" optimal path in which reduced probability of motion sickness is the property to be optimized. <CIT> discusses a control apparatus for limiting a passenger from suffering a motion sickness. <CIT> discusses an automatic driving device capable of reducing a risk of an occupant getting carsick.

Aspects and embodiments of the invention are set out in the claims.

Embodiments are illustrated by way of example, and not by way of limitation, and will be more fully understood with reference to the following detailed description when considered in connection with the figures in which:.

Embodiments of the invention control an autonomous vehicle trajectory and speed to reduce the likelihood of a passenger getting motion sickness. In particular, embodiments of the invention control the transitioning trajectory between the dynamic states of position (direction), velocity and acceleration of the autonomous vehicle. Dynamic states of an autonomous vehicle in this context are constituted by changes in the vehicle's embedded longitudinal axis (back to front), controlled by propulsion and braking, and the vehicle's lateral, or cross, axis, controlled by steering. Multiple interdependent controls for vehicle speed and direction are used to create the desired motion sickness reducing trajectory. Controls include, but are not limited to, controlling the jerk (i.e., the change in acceleration) component of the dynamic states, including lateral and forward motions, within the path constraints of a desired direction of travel.

The speed and direction controls are managed by a supervisory control module that constrains the time-dependent lateral accelerations and jerk in the frequency range that potentially is disturbing to the inner ear of a passenger in the autonomous vehicle. With reference to <FIG>, examples of autonomous vehicle maneuvers to be controlled in this context include actions such as turning from one street to another or changing from one Lane <NUM> to another (such as changing lanes or turning from one street to another street). A Lane <NUM> is defined herein as the width of an area on a road or surface over which an autonomous vehicle can be driven. More broadly a maneuver is any change in course or speed and the trajectory is the path taken between one or both of those states. Embodiments are primarily for autonomous vehicles but may be applicable to driver assisted autonomous vehicles as well.

With reference to <FIG>, an embodiment of the invention <NUM> receives input from three sources: a GPS and map module <NUM> that provides a current, or a selected or chosen starting location, and a selected destination location, for the autonomous vehicle, with reference to a digitized map; a database of baseline maneuver profiles <NUM> for the autonomous vehicle, which provides basic information for controlling the direction, speed and acceleration of the autonomous vehicle, for example, for changing lanes, making left or right hand turns, or entering or exiting a freeway; and sensor input <NUM> from sensors, e.g., forward-looking sensors, and, optionally, lateral-looking sensors, that identify the autonomous vehicle's current lane and turn environment, as well as the autonomous vehicle's proposed lane, if different than the current lane.

Input to the GPS and map module <NUM> (provided by or for a passenger, for example) includes a starting location or current location (location A) and a destination location (location B) for the autonomous vehicle. The GPS and map module <NUM> identifies a plan for getting the autonomous vehicle from location A to location B and provides it to a Trajectory Profile Generator Module <NUM>. As the autonomous vehicle travels, the sensors <NUM>, for example, one or more monocular or binocular cameras, a radar, a lidar, a GPS transceiver, or a combination of sensors, sense an approaching turn or identify a possible, proposed, or planned pathway (according to the input received from the GPS and map module <NUM>) or Lane <NUM>, and capture turn and Lane <NUM> parameters, including the condition of the road, any vehicle congestion or other type of road congestion (pedestrians, bicyclists, road construction, obstructions, signage), and the upcoming turn to be negotiated based on the GPS and map input, and pass this information to the Trajectory Profile Generator Module <NUM>. The maneuver lane requirements from the database of Baseline Maneuver Profiles <NUM> are also available to the Trajectory Profile Generator Module <NUM>. The Trajectory Profile Generator Module <NUM> selects a maneuver profile from the database of Baseline Maneuver Profiles <NUM> and calculates a path with low lateral acceleration, e.g., less than <NUM>, to accomplish the maneuver. (Keeping the primary acceleration forces in the vertical direction instead of lateral direction with reference to the anatomy of the passenger is accomplished by using coordinated turns as in a two wheeled vehicle, or in an autonomous vehicle that rotates the passenger to keep the sum of gravitational and centrifugal forces aligned so the passenger only experiences vertical sensations).

The calculated path with low lateral acceleration is sent to the Steering Control Module <NUM> and a Supervisory Control Module <NUM>. The Supervisory Control Module <NUM> uses the geometry of the path, Inner Ear Constraints <NUM>, a speed limit obtained from the GPS and Map Module <NUM>, and environmental information (e.g., road conditions, traffic congestion) to select a speed for the autonomous vehicle. The speed is transmitted to the Trajectory Profile Generator Module <NUM> to set a Lane Margin <NUM> in a subsequent iteration of generating a trajectory for the autonomous vehicle, and to Speed Control Module <NUM>. The Inner Ear Constraints <NUM> consist of a level of frequencies in the inner ear crossover spectrum and the decay time of disturbance history.

According to one embodiment, an Apriori Trajectory Generator module makes use of a set of tables for placing points between the lane boundaries for total turn angle ranges. These data are generated based on autonomous vehicle design in the development phase of the system design, and includes a percentage of progress through a turn when the number of defining points changes from <NUM> to <NUM>.

According to an embodiment <NUM>, the direction of travel, or direction of turn, (DOT) <NUM> and Lane <NUM> parameters depicted in <FIG> include the Lane <NUM> and a trajectory of a center of a Planning Area <NUM> or desired pathway, if a Planning Area exists. The Planning Area <NUM> is defined herein as the width of Lane <NUM> less a width of a Lane Margin <NUM> (one or both a left and right lane margins, if they exist), and less a width of the autonomous vehicle ("the Vehicle Width <NUM>"). The Lane Margin <NUM> is defined herein as a safety barrier between the furthest maneuvering of the vehicle and an edge of the Lane <NUM>. The Lane Margin <NUM> is a function of vehicle velocity and Lane <NUM>. The Planning Area <NUM> is the range of pathway that the Trajectory Profile Generator Module <NUM> can use to design a path for the autonomous vehicle to travel with lowest inner ear disturbance, or at least to travel with inner ear disturbance maintained below a threshold that is understood to cause motion sickness. The inner ear disturbance is a function of the path design and the vehicle velocity. When driving an autonomous vehicle on narrow roads, the Planning Area <NUM> may diminish to zero and the only parameter available to control lateral accelerations is autonomous vehicle speed.

Note the Planning Area <NUM> can reduce to a line if the width of Lane <NUM> reduces in width to less than two times the width of the Lane Margin <NUM> and the autonomous Vehicle Width <NUM>. Furthermore, the Planning Area <NUM> may reach an endpoint if the width of Lane <NUM> reduces to less than the Vehicle Width <NUM>. Vehicle Width <NUM> is defined herein as the cross section of the vehicle orthogonal to its velocity vector relative to the Lane <NUM> and is a parameter of the vehicle build and attitude. Vehicle Width <NUM> determines the limiting distance at which the center of the generated trajectory may approach the inside edge of the Lane Margin <NUM>. Generated trajectory is defined herein as a path that meets the geometric planning constraints and reduces or minimizes the probability of motion sickness.

The Vehicle Width <NUM> of a two-wheeled autonomous vehicle may vary with attitude unless it is spherical, i.e., a leaning two wheel vehicle is wider than an upright one. The Lane <NUM>, along with the Vehicle Width <NUM> and Lane Margin <NUM> requirements are used to calculate the Planning Area <NUM>. The Lane Margin <NUM> is defined herein as a part of the Lane <NUM> at the edge(s) of the Lane <NUM>. The Lane <NUM> less the Lane Margin <NUM> (on one or both sides of the Lane <NUM>) defines the Planning Area <NUM>. The Planning Area <NUM> provides the range of freedom to vary the trajectory of the autonomous vehicle from the center of the Lane <NUM>.

The Lane Margin <NUM> requirement is a distance the vehicle must stay from a Lane <NUM> edge or boundary (either a left edge, or a right edge, a Lane boundary, or both Lane boundaries). According to embodiments, the Lane Margin <NUM> requirement varies with the width of Lane <NUM> width and vehicle speed. A wider Lane <NUM> invites or allows for a larger Lane Margin <NUM> requirement. The higher the autonomous vehicle's speed, the greater the Lane Margin <NUM> requirement because corrective actions require larger margins at higher speeds, thus producing higher accelerations.

According to embodiments of the invention, there are two basic types of maneuvers: changing destination, including changing lanes, selecting a direction at an intersection, transitioning from one freeway to another freeway, and exiting or entering a freeway; and following a curved road. A road with an occasional turn, curve, or lane change, can be addressed more aggressively because motion sickness is an accumulative condition. The history of induced accelerations fades with time. However, driving on a mountain road with many curves may require reducing speed to stretch out the acceleration events and also to reduce the amplitude of the lateral acceleration (i.e., the maximum lateral acceleration of the autonomous vehicle).

These factors require a two level path planning method, as follows. Each lateral acceleration event that results in low frequency lateral accelerations (below <NUM>) and with an amplitude of lateral acceleration above the human sensitivity is recorded along with its severity. A time weighted severity sum is used in setting lateral acceleration levels for an upcoming maneuver or planned path.

The planned trajectories are designed to minimize and smooth the rate of curvature of the autonomous vehicle as it travels along the trajectories. One embodiment generates a curve between the existing position and direction of the autonomous vehicle, and the desired position and direction of the autonomous vehicle, that has C3 characteristics or greater. That is, at a minimum, the first derivative of curvature is a continuous function. Further, the second derivative of curvature may also be limited in absolute magnitude. Continuity on the first derivative of curvature (a C3 position curve) of the path lowers the frequency content of the accelerations the passenger is feeling and further reduces motion sickness. Smoothness of the lateral acceleration is achieved by using at least a C3 (continuous third derivative) curve for the path.

An example of a method to generate a curve with two continuous derivatives (C2) is to use a cubic spline follows: <MAT>.

However, the path is generated by using two curves, one in x and one in y. Plotting the curve in the x-y Lane provides the path of the turn. The first derivative of the composite curve generated direction, and the first derivative of direction along with the wheelbase of the vehicle gives curvature. A passenger in the autonomous vehicle desires a smooth curvature, meaning at least the first derivative of curvature is smooth. This requires a path that at least has three continuous derivatives or a C3 curve. This can be generated by using a <NUM>th order spline as follows: <MAT> or a similar curve, e.g., <MAT> and <MAT>.

It is further appreciated that embodiments of the invention may make use of C3 or higher curves other than splines, including versine generated curves, etc..

A straight <NUM>th order spline can be used, according to an embodiment, but the process of starting with a three point <NUM>th order spline and using the slope of the two parametric curves with a slight modification to generate a <NUM> point <NUM>th order spline reduces the total curvature and the lateral acceleration the passenger experiences.

The two curves generated are: <MAT> the parameter t is the distance along the path. The calculation of the coefficients is left to one skilled in the art to perform. The direction and curvature are derived from the Px(t) and Py(t)as follows: <MAT> and <MAT> The amplitude of curvature is used to calculate a bounding value of speed to keep the lateral acceleration below a maximum acceleration determined from motion sickness sensitivity.

According to embodiments of the invention, changes in velocity are controlled in a similar manner as described above regarding changes in curvature of the autonomous vehicle. The embodiment further generates a jerk (first derivative of lateral acceleration) function that is continuous.

If the autonomous vehicle has just two wheels, in line, there is a further reduction in motion sickness. People are less susceptible to vertical accelerations than lateral accelerations. Two wheeled vehicles have coordinated turns to maintain balance. This reduces or eliminates the lateral acceleration on the human sensory receptors, allowing a two wheeled vehicle to travel faster along a desired path at the same level of motion sickness sensitivity. Above, it was noted above that the width of Lane <NUM> along with the Vehicle Width <NUM> and the Lane Margin <NUM> requirements are used to calculate the Planning Area <NUM>, i.e., the range of freedom to vary the trajectory from the center of the Lane <NUM>. When embodiments of the invention are applied to a two-wheeled vehicle, the Vehicle Width <NUM> is less than a four-wheeled vehicle, thus the Planning Area <NUM> is greater.

Claim 1:
An apparatus (<NUM>) for controlling a direction and speed of an autonomous vehicle or driver assisted autonomous vehicle (AV), comprising:
a GPS and map module (<NUM>) to receive a start location and a destination location for the AV, and a speed limit, and generate a plan for moving the vehicle from the start location to the destination location;
a trajectory profile generator module (<NUM>) to receive the plan and calculate in real-time a path including a sequence of maneuvers to move the vehicle from the start location to the destination location, wherein to calculate the path in real-time comprises:
tracking each lateral acceleration event with an amplitude above a human sensitivity level, and a corresponding severity;
calculating a time weighted severity sum based on the corresponding severity of the tracked lateral acceleration events; and
setting a lateral acceleration level for the path or an upcoming one of the sequence of maneuvers based on the time weighted severity sum;
a supervisory control module (<NUM>) to receive the calculated path and select a speed for the AV based on a geometry of the calculated path, inner ear constraints comprising a level of frequencies in a human's inner ear crossover spectrum and a decay time of inner ear disturbance history, the speed limit, and environmental information; and
a steering control module (<NUM>) to receive the calculated path and the selected speed and control a lateral acceleration and a change in lateral acceleration of the vehicle based on the calculated path and the selected speed.