Patent Description:
Many modern robots and other machines are designed to operate with increased autonomy and are less reliant on well-trained operators to safely operate. Some of these modern robots are manned while others are unmanned. In particular, a variety of unmanned vehicles include unmanned ground vehicles (UGVs), unmanned aerial vehicles (UAVs), unmanned surface vehicles (USVs), unmanned underwater vehicles (UUVs), unmanned spacecraft and the like. The use of unmanned vehicles has grown in recent years and these unmanned vehicles are employed in a wide variety of applications, including both military and civilian uses.

One focus in the field of robotics is in the improvement of autonomy, which often includes multiple examples of robot operation. These examples of robot operation include automatic control of a given robot to support remote human control. Another example is optimization systems (and associated methods) to determine how, for a given robot or set of robots, tasks should be ordered and/or allocated. And yet another example of robot operation is automatic, real-time or near real-time data processing, and exploitation in support of automatic route planning, mission execution and other activities.

Despite advancements, existing autonomy systems are typically configured to address only one example of these activities, thereby focusing its design of the underling autonomy algorithms and software architecture on a narrow mission set. This limits the extensibility of existing autonomy systems. Furthermore, it is generally desirable to improve existing systems to enhance their efficiency and operation.

Therefore it would be desirable to have a system and method that takes into account at least some of the issues discussed above, as well as other possible issues.

<CIT>, in accordance with its abstract, states a method for the generation of a trajectory for the avoidance of a detected obstacle for a land vehicle driving along a planned path, particularly in a scenario of assisted or autonomous driving, wherein the avoidance trajectory includes at least one curvature with respect to a current reference direction of the vehicle,
characterized in that the curvature has an amplitude that evolves over time with a sinusoidal pattern or with a composite pattern including sinusoidal and constant value section, the sinusoidal pattern having a frequency lower than a predetermined maximum admissible frequency, lower than the maximum bandwidth of a control system of the dynamics of the vehicle arranged for the tracking of the avoidance trajectory by means of driving actuator means of the vehicle comprising at least one steering system. In accordance with the claims of <CIT>, the method also includes a collision check, including verifying whether a current trajectory of the vehicle along a roadway of said planned path intersects a collision area defined as a function of a detected position and velocity of said obstacle, whereby an avoidance maneuver must be carried out; a verification of the feasibility of an obstacle avoidance maneuver, including the calculation of a first avoidance trajectory having a maximum lateral displacement from a first side of the obstacle and of a second avoidance trajectory having a maximum displacement from a second side of the obstacle opposite to said first side, with respect to the current direction of travel of the vehicle; and a selection of an obstacle avoidance maneuver, including the selection of an avoidance trajectory between the current trajectory of the vehicle and said first or said second avoidance trajectory having a maximum lateral displacement, according to a predetermined criterion, wherein said predetermined criterion includes minimizing the lateral acceleration of the vehicle.

<CIT>, in accordance with its abstract, states a method for controlling a semi-autonomous vehicle modifies a current path for the vehicle desired by a driver of the vehicle. The current path starts at a current position of the vehicle and ends in a target position of the vehicle and the method modifies the current path while preserving the current position and the target position of the vehicle in the modified path. The method overrides the actions of the driver to control a movement of the vehicle according to the modified path.

Examples of the present disclosure are directed to conflict detection and avoidance along a current route of a robot.

There is described herein a method of detecting and avoiding conflict along a current route of an unmanned aerial vehicle, the method comprising: accessing a trajectory of the unmanned aerial vehicle on the current route of the unmanned aerial vehicle, and a predicted trajectory of a nearby moving object; detecting a conflict between the unmanned aerial vehicle and the nearby moving object from a comparison of the unmanned aerial vehicle and the nearby moving object on respectively the trajectory of the unmanned aerial vehicle, and the predicted trajectory of the nearby moving object; determining a plurality of alternate routes for the unmanned aerial vehicle, each alternative route including an alternative route segment offset from the current route by a fixed offset, and a transition segment from the current route to the alternative route segment; evaluating routes, including the plurality of alternate routes, according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the unmanned aerial vehicle, and a distance from the current route, wherein the current route is the highest ranked one of the routes when no conflict is detected for the unmanned aerial vehicle on the current route and higher ranked routes are those with a longer time or distance to the point of approach, and/or closest to the current route; selecting one of the alternative routes from the plurality of alternative routes for use in at least one of guidance, navigation or control of the unmanned aerial vehicle to avoid the conflict, wherein the selected alternative route is a higher ranked route; causing the unmanned aerial vehicle to travel the selected alternate route to avoid the conflict; and causing the unmanned aerial vehicle to return to the current route during travel of the unmanned aerial vehicle on the alternate route.

There is also described herein an apparatus for detecting and avoiding conflict along a current route of a unmanned aerial vehicle, the apparatus comprising: a memory configured to store computer-readable program code; and processing circuitry configured to access the memory, and execute the computer-readable program code to cause the apparatus to at least perform a method of detecting and avoiding conflict along a current route of an unmanned aerial vehicle, the method comprising: accessing a trajectory of the unmanned aerial vehicle on the current route of the unmanned aerial vehicle, and a predicted trajectory of a nearby moving object; detecting a conflict between the unmanned aerial vehicle and the nearby moving object from a comparison of the unmanned aerial vehicle and the nearby moving object on respectively the trajectory of the unmanned aerial vehicle, and the predicted trajectory of the nearby moving object; determining a plurality of alternate routes for the unmanned aerial vehicle, each alternative route including an alternative route segment offset from the current route by a fixed offset, and a transition segment from the current route to the alternative route segment; evaluating routes, including the plurality of alternate routes, according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the unmanned aerial vehicle, and a distance from the current route, wherein the current route is the highest ranked one of the routes when no conflict is detected for the unmanned aerial vehicle on the current route and higher ranked routes are those with a longer time or distance to the point of approach, and/or closest to the current route; selecting one of the alternative routes from the plurality of alternative routes for use in at least one of guidance, navigation or control of the unmanned aerial vehicle to avoid the conflict, wherein the selected alternative route is a higher ranked route; causing the unmanned aerial vehicle to travel the selected alternate route to avoid the conflict; and causing the unmanned aerial vehicle to return to the current route during travel of the unmanned aerial vehicle on the alternate route.

There is also described herein a computer program comprising computer-readable program code that, in response to execution by processing circuitry, causes the processing circuitry to perform a method of detecting and avoiding conflict along a current route of an unmanned aerial vehicle, the method comprising: accessing a trajectory of the unmanned aerial vehicle on the current route of the unmanned aerial vehicle, and a predicted trajectory of a nearby moving object; detecting a conflict between the unmanned aerial vehicle and the nearby moving object from a comparison of the unmanned aerial vehicle and the nearby moving object on respectively the trajectory of the unmanned aerial vehicle, and the predicted trajectory of the nearby moving object; determining a plurality of alternate routes for the unmanned aerial vehicle, each alternative route including an alternative route segment offset from the current route by a fixed offset, and a transition segment from the current route to the alternative route segment; evaluating routes, including the plurality of alternate routes, according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the unmanned aerial vehicle, and a distance from the current route, wherein the current route is the highest ranked one of the routes when no conflict is detected for the unmanned aerial vehicle on the current route and higher ranked routes are those with a longer time or distance to the point of approach, and/or closest to the current route; selecting one of the alternative routes from the plurality of alternative routes for use in at least one of guidance, navigation or control of the unmanned aerial vehicle to avoid the conflict, wherein the selected alternative route is a higher ranked route; causing the unmanned aerial vehicle to travel the selected alternate route to avoid the conflict; and causing the unmanned aerial vehicle to return to the current route during travel of the unmanned aerial vehicle on the alternate route.

There is also described herein a computer-readable storage medium having stored thereon a computer program comprising computer-readable program code that, in response to execution by processing circuitry, causes the processing circuitry to perform a method of detecting and avoiding conflict along a current route of an unmanned aerial vehicle, the method comprising: accessing a trajectory of the unmanned aerial vehicle on the current route of the unmanned aerial vehicle, and a predicted trajectory of a nearby moving object; detecting a conflict between the unmanned aerial vehicle and the nearby moving object from a comparison of the unmanned aerial vehicle and the nearby moving object on respectively the trajectory of the unmanned aerial vehicle, and the predicted trajectory of the nearby moving object; determining a plurality of alternate routes for the unmanned aerial vehicle, each alternative route including an alternative route segment offset from the current route by a fixed offset, and a transition segment from the current route to the alternative route segment; evaluating routes, including the plurality of alternate routes, according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the unmanned aerial vehicle, and a distance from the current route, wherein the current route is the highest ranked one of the routes when no conflict is detected for the unmanned aerial vehicle on the current route and higher ranked routes are those with a longer time or distance to the point of approach, and/or closest to the current route; selecting one of the alternative routes from the plurality of alternative routes for use in at least one of guidance, navigation or control of the unmanned aerial vehicle to avoid the conflict, wherein the selected alternative route is a higher ranked route; causing the unmanned aerial vehicle to travel the selected alternate route to avoid the conflict; and causing the unmanned aerial vehicle to return to the current route during travel of the unmanned aerial vehicle on the alternate route.

There is also described herein a system comprising: an unmanned aerial vehicle comprising a vehicle management system; and a mission management system configured to perform a method of detecting and avoiding conflict along a current route of an unmanned aerial vehicle, the method comprising: accessing a trajectory of the unmanned aerial vehicle on the current route of the unmanned aerial vehicle, and a predicted trajectory of a nearby moving object; detecting a conflict between the unmanned aerial vehicle and the nearby moving object from a comparison of the unmanned aerial vehicle and the nearby moving object on respectively the trajectory of the unmanned aerial vehicle, and the predicted trajectory of the nearby moving object; determining a plurality of alternate routes for the unmanned aerial vehicle, each alternative route including an alternative route segment offset from the current route by a fixed offset, and a transition segment from the current route to the alternative route segment; evaluating routes, including the plurality of alternate routes, according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the unmanned aerial vehicle, and a distance from the current route, wherein the current route is the highest ranked one of the routes when no conflict is detected for the unmanned aerial vehicle on the current route and higher ranked routes are those with a longer time or distance to the point of approach, and/or closest to the current route; selecting one of the alternative routes from the plurality of alternative routes for use in at least one of guidance, navigation or control of the unmanned aerial vehicle to avoid the conflict, wherein the selected alternative route is a higher ranked route; causing the unmanned aerial vehicle to travel the selected alternate route to avoid the conflict; and causing the unmanned aerial vehicle to return to the current route during travel of the unmanned aerial vehicle on the alternate route.

These and other features, examples, and advantages of the present disclosure will be apparent from a reading of the following detailed description together with the accompanying figures, which are briefly described below. The present disclosure includes any combination of two, three, four or more features or elements set forth in this disclosure, regardless of whether such features or elements are expressly combined or otherwise recited in a specific example described herein. This disclosure is intended to be read holistically such that any separable features or elements of the disclosure, in any of its examples, should be viewed as combinable unless the context of the disclosure clearly dictates otherwise.

It will therefore be appreciated that this Brief Summary is provided merely for purposes of summarizing some examples so as to provide a basic understanding of the disclosure. Other examples and advantages will become apparent from the following detailed description taken in conjunction with the accompanying figures which illustrate, by way of example, the principles of some described examples.

Having thus described examples of the disclosure in general terms, reference will now be made to the accompanying figures, which are not necessarily drawn to scale, and wherein:.

Some examples of the present disclosure will now be described more fully hereinafter with reference to the accompanying figures, in which some, but not all examples of the disclosure are shown. Indeed, various examples of the disclosure may be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these examples are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. For example, unless specified otherwise or clear from context, references to first, second or the like should not be construed to imply a particular order. A feature described as being above another feature (unless specified otherwise or clear from context) may instead be below, and vice versa; and similarly, features described as being to the left of another feature else may instead be to the right, and vice versa. As used herein, unless specified otherwise or clear from context, the "or" of a set of operands is the "inclusive or" and thereby true if and only if one or more of the operands is true, as opposed to the "exclusive or" which is false when all of the operands are true. Thus, for example, "[A] or [B]" is true if [A] is true, or if [B] is true, or if both [A] and [B] are true. Further, the articles "a" and "an" mean "one or more," unless specified otherwise or clear from context to be directed to a singular form. Furthermore, it should be understood that unless otherwise specified, the terms "data," "content," "digital content," "information," and similar terms may be at times used interchangeably.

Examples of the present disclosure relate generally to robotics and, in particular, to one or more of the design, construction, operation or use of robots. As used herein, a robot is a machine designed and configurable to execute maneuvers in its environment. The robot may be manned or unmanned. The robot may be fully human-controlled, or the robot may be semi-autonomous or autonomous in which at least some of the maneuvers are executed independent of or with minimal human intervention. In some examples, the robot is operable in various modes with various amounts of human control.

A robot designed and configurable to fly may at times be referred to as an aerial robot. A robot designed and configurable to operate with at least some level of autonomy may at times be referred to as an autonomous robot, or an autonomous aerial robot in the case of an autonomous robot that is also designed and configurable to fly. Examples of suitable robots include aerobots, androids, automatons, autonomous vehicles, explosive ordnance disposal robots, hexapods, industrial robots, insect robots, microbots, nanobots, military robots, mobile robots, rovers, service robots, surgical robots, walking robots and the like. Other examples include a variety of unmanned vehicles, including unmanned ground vehicles (UGVs), unmanned aerial vehicles (UAVs), unmanned surface vehicles (USVs), unmanned underwater vehicles (UUVs), unmanned spacecraft and the like. These may include autonomous cars, planes, trains, industrial vehicles, fulfillment center robots, supply-chain robots, robotic vehicles, mine sweepers, and the like.

<FIG> illustrates one type of robot, namely, a UAV <NUM>, that may benefit from examples of the present disclosure. As shown, the UAV may include a fuselage <NUM>, wings <NUM> extending from opposing sides of the UAV in a mid-section of the fuselage, and an empennage or tail assembly <NUM> at a rear end of the fuselage. The tail assembly includes a vertical stabilizer <NUM> and two horizontal stabilizers <NUM> extending from opposing sides of the UAV. Rotors <NUM> and <NUM> are mounted to respectively the wings and the end of the tail assembly for lifting and propelling the UAV during flight.

<FIG> illustrates a system <NUM> according to some examples of the present disclosure. The system may include any of a number of different subsystems (each an individual system) for performing one or more functions or operations. As shown, in some examples, the system includes a control station <NUM> and one or more robots <NUM> (e.g., one or more UAVs <NUM>). The control station provides facilities for communication with or control of the one or more robots, such as by wired or wireless data links directly or across one or more networks <NUM>. In some examples, the control station may be a ground station, and not in all cases control the robots. In this regard, the control station may be configured to monitor the robots. The control station may initiate mission, but the control station may not control the robots to maneuver. At times, then, the control station may enable or provide a distributed network/server of software functions.

The robot <NUM> includes a robot management system (RMS) <NUM> and a mission management system (MMS) <NUM>. The RMS is a robot-specific subsystem configured to manage subsystems and other components of the robot. These subsystems and other components include, for example, maneuver controls, landing gear, onboard environmental systems, electrical, pneumatic and hydraulic systems, communications systems, navigation systems and other subsystems and components for controlling operation and maneuvering of the robot. The RMS is configured to accept maneuver commands such as waypoints and/or steering commands, and control the robot to follow those maneuver commands. In the context of a vehicle, the RMS is at times referred to as a vehicle management system (VMS).

The MMS <NUM> is a subsystem configured to manage missions of the robot <NUM>. A mission is a deployment of the robot (one or more robots) to achieve one or more mission objectives. A mission may be decomposed into maneuvers of the robot with optional sensor and/or effector scheduling, and the MMS may execute tasks to manage the robot to execute maneuvers with specific parameters and capabilities. The MMS <NUM> includes subsystems to process sensor data to situational awareness, plan tasks for the robot <NUM> (or multiple robots), coordinate with teams to assign tasks, execute assigned tasks. The MMS is also configured to interface with the RMS <NUM>, and in some examples the control station <NUM>. Although the MMS is shown on the robot <NUM>, the MMS may instead be at the control station; or in some examples, the MMS may be distributed between the robot and the control station.

In some examples, the MMS <NUM> provides a complete, end-to-end autonomy architecture with open system architecture standards and parameterized to allow rapid extension and reapplication to a variety of robots. The flexibility of the MMS enables an operator to code it once, but to apply it anywhere. The MMS may therefore be applied to virtually any robot that applies, or benefits from, autonomy. The MMS may include an adaptable autonomy architecture that is applicable to a variety of robots, including those identified above. A benefit of the MMS is therefore not only in the specific contents, but also in the specific details of the architecture, its subroutines, and in the interfaces between those subroutines and other systems/devices that support rapid extensibility and adaptability of the MMS to a variety of domains.

<FIG> more particularly illustrates the MMS <NUM> according to some examples of the present disclosure. The MMS may include any of a number of different subsystems (each an individual system) for performing one or more functions or operations. As shown, in some examples, the MMS includes an interface subsystem <NUM>, a situational awareness subsystem <NUM>, a mission planning subsystem <NUM>, a mission coordination subsystem <NUM>, and a mission execution subsystem <NUM>. As suggested above, in some examples, the subsystems of the MMS may be on the robot <NUM>, at the control station <NUM>, or distributed between the robot and the control station. The subsystems may be configured to communicate with one another directly, over a communication bus <NUM>, or across the network(s) <NUM> in examples in which the MMS is distributed between the robot and the control station.

The subsystems enable the MMS <NUM> of the robot <NUM> to interface with the system <NUM>, perform situational awareness, plan a mission including a plurality of tasks, coordinate the plurality of tasks and thereby the mission with other robots <NUM>, and execute the mission. For example, the MMS may use the interface subsystem <NUM> to interface with various sensors onboard the robot, the RMS <NUM>, the control station <NUM> and/or other robots. The MMS may use the situational awareness subsystem <NUM> to acquire sensor data and maintain an awareness of the state of the environment in which the robot is operating. The MMS may use the mission planning subsystem <NUM> to plan a mission including or associated with a plurality of tasks, and which may incorporate rules of engagement, tactics and other constraints on operations. The MMS may likewise use the mission planning subsystem to dynamically replan a mission in which changes to the mission are made in real-time or near real-time as the mission is executed. The MMS may use the mission coordination subsystem <NUM> to coordinate the plurality of tasks of the mission with other robots and users, where agreed-upon tasks may then be executed by the MMS using the mission execution subsystem <NUM>.

According to some examples of the present disclosure, the MMS <NUM> is also configured to implement software functionality or functionalities (at times referred to as services) during a mission to provide the robot <NUM> with conflict detection and avoidance capabilities. During a mission, the robot may take a path, and this path may be described by a series of waypoints that define a route the robot will travel. The robot travels with a velocity (speed and direction of motion), and the series of waypoints and velocities at that define the route with respect to time defines a trajectory of the robot (at times referred to as a track of the robot). The conflict detection and avoidance capabilities enable the robot to detect and avoid conflicts along its route of travel.

<FIG> illustrates a scenario <NUM> in which the robot <NUM> is executing a mission in which the robot is to travel on a current route <NUM> in an environment in which one or more moving objects <NUM> are nearby the robot. In some examples, these moving objects are other robots that may be of the same type or different types than the robot. Other examples of suitable moving objects include non-robot vehicles such as any of a number of different types of ground vehicles, watercraft, aircraft, spacecraft or the like.

<FIG> is a diagram of services <NUM> that may be implemented by the MMS <NUM> for conflict detection and avoidance with respect to nearby moving objects <NUM>, according to some examples. As shown, the services may include a track management <NUM> service, conflict detection <NUM> service, alternate route generator <NUM> service, and a route selector <NUM> service. In some examples, the track management service may be implemented by the situational awareness subsystem <NUM> of the MMS; and the conflict detection service, alternate route generator service and route selector service may be implemented by the mission execution subsystem <NUM> of the MMS.

The track management <NUM> service is configured to determine a trajectory <NUM> of the robot <NUM> on the current route <NUM>, such as from data that indicates a position and a velocity of the robot. The data may include state data that describes position and velocity of the robot, and which in some examples may be received from the RMS <NUM>. In some examples, the current route for the robot is described by a route command, a flight plan (for an aerial robot) and/or a mission route; and in some of these examples, the trajectory of the robot is determined using the route command, the flight plan and/or the mission route. In this regard, the route in some examples is a planned route of the robot.

In some examples, the track management <NUM> service is also configured to determine a predicted trajectory <NUM> of nearby moving object(s) <NUM>, such as from data that indicates a position and a velocity of the nearby moving object(s). This data may be or include sensor data from any of a number of different sensors including those employing technologies such as acoustics, radio, optics and the like. More particular examples of suitable sensors include those employing radar, lidar, infrared sensors, cameras and the like. Another example of a suitable sensor in the context of an aerial robot is an automatic, dependent surveillance-broadcast (ADS-B) receiver configured to receive ADS-B signals.

The conflict detection <NUM> service of the services <NUM> that may be implemented by the MMS <NUM> is configured to access the trajectory <NUM> of the robot <NUM> on the current route <NUM> of the robot, and the predicted trajectory <NUM> of the nearby moving object <NUM>, such as from the track management <NUM> service. The conflict detection service is configured to detect a conflict <NUM> between the robot and the nearby moving object from a comparison of the robot and the nearby moving object on respectively the trajectory of the robot, and the predicted trajectory of the nearby moving object; and the conflict detection service is configured to output an indication of the conflict, which may include a time or distance to a point of approach between the nearby moving object and the robot. In some examples, the point of approach is the closest point of approach between the nearby moving object and the robot. The conflict may be detected in any of a number of different manners, such as when the nearby moving object is within a clear region <NUM> that includes the robot, and a time to the point of approach between nearby moving object and the robot is less than a time threshold value. The clear region in various examples may be referred to as a well-clear region, boundary, violation volume or the like.

The alternate route generator <NUM> service is configured to determine alternate routes for the robot. Each alternative route includes an alternative route segment offset from the current route, and a transition segment from the current route to the alternative route segment. <FIG> illustrates, for example, a current route <NUM> and alternate routes <NUM>, <NUM>. As shown, each alternative route includes an alternative route segment 602A, 604A that is offset <NUM> from the current route, and a transition segment 602B, 604B from the current route to the alternative route segment. In some examples, the offset is a geometric offset, and the alternative route segment has a geometric offset from the current route.

The alternative route segment 602A, 604A may be predefined or determined from the offset <NUM>. Similarly, the transition segment 602B, 604B may be predefined or determined. Any one or more of the alternative route segment, the offset or the transition segment may be defined or described in configuration data accessed by or provided to the alternative route generator <NUM> service. The alternative route segment and thereby the offset may be the same or different across the alternative routes <NUM>, <NUM>. the offset may be fixed or variable. The offset may be independent of or depend on the robot <NUM> or type of robot, the state of the robot, and/or the status of the robot. In some particular examples, the transition segment is defined as a Dubins path that connects the position of the robot on the current route <NUM>, to a position of the robot on the alternative route segment.

In some examples, then, the alternative route segment 602A, 604A is a predefined alternative route segment. In some of these examples, for an alternative route <NUM>, <NUM>, the alternative route generator <NUM> service is configured to access information such as the configuration data that describes the predefined alternative route segment, and determine the transition segment 602B, 604B from the current route to the predefined alternative route segment.

In some examples, the offset <NUM> is a predefined geometric offset. In some of these examples, for an alternative route <NUM>, <NUM>, the alternative route generator <NUM> service is configured to access information such as the configuration data that describes the predefined geometric offset. The alternative route generator service is configured to determine the alternative route segment 602A, 604A having the predefined geometric offset, and determine the transition segment 602B, 604B from the current route to the alternative route segment as determined.

In some examples, for an alternative route <NUM>, <NUM>, the alternative route generator <NUM> service is configured to determine the offset <NUM> that is a function of at least one of a type of the robot <NUM>, a state of the robot, or a status of the robot. In some of these examples, the alternative route generator service is configured to determine the alternative route segment 602A, 604A having the offset as determined, and determine the transition segment 602B, 604B from the current route to the alternative route segment as determined.

Returning to <FIG>, again, the route selector <NUM> service is configured to receive an indication of the conflict from the conflict detection <NUM> service, and which may include a time or distance to a point of approach (e.g., closest point of approach) between the nearby moving object <NUM> and the robot <NUM>. The route selector service may also receive the alternate routes <NUM>, <NUM> for the robot from the alternate route generator <NUM> service. The route selector service is configured to evaluate routes including the alternate routes according to a cost metric that depends on the time or distance to the point of approach between the nearby moving object and the robot, and a distance from the current route. In some examples, the route selector service is configured to evaluate the routes further including the current route <NUM> according to the cost metric. In some examples, the cost metric further depends on at least one of terrain along the routes, or a state of an environment of the robot. In some examples, the route selector service may be configured to rank the routes, and cost metric may allow the route selector service to evaluate the routes with the higher ranked routes being those with a longer time or distance to the point of approach, and/or closest to the current route.

In some examples, the route selector <NUM> service is configured to feed the alternate routes <NUM>, <NUM> for the robot <NUM> back to the conflict detection <NUM> service. In some of these examples, the conflict detection service is configured to determine respective trajectories of the robot on the alternate routes, such as from the data that indicates the position and velocity of the robot. The conflict detection service is configured to detect any conflicts between the robot and the nearby moving object from comparisons of the robot on the respective trajectories, and the nearby moving object on its predicted trajectory. The conflict detection service is configured to output an indication of any conflict, as well as the time or distance to the point of approach between the nearby moving object and the robot on the respective trajectories. And at least the time or distance to the point of approach may be used by the route selector service to determine the cost metric and from it to evaluate the routes.

The route selector <NUM> service is configured to select a route from the routes (alternate routes <NUM>, <NUM> and perhaps also the current route <NUM>) for use in at least one of guidance, navigation or control of the robot to avoid the conflict. The route selector service may be configured to output an indication of the route as selected. In some examples in which the routes are ranked, the route selector service may output an indication of one or more higher ranked ones of the routes. The route selector service may also output a status message with information such as the times or distances to the point of approach between the nearby moving object and the robot on the higher ranked ones of the routes.

In some examples, the MMS <NUM> and in particular the mission execution subsystem <NUM> of the MMS is configured to determine at least one maneuver to cause the robot to travel the route as selected, and the MMS is configured to cause the robot <NUM> to execute the at least one maneuver. In some examples in which the routes are ranked, the MMS is configured to determine at least one maneuver to cause the robot to travel a selected one of the one or more higher ranked ones of the routes <NUM>, <NUM>, <NUM>. This may include the MMS configured to send one or more maneuver commands to the RMS <NUM> to control the robot to follow the maneuver commands and thereby execute the at least one maneuver. The MMS may therefore be configured to cause the robot to travel the route as selected. <FIG> illustrates the robot as before, and one of the routes, in particular alternate route <NUM>, that the robot may be caused to travel to avoid conflict with the nearby moving object <NUM>.

In some examples in which the robot <NUM> is caused to travel one of the alternate routes (e.g., alternate route <NUM>), the mission execution subsystem <NUM> of the MMS <NUM> is further configured to cause the robot to return to the current route during travel of the robot on the one of the alternate routes. In this regard, the track management <NUM>, conflict detection <NUM>, alternate route generator <NUM> and route selector <NUM> services may continue as described above. The cost metric may be defined such that the current route <NUM> is the highest ranked one of the routes <NUM>, <NUM>, <NUM> when the conflict detection service no longer detects the conflict for the robot on the current route. The mission execution subsystem may then cause the robot to return to the current route.

Although described in the context of a nearby moving object, examples of the present disclosure may be equally applicable to a nearby stationary object or spatial condition such as a physical obstacle (e.g., man-made structures, terrain), weather condition, artificial threat or no-fly zone. In some of these examples, a position of the nearby stationary object or spatial condition may be accessed. A conflict between the robot and the nearby stationary object or spatial condition may be detected from a comparison of the robot on the trajectory of the robot, and the position of the nearby stationary object or spatial condition. Alternate routes may be determined, routes evaluated and a route selected in a manner the same as or similar to that described in the context of a nearby moving object. Other examples in the context of the nearby moving object described herein may also similarly be applied in the context of a nearby stationary object or spatial condition.

<FIG>, <FIG>, <FIG> are flowcharts illustrating various steps in a method <NUM> of detecting and avoiding conflict along a current route <NUM> of a robot, according to examples of the present disclosure. The method includes accessing a trajectory of the robot on the current route of the robot, and a predicted trajectory of a nearby moving object, as shown at block <NUM> of <FIG>. The method includes detecting a conflict between the robot and the nearby moving object from a comparison of the robot and the nearby moving object on respectively the trajectory of the robot, and the predicted trajectory of the nearby moving object, as shown at block <NUM>.

As also shown, the method <NUM> includes determining alternate routes <NUM>, <NUM> for the robot, each alternative route including an alternative route segment 602A, 604A offset <NUM> from the current route <NUM>, and a transition segment 602B, 604B from the current route to the alternative route segment, as shown at block <NUM>. The method includes evaluating routes including the alternate routes according to a cost metric that depends on a time or distance to a point of approach (e.g., closest point of approach) between the nearby moving object and the robot, and a distance from the current route, as shown at block <NUM>. In some examples, the cost metric further depends on at least one of terrain along the routes, or a state of an environment of the robot. And the method includes selecting a route from the routes for use in at least one of guidance, navigation or control of the robot to avoid the conflict, as shown at block <NUM>.

In some examples, the alternative route segment 602A, 604A is a predefined alternative route segment. In some of these examples, determining the alternate routes <NUM>, <NUM> at block <NUM> includes for an alternative route, accessing information that describes the predefined alternative route segment, and determining the transition segment 602B, 604B from the current route <NUM> to the predefined alternative route segment, as shown at blocks <NUM> and <NUM> of <FIG>.

In some examples, the current route <NUM> of the robot is described by at least one of a route command, a flight plan or a mission route. In some of these examples, the method <NUM> further includes determining the trajectory of the robot using the at least one of the route command, the flight plan or the mission route, as shown at block <NUM> of <FIG>.

In some examples, the offset <NUM> is a predefined geometric offset. In some of these examples, determining the alternate routes <NUM>, <NUM> at block <NUM> includes for an alternative route, accessing information that describes the predefined geometric offset, as shown at block <NUM> of <FIG>. The alternative route segment 602A, 604A having the predefined geometric offset is determined at block <NUM>. And the transition segment 602B, 604B is determined from the current route <NUM> to the alternative route segment as determined, as shown at block <NUM>.

In some examples, determining the alternate routes <NUM>, <NUM> at block <NUM> includes for an alternative route determining the offset <NUM> that is a function of at least one of a type of the robot, a state of the robot, or a status of the robot, as shown at block <NUM> of <FIG>. Also in some of these examples, determining the alternate routes includes for the alternative route, determining the alternative route segment 602A, 604A having the offset as determined, as shown at block <NUM>. And the transition segment 602B, 604B is determined from the current route <NUM> to the alternative route segment as determined, as shown at block <NUM>.

In some examples, the method <NUM> further includes causing <NUM> the robot to travel the route as selected, as shown at block <NUM> of <FIG>. And in some further examples in which the route is one of the alternate routes <NUM>, <NUM>, the method further includes causing the robot to return to the current route <NUM> during travel of the robot on the one of the alternate routes, as shown at block <NUM>.

According to examples of the present disclosure, the MMS <NUM> and its subsystems including the interface subsystem <NUM>, situational awareness subsystem <NUM>, mission planning subsystem <NUM>, mission coordination subsystem <NUM> and mission execution subsystem <NUM> may be implemented by various means. Means for implementing the MMS and its subsystems may include hardware, alone or under direction of one or more computer programs from a computer-readable storage medium. In some examples, one or more apparatuses may be configured to function as or otherwise implement the MMS and its subsystems shown and described herein. In examples involving more than one apparatus, the respective apparatuses may be connected to or otherwise in communication with one another in a number of different manners, such as directly or indirectly via a wired or wireless network or the like.

<FIG> illustrates an apparatus <NUM> according to some examples of the present disclosure. The apparatus may comprise, include or be embodied in one or more fixed or portable electronic devices. The apparatus may include one or more of each of a number of components such as, for example, processing circuitry <NUM> (e.g., processor unit) connected to a memory <NUM> (e.g., storage device).

The processing circuitry <NUM> may be composed of one or more processors alone or in combination with one or more memories. The processing circuitry may be any piece of computer hardware that is capable of processing information such as, for example, data, computer programs and/or other suitable electronic information. The processing circuitry is composed of a collection of electronic circuits some of which may be packaged as an integrated circuit or multiple interconnected integrated circuits (an integrated circuit at times more commonly referred to as a "chip"). The processing circuitry may be configured to execute computer programs, which may be stored onboard the processing circuitry or otherwise stored in the memory <NUM> (of the same or another apparatus).

The processing circuitry <NUM> may be a number of processors, a multi-core processor or some other type of processor, depending on the particular implementation. Further, the processing circuitry may be implemented using a number of heterogeneous processor systems in which a main processor is present with one or more secondary processors on a single chip. In other illustrative examples, the processing circuitry may be a symmetric multi-processor system containing multiple processors of the same type. In yet other examples, the processing circuitry may be embodied as or otherwise include one or more ASICs, FPGAs or the like. Thus, although the processing circuitry may be capable of executing a computer program to perform one or more functions, the processing circuitry of various examples may be capable of performing one or more functions without the aid of a computer program. In either instance, the processing circuitry may be appropriately programmed to perform functions or operations according to examples of the present disclosure.

The memory <NUM> may be any piece of computer hardware that is capable of storing information such as, for example, data, computer programs (e.g., computer-readable program code <NUM>) and/or other suitable information either on a temporary basis and/or a permanent basis. The memory may include volatile and/or non-volatile memory, and may be fixed or removable. Examples of suitable memory include random access memory (RAM), read-only memory (ROM), a hard drive, a flash memory, a thumb drive, a removable computer diskette, an optical disk, a magnetic tape or some combination of the above. Optical disks may include compact disk - read only memory (CD-ROM), compact disk - read/write (CD-R/W), DVD or the like. In various instances, the memory may be referred to as a computer-readable storage medium. The computer-readable storage medium is a non-transitory device capable of storing information, and is distinguishable from computer-readable transmission media such as electronic transitory signals capable of carrying information from one location to another. Computer-readable medium as described herein may refer to a computer-readable storage medium or computer-readable transmission medium.

In addition to the memory <NUM>, the processing circuitry <NUM> may also be connected to one or more interfaces for displaying, transmitting and/or receiving information. The interfaces may include a communications interface <NUM> (e.g., communications unit) and/or one or more user interfaces. The communications interface may be configured to transmit and/or receive information, such as to and/or from other apparatus(es), network(s) or the like. The communications interface may be configured to transmit and/or receive information by physical (wired) and/or wireless communications links. Examples of suitable communication interfaces include a network interface controller (NIC), wireless NIC (WNIC) or the like.

The user interfaces may include a display <NUM> and/or one or more user input interfaces <NUM> (e.g., input/output unit). The display may be configured to present or otherwise display information to a user, suitable examples of which include a liquid crystal display (LCD), light-emitting diode display (LED), plasma display panel (PDP) or the like. The user input interfaces may be wired or wireless, and may be configured to receive information from a user into the apparatus, such as for processing, storage and/or display. Suitable examples of user input interfaces include a microphone, image or video capture device, keyboard or keypad, joystick, touch-sensitive surface (separate from or integrated into a touchscreen), biometric sensor or the like. The user interfaces may further include one or more interfaces for communicating with peripherals such as printers, scanners or the like.

As indicated above, program code instructions may be stored in memory, and executed by processing circuitry that is thereby programmed, to implement functions of the systems, subsystems, tools and their respective elements described herein. As will be appreciated, any suitable program code instructions may be loaded onto a computer or other programmable apparatus from a computer-readable storage medium to produce a particular machine, such that the particular machine becomes a means for implementing the functions specified herein. These program code instructions may also be stored in a computer-readable storage medium that can direct a computer, a processing circuitry or other programmable apparatus to function in a particular manner to thereby generate a particular machine or particular article of manufacture. The instructions stored in the computer-readable storage medium may produce an article of manufacture, where the article of manufacture becomes a means for implementing functions described herein. The program code instructions may be retrieved from a computer-readable storage medium and loaded into a computer, processing circuitry or other programmable apparatus to configure the computer, processing circuitry or other programmable apparatus to execute operations to be performed on or by the computer, processing circuitry or other programmable apparatus.

Retrieval, loading and execution of the program code instructions may be performed sequentially such that one instruction is retrieved, loaded and executed at a time. In some examples, retrieval, loading and/or execution may be performed in parallel such that multiple instructions are retrieved, loaded, and/or executed together. Execution of the program code instructions may produce a computer-implemented process such that the instructions executed by the computer, processing circuitry or other programmable apparatus provide operations for implementing functions described herein.

Execution of instructions by a processing circuitry, or storage of instructions in a computer-readable storage medium, supports combinations of operations for performing the specified functions. In this manner, an apparatus <NUM> may include a processing circuitry <NUM> and a computer-readable storage medium or memory <NUM> coupled to the processing circuitry, where the processing circuitry is configured to execute computer-readable program code <NUM> stored in the memory. It will also be understood that one or more functions, and combinations of functions, may be implemented by special purpose hardware-based computer systems and/or processing circuitry which perform the specified functions, or combinations of special purpose hardware and program code instructions.

Many modifications and other examples of the disclosure set forth herein will come to mind to one skilled in the art to which the disclosure pertains having the benefit of the teachings presented in the foregoing description and the associated figures. Therefore, it is to be understood that the disclosure is not to be limited to the specific examples disclosed and that modifications and other examples are intended to be included within the scope of the appended claims. Moreover, although the foregoing description and the associated figures describe examples in the context of certain example combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative examples without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims.

In a first example, not explicitly claimed herein but useful for understanding the claimed method, apparatus, computer program, and computer-readable medium, there is provided an apparatus for detecting and avoiding conflict along a current route of a robot, the apparatus comprising: a memory configured to store computer-readable program code; and processing circuitry configured to access the memory, and execute the computer-readable program code to cause the apparatus to at least: access a trajectory of the robot on the current route of the robot, and a predicted trajectory of a nearby moving object; detect a conflict between the robot and the nearby moving object from a comparison of the robot and the nearby moving object on respectively the trajectory of the robot, and the predicted trajectory of the nearby moving object; determine alternate routes for the robot, each alternative route including an alternative route segment offset from the current route, and a transition segment from the current route to the alternative route segment; evaluate routes including the alternate routes according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the robot, and a distance from the current route; and select a route from the routes for use in at least one of guidance, navigation or control of the robot to avoid the conflict.

In some examples, the alternative route segment is a predefined alternative route segment, and the apparatus caused to determine the alternate routes includes for an alternative route, the apparatus caused to at least: access information that describes the predefined alternative route segment; and determine the transition segment from the current route to the predefined alternative route segment.

In some examples, the current route of the robot is described by at least one of a route command, a flight plan or a mission route, and the processing circuitry is configured to execute the computer-readable program code to cause the apparatus to further determine the trajectory of the robot using the at least one of the route command, the flight plan or the mission route.

In some examples, the offset is a predefined geometric offset, and the apparatus caused to determine the alternate routes includes for an alternative route, the apparatus caused to at least: access information that describes the predefined geometric offset; determine the alternative route segment having the predefined geometric offset; and determine the transition segment from the current route to the alternative route segment as determined.

In some examples the apparatus caused to determine the alternate routes includes for an alternative route, the apparatus caused to at least: determine the offset that is a function of at least one of a type of the robot, a state of the robot, or a status of the robot; determine the alternative route segment having the offset as determined; and determine the transition segment from the current route to the alternative route segment as determined.

In some examples, the cost metric further depends on at least one of terrain along the routes, or a state of an environment of the robot.

In some examples, the processing circuitry is configured to execute the computer-readable program code to cause the apparatus to further cause the robot to travel the route as selected.

In some examples, the processing circuitry is configured to execute the computer-readable program code to cause the apparatus to further at least: cause the robot to travel the route that is one of the alternate routes; and cause the robot to return to the current route during travel of the robot on the one of the alternate routes.

In another example, not explicitly claimed herein but useful for understanding the claimed method, apparatus, computer program, and computer-readable medium, there is provided a method of detecting and avoiding conflict along a current route of a robot, the method comprising: accessing a trajectory of the robot on the current route of the robot, and a predicted trajectory of a nearby moving object; detecting a conflict between the robot and the nearby moving object from a comparison of the robot and the nearby moving object on respectively the trajectory of the robot, and the predicted trajectory of the nearby moving object; determining alternate routes for the robot, each alternative route including an alternative route segment offset from the current route, and a transition segment from the current route to the alternative route segment; evaluating routes including the alternate routes according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the robot, and a distance from the current route; and selecting a route from the routes for use in at least one of guidance, navigation or control of the robot to avoid the conflict.

In some examples, the alternative route segment is a predefined alternative route segment, and determining the alternate routes comprises for an alternative route: accessing information that describes the predefined alternative route segment; and determining the transition segment from the current route to the predefined alternative route segment.

In some examples, the current route of the robot is described by at least one of a route command, a flight plan or a mission route, and the method further comprises determining the trajectory of the robot using the at least one of the route command, the flight plan or the mission route.

In some examples, the offset is a predefined geometric offset, and determining the alternate routes comprises for an alternative route: accessing information that describes the predefined geometric offset; determining the alternative route segment having the predefined geometric offset; and determining the transition segment from the current route to the alternative route segment as determined.

In some examples, determining the alternate routes comprises for an alternative route: determining the offset that is a function of at least one of a type of the robot, a state of the robot, or a status of the robot; determining the alternative route segment having the offset as determined; and determining the transition segment from the current route to the alternative route segment as determined.

In some examples, the method further comprises causing the robot to travel the route as selected.

In some examples, the method further comprises: causing the robot to travel the route that is one of the alternate routes; and causing the robot to return to the current route during travel of the robot on the one of the alternate routes.

In another example, not explicitly claimed herein but useful for understanding the claimed method, apparatus, computer program, and computer-readable medium, there is provided a computer-readable storage medium for detecting and avoiding conflict along a current route of a robot, the computer-readable storage medium being non-transitory and having computer-readable program code stored therein that, in response to execution by processing circuitry, causes an apparatus to at least: access a trajectory of the robot on the current route of the robot, and a predicted trajectory of a nearby moving object; detect a conflict between the robot and the nearby moving object from a comparison of the robot and the nearby moving object on respectively the trajectory of the robot, and the predicted trajectory of the nearby moving object; determine alternate routes for the robot, each alternative route including an alternative route segment offset from the current route, and a transition segment from the current route to the alternative route segment; evaluate routes including the alternate routes according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the robot, and a distance from the current route; and select a route from the routes for use in at least one of guidance, navigation or control of the robot to avoid the conflict.

In some examples, the current route of the robot is described by at least one of a route command, a flight plan or a mission route, and the computer-readable storage medium has further computer-readable program code stored therein that, in response to execution by the processing circuitry, causes the apparatus to further determine the trajectory of the robot using the at least one of the route command, the flight plan or the mission route.

In some examples, the apparatus caused to determine the alternate routes includes for an alternative route, the apparatus caused to at least: determine the offset that is a function of at least one of a type of the robot, a state of the robot, or a status of the robot; determine the alternative route segment having the offset as determined; and determine the transition segment from the current route to the alternative route segment as determined.

In some examples, the computer-readable storage medium has further computer-readable program code stored therein that, in response to execution by the processing circuitry, causes the apparatus to further cause the robot to travel the route as selected.

Claim 1:
A method (<NUM>) of detecting and avoiding conflict along a current route (<NUM>) of an unmanned aerial vehicle (<NUM>), the method comprising:
accessing (<NUM>) a trajectory of the unmanned aerial vehicle on the current route of the unmanned aerial vehicle, and a predicted trajectory of a nearby moving object;
detecting (<NUM>) a conflict between the unmanned aerial vehicle and the nearby moving object from a comparison of the unmanned aerial vehicle and the nearby moving object on respectively the trajectory of the unmanned aerial vehicle, and the predicted trajectory of the nearby moving object;
determining (<NUM>) a plurality of alternate routes (<NUM>, <NUM>) for the unmanned aerial vehicle, each alternate route including an alternate route segment (602A, 604A) offset (<NUM>) from the current route by a fixed offset, and a transition segment (602B, 604B) from the current route to the alternate route segment;
evaluating (<NUM>) routes, including the plurality of alternate routes, according to a cost metric that depends on a time or distance to a point of approach between the nearby moving object and the unmanned aerial vehicle, and a distance from the current route, wherein the cost metric is defined such that the current route (<NUM>) is the highest ranked one of the routes (<NUM>, <NUM>, <NUM>) when the conflict is no longer detected for the unmanned aerial vehicle (<NUM>) on the current route and higher ranked routes are those with a longer time or distance to the point of approach, and/or closest to the current route (<NUM>);
selecting (<NUM>) one of the alternate routes from the plurality of alternate routes for use in at least one of guidance, navigation or control of the unmanned aerial vehicle to avoid the conflict, wherein the selected alternate route is a higher ranked route;
causing (<NUM>) the unmanned aerial vehicle (<NUM>) to travel the selected alternate route (<NUM>, <NUM>) to avoid the conflict; and
causing (<NUM>) the unmanned aerial vehicle (<NUM>) to return to the current route (<NUM>) during travel of the unmanned aerial vehicle (<NUM>) on the alternate route.