# Patent

## Title
Method, apparatus and server for real-time learning of travelling strategy of driverless vehicle

## Abstract

A method, apparatus and server for real-time learning of a travelling strategy of a driverless vehicle are provided. The method includes: when a first travelling strategy of the driverless vehicle is unable to be generated, recording travelling trajectories of other vehicles on a road; when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generating a second travelling strategy using the same travelling trajectory; and controlling the driverless vehicle to travel using the second travelling strategy. A situation in which a driverless vehicle is unable to normally generate a travelling strategy can be improved effectively.

## Background
CROSS-REFERENCE TO RELATED APPLICATION
This application claims priority to Chinese Patent Application No. 201910124914.1, entitled “Method, Apparatus, and Server for Real-Time Learning of Travelling Strategy of Driverless Vehicle”, and filed on Feb. 19, 2019, which is hereby incorporated by reference in its entirety.
TECHNICAL FIELD
The present disclosure relates to driverless vehicles, and particularly to a method, apparatus, server, system and device for real-time learning of a travelling strategy of a driverless vehicle, and a storage medium.
BACKGROUND
During a travelling of a driverless vehicle, a travelling strategy may be generated according to routing information, surrounding obstacle information, self-state information and the like, to control the travel of the driverless vehicle based on the travelling strategy.
SUMMARY
The embodiments of the present disclosure provide a method, apparatus, server, system and device for real-time learning of a travelling strategy of a driverless vehicle, and a storage medium, so as to at least solve the above technical problems in the existing technology.
According to a first aspect, a method for real-time learning of a travelling strategy of a driverless vehicle, includes:
when a first travelling strategy of the driverless vehicle is unable to be generated, recording travelling trajectories of other vehicles on a road;
when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generating a second travelling strategy using the same travelling trajectory; and
controlling the driverless vehicle to travel using the second travelling strategy.
In an embodiment, the method further includes:
reporting the second travelling strategy to a server, and/or transmitting the second travelling strategy to at least one other driverless vehicle.
In an embodiment, the method further includes:
when a third travelling strategy is received from a server, determining whether the first travelling strategy is able to be generated by the driverless vehicle; controlling the driverless vehicle to travel using the first travelling strategy and transmitting to the server a report indicating that a second driverless vehicle does not use the third travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and controlling the driverless vehicle to travel using the third travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
In an embodiment, the method further includes:
when the second travelling strategy is received from the at least one other driverless vehicle, determining whether the first travelling strategy is able to be generated by the driverless vehicle; controlling the driverless vehicle to travel using the first travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and controlling the driverless vehicle to travel using the second travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
According to a second aspect, a method for real-time learning of a travelling strategy of a driverless vehicle, includes:
receiving a second travelling strategy from a first driverless vehicle, and obtaining a position corresponding to the second travelling strategy; and
when the number of received same second travelling strategies is greater than a preset second number threshold, determining the same second travelling strategy as a third travelling strategy, and storing the third travelling strategy and the corresponding position.
In an embodiment, the method further includes:
when a distance from a second driverless vehicle to a position corresponding to the third travelling strategy is detected to be less than a preset distance threshold, transmitting the third travelling strategy to the second driverless vehicle.
In an embodiment, the method further includes:
when the number of received reports indicating that the second driverless vehicle does not use the third travelling strategy exceeds a preset third number threshold, deleting the third travelling strategy and the corresponding position.
According to a third aspect, an apparatus for real-time learning of a travelling strategy of a driverless vehicle, includes:
a recording module configured to, when a first travelling strategy of the driverless vehicle is unable to be generated, record travelling trajectories of other vehicles on a road;
a generating module configured to when a number of vehicles on the same travelling trajectory is greater than a preset first number threshold, generate a second travelling strategy using a same travelling trajectory; and
a controlling module configured to control the driverless vehicle to travel using the second travelling strategy.
In an embodiment, the apparatus further includes:
a reporting module configured to report the second travelling strategy to a server, and/or to transmit the second travelling strategy to the at least one other driverless vehicle.
In an embodiment, the controlling module is further configured to:
when a third travelling strategy is received from a server, determine whether the first travelling strategy is able to be generated by the driverless vehicle; control the driverless vehicle to travel using the first travelling strategy and transmit to the server a report indicating that the second driverless vehicle does not use the third travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and control the driverless vehicle to travel using the third travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
In an embodiment, the controlling module is further configured to:
determine whether the first travelling strategy is able to be generated by the driverless vehicle, when the second travelling strategy is received from the at least one other driverless vehicle; control the driverless vehicle to travel using the first travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and control the driverless vehicle to travel using the second travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
According to a fourth aspect, a server for real-time learning of a travelling strategy of a driverless vehicle, includes:
a receiving and obtaining module configured to receive a second travelling strategy from a first driverless vehicle, and obtain a position corresponding to the second travelling strategy; and
a storing module configured to when the number of the received same second travelling strategies is greater than a preset second number threshold, determine the same second travelling strategy as a third travelling strategy, and store the third travelling strategy and the corresponding position.
In an embodiment, the server further includes:
a transmitting module configured to, when a distance from a second driverless vehicle to a position corresponding to the third travelling strategy is detected to be less than a preset distance threshold, transmit the third travelling strategy to the second driverless vehicle.
In an embodiment, the server further includes:
a deleting module configured to, when the number of received reports indicating that the second driverless vehicle does not use the third travelling strategy exceeds a preset third number threshold, delete the third travelling strategy and the corresponding position.
According to a fifth aspect, a system for real-time learning of a travelling strategy of a driverless vehicle, includes the apparatus according to any one of the embodiments of the third aspect and the server according to any one of the embodiments of the fourth aspect.
According to a sixth aspect, a device for real-time learning of a travelling strategy of a driverless vehicle is provided, and the functions thereof can be implemented by hardware or by hardware to execute corresponding software. The hardware or the software includes one or more modules corresponding to the above functions.
In a possible embodiment, the structure of the device includes a memory configured to store a program for supporting the device to perform the above method for real-time learning of a travelling strategy of a driverless vehicle, and a processor configured to execute the program stored in the memory. The device may further include a communication interface configured to be communicated with other device or a communication network.
According to a seventh aspect, a non-volatile computer-readable storage medium is provided for storing computer software instructions used by a device for real-time learning of a travelling strategy of an driverless vehicle, and the computer software instructions include programs involved in execution of the method for real-time learning of a travelling strategy of a driverless vehicle.
The above technical solution improves the following advantages or beneficial effects: when a first travelling strategy is unable to be normally generated by a vehicle, the vehicle may learn the travelling trajectories of other vehicles in real time, so that a second travelling strategy is generated based on the learned travelling trajectory, and the driverless vehicle is controlled to travel using the second travelling strategy.
The above summary is for the purpose of the specification only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and characters described above, further aspects, embodiments, and characters of the present application will be readily understood by reference to the drawings and the following detailed description.



BRIEF DESCRIPTION OF THE DRAWINGS
In the drawings, unless otherwise specified, identical reference numerals will be used throughout the drawings to refer to identical or similar parts or elements. The drawings are not necessarily drawn to scale. It should be understood that these drawings depict only some embodiments disclosed in accordance with the present application and are not to be considered as limiting the scope of the present application.
FIG. 1 illustrates a flowchart of a method for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of an application scene according to an embodiment of the present disclosure;
FIG. 3 illustrates a flowchart of another method for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 4 illustrates a flowchart of another method for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 5 illustrates a flowchart of another method for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 6 illustrates a schematic diagram of an apparatus for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 7 illustrates a schematic diagram of another apparatus for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 8 illustrates a schematic diagram of a server for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure;
FIG. 9 illustrates a schematic diagram of another server for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure; and
FIG. 10 illustrates a schematic diagram of a device for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure.



DETAILED DESCRIPTION OF THE EMBODIMENTS
In the following, only certain exemplary embodiments are briefly described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present application. Accordingly, the drawings and description are to be regarded as illustrative in nature and not restrictive.
Here, the routing solves an issue of the driverless vehicle from a start point to a destination, and the routing information is generated depending on a high-precision map (HD-Map) of the driverless vehicle. The travelling strategy determines the travelling situations of the driverless vehicles, which normally includes: following a vehicle on a road, waiting at the traffic lights, yielding before the pedestrians, and passing by other vehicles at intersection. For example, the routing information requires the driverless vehicle to keep travelling in the current lane, and another vehicle is travelling in front of this driverless vehicle. In this case, the travelling strategy is likely to be following another vehicle.
Under some special situations, the driverless vehicle is unable to generate the travelling strategy normally. For example, the road is closed temporarily, and a high-precision map is not modified. When the driverless vehicle travels to the temporarily closed road, it cannot continue travelling with an obstacle ahead based on the previous routing information. In this case, the driverless vehicle is unable to normally generate a travelling strategy.
In the existing technology, when the travelling strategy is unable to be normally generated, the driverless vehicle cannot deal with the situations effectively.
The present disclosure mainly provides a method and apparatus for real-time learning of a travelling strategy of a driverless vehicle. The details will be described by the following embodiments.
FIG. 1 illustrates a flowchart of a method for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure. As illustrated in FIG. 1, the method includes:
S11: when a first travelling strategy of the driverless vehicle is unable to be generated, recording travelling trajectories of other vehicles on a road;
S12: when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generating a second travelling strategy using the same travelling trajectory; and
S13: controlling the driverless vehicle to travel using the second travelling strategy.
FIG. 2 is a schematic diagram of an application scene according to an embodiment of the present disclosure. In FIG. 2, the driverless vehicle travels in a right lane, and a left lane is a reverse lane. In a running process, the driverless vehicle senses a static obstacle ahead, while the routing information intends to go straight along the current lane. Since the routing information is not consistent with the sense information, the driverless vehicle is unable to normally generate a travelling strategy.
In a possible embodiment, when the driverless vehicle is unable to generate a travelling strategy (hereinafter, the travelling strategy generated by the driverless vehicle using the existing technology is referred to a first travelling strategy), it may stop at a safe position and record the travelling trajectories of other vehicles on the road. As illustrated in FIG. 2, an arrowed curve shows a travelling trajectory related to other vehicles. Here, ‘the travelling trajectories of other vehicle’ does not mean that the other vehicles are travelling exactly along this route, but represents a travelling strategy of other vehicles. For example in FIG. 2, the travelling trajectory illustrated by the arrowed curve may indicate to temporarily occupy the left reverse lane in order to avoid the obstacle, and to return to the right lane and continue to go straight.
When the number of vehicles on the same travelling trajectory is greater than a preset first number threshold, it is reasonable to use this travelling trajectory according to the embodiments of the present disclosure. A second travelling strategy is able to be generated based on the same travelling trajectory, and the driverless vehicle may be controlled using the second travelling strategy.
Further, the driverless vehicle may report the generated second travelling strategy to a server. When the number of the received same second travelling strategies is greater than a preset second number threshold, the server determines that the same second travelling strategy is valid and sets the same second travelling strategy as a third travelling strategy. The server may provide the third travelling strategy to other driverless vehicles for reference.
Alternatively, the driverless vehicle may further transmit the generated second travelling strategy to other driverless vehicles for reference. For example, the driverless vehicle may transmit the second travelling strategy to other driverless vehicles within a detected range of the driverless vehicle.
Hereinafter, the driverless vehicle that generates the second travelling strategy is referred to a first driverless vehicle, and the driverless vehicle that receives the second travelling strategy (from the first driverless vehicle) or the third travelling strategy (from the server) is referred to a second driverless vehicle.
When the second driverless vehicle receives the third travelling strategy and is able to be generate the first travelling strategy, the second driverless vehicle may report this situation to the server. For example, as illustrated in FIG. 2, after the obstacle on the road is removed, the second driverless vehicle is able to generate the first traveling strategy when travelling thereon.
The server may delete the third travelling strategy when receiving the information reported by the second driverless vehicle several times.
Based on the above, a flowchart of another method for real-time learning of a travelling strategy of a driverless vehicle is provided. As illustrated in FIG. 3, the method includes:
S11: when a first travelling strategy of the driverless vehicle is unable to be generated, recording travelling trajectories of other vehicles on a road.
S12: when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generating a second travelling strategy using the same travelling trajectory.
S13: controlling the driverless vehicle to travel using the second travelling strategy.
S11 to S13 are the same as the above embodiment, and will not be described again.
S34: reporting the second travelling strategy to a server, and/or transmitting the second travelling strategy to other driverless vehicle.
Since the other driverless vehicles are nearby the detected range of the driverless vehicles, the other driverless vehicles in the detected range of the driverless vehicles are likely unable to generate the first travelling strategy. The second travelling strategy may be directly transmitted to other driverless vehicles within the detected range for reference.
In a possible embodiment, the second travelling strategy may be transmitted to other driverless vehicles in a same travelling direction as the main driverless vehicle.
S35: when a third travelling strategy is received from a server, determining whether the first travelling strategy is able to be generated by the driverless vehicle; controlling the driverless vehicle to travel using the first travelling strategy and transmitting to the server a report indicating that the second driverless vehicle does not use the third travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and controlling the driverless vehicle to travel using the third travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
In a possible embodiment, if the third travelling strategy is used to control the driverless vehicle, a used report of the third travelling strategy may be reported to the server. The server may record relevant information such as the times and the duration of using the third travelling strategy. When the duration of using the third travelling strategy is long, it indicates that the temporary road conditions corresponding to the position may become the long-term road conditions. Thus, information related to the road in the high-precision map may be updated as needed.
S36: when the second travelling strategy is received from the at least one other driverless vehicle, determining whether the first travelling strategy is able to be generated by the driverless vehicle; controlling the driverless vehicle to travel using the first travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and controlling the driverless vehicle to travel using the second travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
The above S34 to S36 describe three different embodiments, and they are not limited in their execution orders.
Another method for real-time learning of a travelling strategy of a driverless vehicle is provided, which may be applied to a server side. FIG. 4 illustrates a flowchart of the method, includes:
S41: receiving a second travelling strategy from a first driverless vehicle, and obtaining a position corresponding to the second travelling strategy.
In a possible embodiment, the position corresponding to the second travelling strategy may be a position at which the first driverless vehicle generates or transmits the second travelling strategy, or a position of an obstacle resulting in that the first driverless vehicle is unable to generate the first travelling strategy.
S42: when the number of received same second travelling strategies is greater than a preset second number threshold, determining the same second travelling strategy as a third travelling strategy, and storing the third travelling strategy and the corresponding position.
Another method for real-time learning of a travelling strategy of a driverless vehicle is provided, which may be applied to a server side. FIG. 5 illustrates a flowchart of the method, includes:
S41: receiving a second travelling strategy from a first driverless vehicle, and obtaining a position corresponding to the second travelling strategy.
S42: when the number of received same second travelling strategies is greater than a preset second number threshold, determining the same second travelling strategy as a third travelling strategy, and storing the third travelling strategy and the corresponding position.
S43: when a distance from a second driverless vehicle to a position corresponding to the third travelling strategy is detected to be less than a preset distance threshold, transmitting the third travelling strategy to the second driverless vehicle.
When a distance from the second driverless vehicle to the obtained position is less than a preset distance threshold, it indicates that the second driverless vehicle will be unable to generate the first travelling strategy. At this point, the second travelling strategy may be transmitted to the second driverless vehicle for reference.
In a possible embodiment, the server may transmit the second travelling strategy to the second driverless vehicle in the same travelling direction as the first driverless vehicle.
S44: when the number of received reports indicating that the second driverless vehicle does not use the third travelling strategy exceeds a preset third number threshold, deleting the third travelling strategy and the corresponding position.
In a possible embodiment, the used reports of the third travelling strategy may be received from the second driverless vehicle. For a certain third travelling strategy, when the number of received used reports of the third travelling strategy or duration exceeds a preset threshold, information related to the road in the high-precision map may be updated accordingly.
An apparatus for real-time learning of a travelling strategy of a driverless vehicle is provided. FIG. 6 illustrates a schematic diagram of an apparatus for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure, includes:
a recording module 601 configured to, when a first travelling strategy of the driverless vehicle is unable to be generated, record travelling trajectories of other vehicles on a road.
a generating module 602 configured to when a number of vehicles on the same travelling trajectory is greater than a preset first number threshold, generate a second travelling strategy using a same travelling trajectory.
a controlling module 603 configured to control the driverless vehicle to travel using the second travelling strategy.
Another apparatus for real-time learning of a travelling strategy of a driverless vehicle is provided. FIG. 7 is a schematic diagram of the apparatus, includes:
a recording module 601 configured to, when a first travelling strategy of the driverless vehicle is unable to be generated, record travelling trajectories of other vehicles on a road.
a generating module 602 configured to when a number of vehicles on the same travelling trajectory is greater than a preset first number threshold, generate a second travelling strategy using a same travelling trajectory.
a controlling module 603 configured to control the driverless vehicle to travel using the second travelling strategy.
a reporting module 704 configured to report the second travelling strategy to a server, and/or to transmit the second travelling strategy to other driverless vehicles.
In a possible embodiment, the controlling module 603 is further configured to:
when a third travelling strategy is received from a server, determine whether the first travelling strategy is able to be generated by the driverless vehicle; control the driverless vehicle to travel using the first travelling strategy and transmit to the server a report indicating that the second driverless vehicle does not use the third travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and control the driverless vehicle to travel using the third travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
In a possible embodiment, the controlling module 603 is further configured to:
determine whether the first travelling strategy is able to be generated by the driverless vehicle, when the second travelling strategy is received from other driverless vehicle; control the driverless vehicle to travel using the first travelling strategy, if the first travelling strategy is able to be generated by the driverless vehicle; and control the driverless vehicle to travel using the second travelling strategy, if the first travelling strategy is unable to be generated by the driverless vehicle.
A server for real-time learning of a travelling strategy of a driverless vehicle is provided. FIG. 8 is a schematic diagram of the server, includes:
a receiving and obtaining module 801 configured to receive a second travelling strategy from a first driverless vehicle, and obtain a position corresponding to the second travelling strategy.
a storing module 802 configured to when the number of the received same second travelling strategies is greater than a preset second number threshold, determine the same second travelling strategy as a third travelling strategy, and store the third travelling strategy and the corresponding position.
Another server for real-time learning of a travelling strategy of a driverless vehicle is provided. FIG. 9 is a schematic diagram of the server, includes:
a receiving and obtaining module 801 configured to receive a second travelling strategy from a first driverless vehicle, and obtain a position corresponding to the second travelling strategy.
a storing module 802 configured to when the number of the received same second travelling strategies is greater than a preset second number threshold, determine the same second travelling strategy as a third travelling strategy, and store the third travelling strategy and the corresponding position.
a transmitting module 903 configured to, when a distance from a second driverless vehicle to a position corresponding to the third travelling strategy is detected to be less than a preset distance threshold, transmit the third travelling strategy to the second driverless vehicle.
a deleting module 904 configured to, when the number of received reports indicating that the second driverless vehicle does not use the third travelling strategy exceeds a preset third number threshold, delete the third travelling strategy and the corresponding position.
The function of each of the modules in the apparatus according to the embodiments of the present disclosure may refer to descriptions in the above method, and will not be repeated here.
A system for real-time learning of a travelling strategy of a driverless vehicle is provided, including a server and the apparatuses according to the above embodiments, wherein each apparatus may be provided on one driverless vehicle. Each apparatus is communicatively connected to the server, and the apparatuses may also be communicatively connected to each other. The communicative connections between the apparatus and the server, and among the apparatuses can be realized in a Vehicle to Everything (V2X) mode.
A device for real-time learning of a travelling strategy of a driverless vehicle is provided. FIG. 10 illustrates a schematic diagram of a device for real-time learning of a travelling strategy of a driverless vehicle according to an embodiment of the present disclosure, includes:
a memory 11 and a processor 12, wherein a computer program executable on the processor 12 is stored in the memory 11. When the processor 12 executes the computer program, the method for real-time learning of a travelling strategy of a driverless vehicle in the above embodiment is implemented. There may be one or more memories 11 and one or more processors 12.
The device may further include a communication interface 13 configured to communicate with an external device for a data interactive transmission.
The memory 11 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk memory.
If the memory 11, the processor 12, and the communication interface 13 are implemented independently, the memory 11, the processor 12, and the communication interface 13 may be connected to each other through a bus and communicate with one another. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, an Extended Industry Standard Component (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one bold line is shown in FIG. 10, but it does not mean that there is only one bus or one type of bus.
Optionally, in a specific implementation, if the memory 11, the processor 12, and the communication interface 13 are integrated on one chip, the memory 12, the processor 12, and the communication interface 13 may implement mutual communication through an internal interface.
According to an embodiment of the present disclosure, a non-volatile computer-readable storage medium is provided for storing computer software instructions, which include programs involved in execution of the above method.
In the description of the specification, the description of the terms “one embodiment,” “some embodiments,” “an example,” “a specific example,” or “some examples” and the like means the specific characters, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. Furthermore, the specific characters, structures, materials, or characteristics described may be combined in any suitable manner in any one or more of the embodiments or examples. In addition, different embodiments or examples described in this specification and characters of different embodiments or examples may be incorporated and combined by those skilled in the art without mutual contradiction.
In addition, the terms “first” and “second” are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical characters. Thus, characters defining “first” and “second” may explicitly or implicitly include at least one of the characters. In the description of the present application, “a plurality of” means two or more, unless expressly limited otherwise.
Any process or method descriptions described in flowcharts or otherwise herein may be understood as representing modules, segments or portions of code that include one or more executable instructions for implementing the steps of a particular logic function or process. The scope of the preferred embodiments of the present application includes additional implementations where the functions may not be performed in the order shown or discussed, including according to the functions involved, in substantially simultaneous or in reverse order, which should be understood by those skilled in the art to which the embodiment of the present application belongs.
Logic and/or steps, which are represented in the flowcharts or otherwise described herein, for example, may be thought of as a sequencing listing of executable instructions for implementing logic functions, which may be embodied in any non-volatile computer-readable medium, for use by or in connection with an instruction execution system, device, or apparatus (such as a computer-based system, a processor-included system, or other system that fetch instructions from an instruction execution system, device, or apparatus and execute the instructions). For the purposes of this specification, a “non-volatile computer-readable medium” may be any device that may contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, device, or apparatus. More specific examples (not a non-exhaustive list) of the computer-readable media include the following: electrical connections (electronic devices) having one or more wires, a portable computer disk cartridge (magnetic device), random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber devices, and portable read only memory (CDROM). In addition, the non-volatile computer-readable medium may even be paper or other suitable medium upon which the program may be printed, as it may be read, for example, by optical scanning of the paper or other medium, followed by editing, interpretation or, where appropriate, process otherwise to electronically obtain the program, which is then stored in a computer memory.
It should be understood that various portions of the present application may be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, they may be implemented using any one or a combination of the following techniques well known in the art: discrete logic circuits having a logic gate circuit for implementing logic functions on data signals, application specific integrated circuits with suitable combinational logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGAs), and the like.
Those skilled in the art may understand that all or some of the steps carried in the methods in the foregoing embodiments may be implemented by a program instructing relevant hardware. The program may be stored in a non-volatile computer-readable storage medium, and when executed, one of the steps of the method embodiment or a combination thereof is included.
In addition, each of the functional units in the embodiments of the present application may be integrated in one processing module, or each of the units may exist alone physically, or two or more units may be integrated in one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of software functional module. When the integrated module is implemented in the form of a software functional module and is sold or used as an independent product, the integrated module may also be stored in a computer-readable storage medium. The storage medium may be a read only memory, a magnetic disk, an optical disk, or the like.
The foregoing descriptions are merely specific embodiments of the present application, but not intended to limit the protection scope of the present application. Those skilled in the art may easily conceive of various changes or modifications within the technical scope disclosed herein, all these should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

## Claims

1. A method for real-time learning of a travelling strategy of a driverless vehicle, comprising:
determining whether a first travelling strategy of the driverless vehicle is unable to be generated according to routing information depending on a high-precision map and surrounding obstacle information of the driverless vehicle;
in response to determining that the first travelling strategy of the driverless vehicle is unable to be generated according to the routing information depending on the high-precision map and the surrounding obstacle information, of the driverless vehicle, recording travelling trajectories of other vehicles on a road;
when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generating a second travelling strategy using the same travelling trajectory; and
controlling the driverless vehicle to travel using the second travelling strategy,
wherein the method further comprises:
when a third travelling strategy is received by a second driverless vehicle from a server, determining whether the first travelling strategy is able to be generated by the second driverless vehicle; and,
in response to the first travelling strategy being unable to be generated by the second driverless vehicle, controlling the second driverless vehicle to travel using the third travelling strategy and transmitting a used report indicating that the third travelling strategy has been used to the server, such that the server records a number of used reports and a duration of receiving used reports, and updates the high-precision map in response to the number of used reports is greater than a report threshold or the duration is longer than a duration threshold.

2. The method according to claim 1, further comprising:
reporting the second travelling strategy to the server, and/or transmitting the second travelling strategy to at least one other driverless vehicle.

3. The method according to claim 1, further comprising:
controlling the second driverless vehicle to travel using the first travelling strategy and transmitting to the server a report indicating that the second driverless vehicle does not use the third travelling strategy, if the first travelling strategy is able to be generated by the second driverless vehicle.

4. A non-volatile computer-readable storage medium storing a computer program, wherein the computer program implements the method according to claim 1 when being executed by a processor.

5. An apparatus for real-time learning of a travelling strategy of a driverless vehicle, comprising:
one or more processors;
a storage device configured to store one or more programs;
wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
determine whether a first travelling strategy of the driverless vehicle is unable to be generated according to routing information depending on a high-precision map and surrounding obstacle information of the driverless vehicle;
in response to determining that the first travelling strategy of the driverless vehicle is unable to be generated according to the routing information depending on the high-precision map and the surrounding obstacle information, of the driverless vehicle, record travelling trajectories of other vehicles on a road;
when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generate a second travelling strategy using the same travelling trajectory; and
control the driverless vehicle to travel using the second travelling strategy,
wherein the one or more programs are executed by the one or more processors to enable the one or more processors further to:
when a third travelling strategy is received by a second driverless vehicle from a server, determine whether the first travelling strategy is able to be generated by the second driverless vehicle;
in response to the first travelling strategy being unable to be generated by the second driverless vehicle, control the second driverless vehicle to travel using the third travelling strategy and transmit a used report indicating that the third travelling strategy has been used to the server, such that the server records a number of used reports and a duration of receiving used reports, and updates the high-precision map in response to the number of used reports is greater than a report threshold or the duration is longer than a duration threshold.

6. The apparatus according to claim 5, wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
report the second travelling strategy to the server, and/or to transmit the second travelling strategy to at least one other driverless vehicle.

7. The apparatus according to claim 5, wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
control the second driverless vehicle to travel using the first travelling strategy and transmit to the server a report indicating that the second driverless vehicle does not use the third travelling strategy, if the first travelling strategy is able to be generated by the second driverless vehicle.

8. A server for real-time learning of a travelling strategy of a driverless vehicle, comprising:
one or more processors;
a storage device configured to store one or more programs;
wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
receive a second travelling strategy from a first driverless vehicle, and obtain a position corresponding to the second travelling strategy; wherein the second travelling strategy is generated by: determining whether a first travelling strategy of the first driverless vehicle is unable to be generated according to routing information depending on a high-precision map and surrounding obstacle information, of the first driverless vehicle; in response to determining that the first travelling strategy of the first driverless vehicle is unable to be generated according to the routing information depending on the high-precision map and the surrounding obstacle information, of the first driverless vehicle, recording travelling trajectories of other vehicles on a road; when a number of vehicles on a same travelling trajectory is greater than a preset first number threshold, generating the second travelling strategy using the same travelling trajectory; and
when a number of received same second travelling strategies is greater than a preset second number threshold, determine the second travelling strategy as a third travelling strategy, and store the third travelling strategy and the corresponding position,
wherein the one or more programs are executed by the one or more processors to enable the one or more processors further to:
send the third travelling strategy to a second driverless vehicle, such that the second driverless vehicle determines whether the first travelling strategy is able to be generated, and is controlled to travel using the third travelling strategy in response to determining that the first travelling strategy being unable to be generated; and
in response to receiving used reports indicating that the third travelling strategy has been used, record a number of the used reports and a duration of receiving the used reports, and update the high-precision map in response to the number of used reports is greater than a report threshold or the duration is longer than a duration threshold.

9. The server according to claim 8, wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
when a distance from a second driverless vehicle to a position corresponding to the third travelling strategy is detected to be less than a preset distance threshold, transmit the third travelling strategy to the second driverless vehicle.

10. The server according to claim 9, wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
when a number of received reports from the second driverless vehicle indicating that the second driverless vehicle does not use the third travelling strategy exceeds a preset third number threshold, delete the third travelling strategy and the corresponding position.

11. The server according to claim 8, wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:
when a number of received reports from a second driverless vehicle indicating that the second driverless vehicle does not use the third travelling strategy exceeds a preset third number threshold, delete the third travelling strategy and the corresponding position.