Patent ID: 11967239
Assignee: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. One or more non-transitory computer-readable storage media storing instructions executable by one or more processors, wherein execution of the instructions causes the one or more processors to perform operations comprising:
obtaining an offline state value network for predicting a value of a vehicle state, the offline state value network being trained based on a plurality of historical vehicle trajectories wherein the plurality of historical vehicle trajectories comprises a plurality of vehicle state transitions;
initializing an online state value network and dispatching a plurality of vehicles according to the online state value network for a period of time;
training the online state value network based on vehicle states of the plurality of vehicles before and after the dispatching and rewards associated with the dispatching;
ensembling the trained online state value network and the offline state value network to obtain an ensembled online state value network;
dispatching the plurality of vehicles according to the ensembled online state value network for a second period of time to obtain online training data; and
retraining the online state value network using the online training data obtained from the second period of time, and ensembling the retrained online state value network and the offline state value network to serve vehicle dispatching for a next period of time;
wherein the online state value network is retrained more frequently than the offline state value network.