Patent ID: 11967239
Assignee: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. The storage media of claim 14, wherein the operations further comprise:
training the offline state value network, wherein the training of the offline state value network comprises:
extracting the plurality of vehicle state transitions from the plurality of historical vehicle trajectories;
for each vehicle state transition extracted from the plurality of historical vehicle trajectories, determining, using the offline state value network, a first vehicle state value before the each vehicle state transition and a second vehicle state value after the each vehicle state transition,
constructing an objective function based on a squared error of the first vehicle state value, the second vehicle state value, and a reward associated with the each vehicle state transition; and
updating parameters of the offline state value network to minimize the objective function.