Patent ID: 11860838
Assignee: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 9:
10. A non-transitory computer-readable storage medium, comprising computer executable instructions stored thereon, wherein the executable instructions, when executed by a computer, cause the computer to:
sample a data source according to an evaluation task for the data source, to obtain sampled data;
generate a labeling task from the sampled data;
send the labeling task to a labeling device; and
receive a labeled result of the labeling task from the labeling device,
wherein the executable instructions, when executed by a computer, further cause the computer to:
evaluate the received labeled result to obtain an evaluation result for the labeled result;
send the evaluation result for the labeled result to a server; and
receive an analysis result from the server, wherein the analysis result comprises labeled results of labeling tasks belonging to the same evaluation task and/or evaluation results for labeled results of labeling tasks belonging to the same evaluation task.