Patent ID: 11822969

Abstract:
The present application discloses a task allocation method and system based on a resource management platform. The method comprises: receiving an artificial intelligence model training and/or testing task and a name of data set required for processing the task; acquiring data set distribution information of a plurality of nodes; judging if the node has the required data sets according to names of the data sets in the node; and selecting a node with the size of the required data set meeting preset requirements for task allocation according to the size of the required data set in the node if the node has the required data set. It may be seen that, in the present application, the situation of data sets in a node is taken into account during task allocation, and the node with the size of the required data set meeting preset conditions is selected for task allocation, such that the node does not need to download the required data set or reduce the frequency of downloading data sets by a node, thereby improving the efficiency in processing tasks.