An image evaluation method using a server for communicating with a portable terminal and a sensor terminal located in an agricultural field, the server including a storage unit, the method comprising the steps of, by the server: for each of animal or plant species, storing in the storage unit, animal or plant species images corresponding to respective animal or plant species, and occurrence environmental information representing the range of environmental information in which respective animal or plant species easily occurs; storing in the storage unit, crop information corresponding to a crop cultivated in the agricultural field and environmental information transmitted from the sensor terminal, the crop information and the environmental information associated with the sensor terminal; receiving a captured image transmitted from the portable terminal; receiving the environmental information measured by the sensor terminal from the sensor terminal; for each of animal or plant species images, generating a classification model for a feature vector corresponding to a local image feature amount for each feature point in each of animal or plant species images, and generating a feature vector corresponding to the local image feature amount for the captured image; assigning a point to a name of a type of disease or insect damage for each animal or plant species based on the classification model for corresponding animal or plant species images and the feature vector for the captured image; extracting the crop information corresponding to the crop cultivated in the agricultural field, the crop information associated with the sensor terminal; extracting the occurrence environmental information associated with the extracted crop information; determining whether or not the extracted occurrence environmental information includes the received environmental information from the sensor terminal; when it is determined that the extracted occurrence environmental information includes the received environmental information from the sensor terminal, extracting the_ name of the disease or insect damage for the animal or plant species corresponding to the extracted occurrence environmental information, and weighting the point of the extracted name according to the environmental information; and transmitting a name having a highest point of the points to the portable terminal having transmitted the captured image as an evaluation result name. for each of animal or plant species, storing in the storage unit, animal or plant species images corresponding to respective animal or plant species, and occurrence environmental information representing the range of environmental information in which respective animal or plant species easily occurs; storing in the storage unit, crop information corresponding to a crop cultivated in the agricultural field and environmental information transmitted from the sensor terminal, the crop information and the environmental information associated with the sensor terminal; receiving a captured image transmitted from the portable terminal; receiving the environmental information measured by the sensor terminal from the sensor terminal; for each of animal or plant species images, generating a classification model for a feature vector corresponding to a local image feature amount for each feature point in each of animal or plant species images, and generating a feature vector corresponding to the local image feature amount for the captured image; assigning a point to a name of a type of disease or insect damage for each animal or plant species based on the classification model for corresponding animal or plant species images and the feature vector for the captured image; extracting the crop information corresponding to the crop cultivated in the agricultural field, the crop information associated with the sensor terminal; extracting the occurrence environmental information associated with the extracted crop information; determining whether or not the extracted occurrence environmental information includes the received environmental information from the sensor terminal; when it is determined that the extracted occurrence environmental information includes the received environmental information from the sensor terminal, extracting the_ name of the disease or insect damage for the animal or plant species corresponding to the extracted occurrence environmental information, and weighting the point of the extracted name according to the environmental information; and transmitting a name having a highest point of the points to the portable terminal having transmitted the captured image as an evaluation result name.