An image processing apparatus, comprising: a storage unit configured to store map information to which object information indicating an object and a position thereof is added, and a plurality of different classifiers for classifying an object in an image; an object detecting unit configured to detect an object in a target image; and an object recognizing unit configured to select any of the classifiers based on a photographing position that is a position at which the target image has been photographed and the object information added to the map information and, using the selected classifier, recognize the object detected by the object detecting unit; wherein, when a determination result of the classifier is such that an object is not a sign, no sign information is transmitted to a server managing the map information, wherein, when the determination result of the classifier is such that an object is a sign indicated by the sign information added to the map information, no sign information is transmitted to the server, wherein, when a determination result of the classifier is such that an object is a sign and that there is a likelihood that the sign installed on site has been changed, an image and positional information of the sign are transmitted to the server, wherein, when there is sign information on the map and an object is not detected in the image, information describing the absence of the sign of the sign information and positional information is transmitted to the server, wherein, when sign information is absent from the map and the determination result of the classifier is such that an object is a sign, an image and positional information of the sign are transmitted to the server, and wherein, when sign information is absent from the map and the determination result of the classifier is such that an object is not a sign, nothing is transmitted to the server. a storage unit configured to store map information to which object information indicating an object and a position thereof is added, and a plurality of different classifiers for classifying an object in an image; an object detecting unit configured to detect an object in a target image; and an object recognizing unit configured to select any of the classifiers based on a photographing position that is a position at which the target image has been photographed and the object information added to the map information and, using the selected classifier, recognize the object detected by the object detecting unit; wherein, when a determination result of the classifier is such that an object is not a sign, no sign information is transmitted to a server managing the map information, wherein, when the determination result of the classifier is such that an object is a sign indicated by the sign information added to the map information, no sign information is transmitted to the server, wherein, when a determination result of the classifier is such that an object is a sign and that there is a likelihood that the sign installed on site has been changed, an image and positional information of the sign are transmitted to the server, wherein, when there is sign information on the map and an object is not detected in the image, information describing the absence of the sign of the sign information and positional information is transmitted to the server, wherein, when sign information is absent from the map and the determination result of the classifier is such that an object is a sign, an image and positional information of the sign are transmitted to the server, and wherein, when sign information is absent from the map and the determination result of the classifier is such that an object is not a sign, nothing is transmitted to the server.