A sorting device comprising: a sensor unit (13a, 13b... 13n) configured to detect physical quantities from an object, which is a paper sheet or a parcel on which sorting information is indicated or on which a label with sorting information indicated thereon is attached, wherein the sensor unit includes an image sensor, a measurement sensor measuring a size of the object, and a quantity sensor measuring a weight of the object; a feature extracting unit configured to extract a plurality of types of feature values and respective features values from the physical quantities detected from the object by each sensor (13a, 13b... 13n); a feature searching unit configured to specify identification information of the object from a feature database which associates the values of the plurality of types of feature values extracted by the feature extracting unit and the identification information of the object in advance and stores the values of the plurality of feature values and the identification information of the object; wherein the feature searching unit is configured to vote on the identification information of the object corresponding to the values of the feature values extracted by the feature extracting unit, in a vote table in which a vote value for identification information of each object is recorded referring to the feature database, and to specify the identification information of the object based on a voting result in the vote table on the plurality of types of feature values of the object after voting on the plurality of types of feature values of the object, wherein the feature searching unit is configured to select identification information of an object whose vote value in the voting result in the vote table is maximum and not less than a predetermined reference value, as the identification information of the object whose physical quantity is detected by the sensor unit (13a, 13b... 13n), a determining unit configured to specify sorting information of the object based on the identification information of the object specified by the feature searching unit, from a sorting database which associates the identification information of the object and the sorting information in advance and stores the identification information of the object and the sorting information; and a sorting unit configured to sort the object based on the sorting information specified by the determining unit. a sensor unit (13a, 13b... 13n) configured to detect physical quantities from an object, which is a paper sheet or a parcel on which sorting information is indicated or on which a label with sorting information indicated thereon is attached, wherein the sensor unit includes an image sensor, a measurement sensor measuring a size of the object, and a quantity sensor measuring a weight of the object; a feature extracting unit configured to extract a plurality of types of feature values and respective features values from the physical quantities detected from the object by each sensor (13a, 13b... 13n); a feature searching unit configured to specify identification information of the object from a feature database which associates the values of the plurality of types of feature values extracted by the feature extracting unit and the identification information of the object in advance and stores the values of the plurality of feature values and the identification information of the object; wherein the feature searching unit is configured to vote on the identification information of the object corresponding to the values of the feature values extracted by the feature extracting unit, in a vote table in which a vote value for identification information of each object is recorded referring to the feature database, and to specify the identification information of the object based on a voting result in the vote table on the plurality of types of feature values of the object after voting on the plurality of types of feature values of the object, wherein the feature searching unit is configured to select identification information of an object whose vote value in the voting result in the vote table is maximum and not less than a predetermined reference value, as the identification information of the object whose physical quantity is detected by the sensor unit (13a, 13b... 13n), a determining unit configured to specify sorting information of the object based on the identification information of the object specified by the feature searching unit, from a sorting database which associates the identification information of the object and the sorting information in advance and stores the identification information of the object and the sorting information; and a sorting unit configured to sort the object based on the sorting information specified by the determining unit.