A damage information processing device comprising: a damage information acquisition unit that acquires damage information on damage of a structure in an acquired 2-D image; a damage vector generation unit that vectorizes the acquired damage information to generate a set of 2-D damage vectors, each of which is defined with a line segment determined by a start point and a termination point with respect to the damage; a hierarchical structure information generation unit that generates hierarchical structure information that is information hierarchically representing a connection relationship between the damage vectors on the basis of the generated set of damage vectors, wherein a hierarchy corresponding to the hierarchical structure information has one or more levels, wherein a vector group is formed whereby a plurality of damage vectors connected to each other or damage vectors separated from but close to each other is set as a vector group, wherein the hierarchical structure information includes information identifying a vector group to which one damage vector in the set belongs, information on another damage vector connected to the one damage vector, unique information of the one damage vector and, for each of the one damage vector and the another damage vector, level information defining the level of that damage vector within the hierarchy, wherein the level information for the one damage vector and the another damage vector are different, and wherein the unique information includes identification information of the one damage vector, affiliation hierarchy information indicating which of hierarchies of the hierarchical structure the one damage vector belongs to, and positions of the start point and the termination point; a damage vector extraction unit that extracts a damage vector satisfying a designated condition by referring to the hierarchical structure information; and a display unit that displays the one or more extracted damage vector. a damage information acquisition unit that acquires damage information on damage of a structure in an acquired 2-D image; a damage vector generation unit that vectorizes the acquired damage information to generate a set of 2-D damage vectors, each of which is defined with a line segment determined by a start point and a termination point with respect to the damage; a hierarchical structure information generation unit that generates hierarchical structure information that is information hierarchically representing a connection relationship between the damage vectors on the basis of the generated set of damage vectors, wherein a hierarchy corresponding to the hierarchical structure information has one or more levels, wherein a vector group is formed whereby a plurality of damage vectors connected to each other or damage vectors separated from but close to each other is set as a vector group, wherein the hierarchical structure information includes information identifying a vector group to which one damage vector in the set belongs, information on another damage vector connected to the one damage vector, unique information of the one damage vector and, for each of the one damage vector and the another damage vector, level information defining the level of that damage vector within the hierarchy, wherein the level information for the one damage vector and the another damage vector are different, and wherein the unique information includes identification information of the one damage vector, affiliation hierarchy information indicating which of hierarchies of the hierarchical structure the one damage vector belongs to, and positions of the start point and the termination point; a damage vector extraction unit that extracts a damage vector satisfying a designated condition by referring to the hierarchical structure information; and a display unit that displays the one or more extracted damage vector.