A person tracking device comprising: a person region information extraction means for detecting a person region containing a person or persons appearing in a video, and generating person region information describing information of the person region; an accompanying person determination means for identifying at least one accompanying person accompanying a tracking target person among persons included in the person region information based on the person region information and information specifying a tracking target person, and generating accompanying person information describing the accompanying person; a distinctive person selection means for selecting a distinctive person with high saliency using the person region information and feature saliency information representing the degree of saliency or degree of distinction of a feature value of a person, among the accompanying person specified by the accompanying person information, and generating distinctive person information describing the distinctive person; and a person tracking means for calculating a distinctive person tracking result being a tracking result for the distinctive person based on the person region information and the distinctive person information, wherein the accompanying person information includes the information specifying the tracking target person, the distinctive person selection means calculates tracking target person relative position information representing a relative position between the tracking target person and the distinctive person, and the person tracking device further comprises a tracking result calculation means for calculating a tracking result for the tracking target person from the distinctive person tracking result and the tracking target person relative position information. a person region information extraction means for detecting a person region containing a person or persons appearing in a video, and generating person region information describing information of the person region; an accompanying person determination means for identifying at least one accompanying person accompanying a tracking target person among persons included in the person region information based on the person region information and information specifying a tracking target person, and generating accompanying person information describing the accompanying person; a distinctive person selection means for selecting a distinctive person with high saliency using the person region information and feature saliency information representing the degree of saliency or degree of distinction of a feature value of a person, among the accompanying person specified by the accompanying person information, and generating distinctive person information describing the distinctive person; and a person tracking means for calculating a distinctive person tracking result being a tracking result for the distinctive person based on the person region information and the distinctive person information, wherein the accompanying person information includes the information specifying the tracking target person, the distinctive person selection means calculates tracking target person relative position information representing a relative position between the tracking target person and the distinctive person, and the person tracking device further comprises a tracking result calculation means for calculating a tracking result for the tracking target person from the distinctive person tracking result and the tracking target person relative position information.