A labeling apparatus for labeling structures of an object shown in an object image, the labeling apparatus comprising: - a contour providing unit for providing a contour (9...17) representing a structure in the object image, - a probability map providing unit for providing a probability map, the probability map indicating for different labels, which are indicative of different structures of the object, and for different positions in the probability map the probability that the respective structure, which is indicated by the respective label, is present at the respective position, wherein the probability depends on the position in the probability map, - a mapping unit for mapping the probability map to the object image such that the positions in the probability map are assigned to positions in the object image, and - a label assigning unit for assigning to the contour (9...17) a label based on the mapped probability map, the label assigning unit being adapted to - define positions of image elements in accordance with the provided contour (9...17) and with a predefined definition rule, the predefined definition rule defining positions of image elements depending on a contour, - determine for each label a label probability depending on the probabilities which are defined by the mapped probability map and the defined positions of image elements, and - assign the label to the contour (9...17) for which the largest label probability has been determined, wherein the predefined definition rule defines positions of image elements within the contour, if the contour is closed, wherein the label assigning unit is adapted to determine for each label an integral probability as the label probability by integrating the probabilities defined by the mapped probability map and by the defined positions of the image elements within the contour (9...17). - a contour providing unit for providing a contour (9...17) representing a structure in the object image, - a probability map providing unit for providing a probability map, the probability map indicating for different labels, which are indicative of different structures of the object, and for different positions in the probability map the probability that the respective structure, which is indicated by the respective label, is present at the respective position, wherein the probability depends on the position in the probability map, - a mapping unit for mapping the probability map to the object image such that the positions in the probability map are assigned to positions in the object image, and - a label assigning unit for assigning to the contour (9...17) a label based on the mapped probability map, the label assigning unit being adapted to - define positions of image elements in accordance with the provided contour (9...17) and with a predefined definition rule, the predefined definition rule defining positions of image elements depending on a contour, - determine for each label a label probability depending on the probabilities which are defined by the mapped probability map and the defined positions of image elements, and - assign the label to the contour (9...17) for which the largest label probability has been determined,