A device for associating semantics of video coding information associated with an access unit with a set of layers or a set of operation points of a multi-layer bitstream, comprising: means for storing video information associated with the multi-layer bitstream, the stored video information comprising a supplemental enhancement information message; and means for determining, based on an identifier in the SEI message, whether the SEI message belongs to one of a first SEI message category that includes buffering period SEI messages, picture timing SEI messages, or decoding unit information SEI messages and a second SEI message category that includes SEI messages different from buffering period SEI messages, picture timing SEI messages, and decoding unit information SEI messages; means for determining when the SEI message applies to the set of operation points and when the SEI message applies to the set of layers; means for applying each semantic of the SEI message independently to each operation point of the set of operation points in response to the SEI message belonging to the first SEI message category and applying to the set of operation points to which the SEI message applies; means for applying each semantic of the SEI message to the set of layers according to one or more indicators of the SEI message in response to the SEI message belonging to the first SEI message category, being nested, and applying to the set of layers; and means for applying each semantic of the SEI message independently to each layer of the set of layers to which the SEI message applies in response to the SEI message belonging to a second SEI message category and applying to the set of layers. means for storing video information associated with the multi-layer bitstream, the stored video information comprising a supplemental enhancement information message; and means for determining, based on an identifier in the SEI message, whether the SEI message belongs to one of a first SEI message category that includes buffering period SEI messages, picture timing SEI messages, or decoding unit information SEI messages and a second SEI message category that includes SEI messages different from buffering period SEI messages, picture timing SEI messages, and decoding unit information SEI messages; means for determining when the SEI message applies to the set of operation points and when the SEI message applies to the set of layers; means for applying each semantic of the SEI message independently to each operation point of the set of operation points in response to the SEI message belonging to the first SEI message category and applying to the set of operation points to which the SEI message applies; means for applying each semantic of the SEI message to the set of layers according to one or more indicators of the SEI message in response to the SEI message belonging to the first SEI message category, being nested, and applying to the set of layers; and means for applying each semantic of the SEI message independently to each layer of the set of layers to which the SEI message applies in response to the SEI message belonging to a second SEI message category and applying to the set of layers.