A method of encoding video data, the method comprising: storing a parameter set for each picture that is encoded, the parameter set of a particular picture including one or more reference picture subsets that form a reference picture set of the particular picture; receiving, from a device comprising a video decoder, information identifying a previously decoded picture that is stored in a decoded picture buffer of the video decoder at the time the video decoder transmitted the information; determining, based on the parameter set of the identified picture, one or more candidate reference pictures that are available for encoding a current picture, wherein the one or more candidate reference pictures include one or more pictures that are: in the reference picture set of the identified picture, wherein the reference picture set identifies pictures that were previously determined, during encoding of the identified picture, as pictures that could have been used for inter-prediction encoding the identified picture or as pictures that could have been used for inter-prediction encoding the pictures following the identified picture in coding order; and that are still stored in a DPB of a video encoder; selecting one or more reference pictures for the current picture from the determined one or more candidate reference pictures and the identified picture; and inter-prediction encoding the current picture based on the selected one or more reference pictures. storing a parameter set for each picture that is encoded, the parameter set of a particular picture including one or more reference picture subsets that form a reference picture set of the particular picture; receiving, from a device comprising a video decoder, information identifying a previously decoded picture that is stored in a decoded picture buffer of the video decoder at the time the video decoder transmitted the information; determining, based on the parameter set of the identified picture, one or more candidate reference pictures that are available for encoding a current picture, wherein the one or more candidate reference pictures include one or more pictures that are: in the reference picture set of the identified picture, wherein the reference picture set identifies pictures that were previously determined, during encoding of the identified picture, as pictures that could have been used for inter-prediction encoding the identified picture or as pictures that could have been used for inter-prediction encoding the pictures following the identified picture in coding order; and that are still stored in a DPB of a video encoder; selecting one or more reference pictures for the current picture from the determined one or more candidate reference pictures and the identified picture; and inter-prediction encoding the current picture based on the selected one or more reference pictures. in the reference picture set of the identified picture, wherein the reference picture set identifies pictures that were previously determined, during encoding of the identified picture, as pictures that could have been used for inter-prediction encoding the identified picture or as pictures that could have been used for inter-prediction encoding the pictures following the identified picture in coding order; and that are still stored in a DPB of a video encoder; selecting one or more reference pictures for the current picture from the determined one or more candidate reference pictures and the identified picture; and inter-prediction encoding the current picture based on the selected one or more reference pictures.