A method of decoding a multi-view image, the method comprising: receiving a bitstream comprising: data about a multi-view image sequence, and information indicating either a picture in one view image sequence included in the multi-view image sequence is a reference picture referred to or not referred to by other pictures aligned with the picture in time in another view image, among image sequences included in the multi-view image sequence for inter-view prediction of the other pictures, the image sequences of the multi-view image sequence each comprising a sequence of pictures, the picture comprising a non-anchor picture; extracting the data about the multi-view image sequence from the received bitstream; extracting the received information indicating either the picture in one view image sequence included in multi-view image sequences is a reference picture or not a reference picture for inter-view prediction of the other pictures from a network abstraction layer unit header; and decoding a picture included in the data about the multi-view image sequence; determining based on the extracted information whether the picture included in the data about the multi-view image sequence is to be used for inter-view prediction decoding of the other pictures based on the extracted information indicating either the picture included in multi-view image sequence is a reference picture or not a reference picture for inter-view prediction decoding of the other pictures; if the picture is determined to be a reference picture referred to for inter-view prediction of the other pictures, storing the picture in a memory for inter-view prediction of the other pictures; and if the picture is determined to be not a reference picture referred to for inter-view prediction of the other pictures, not storing the picture in a memory for inter-view prediction of the other pictures. receiving a bitstream comprising: data about a multi-view image sequence, and information indicating either a picture in one view image sequence included in the multi-view image sequence is a reference picture referred to or not referred to by other pictures aligned with the picture in time in another view image, among image sequences included in the multi-view image sequence for inter-view prediction of the other pictures, the image sequences of the multi-view image sequence each comprising a sequence of pictures, the picture comprising a non-anchor picture; extracting the data about the multi-view image sequence from the received bitstream; extracting the received information indicating either the picture in one view image sequence included in multi-view image sequences is a reference picture or not a reference picture for inter-view prediction of the other pictures from a network abstraction layer unit header; and decoding a picture included in the data about the multi-view image sequence; determining based on the extracted information whether the picture included in the data about the multi-view image sequence is to be used for inter-view prediction decoding of the other pictures based on the extracted information indicating either the picture included in multi-view image sequence is a reference picture or not a reference picture for inter-view prediction decoding of the other pictures; if the picture is determined to be a reference picture referred to for inter-view prediction of the other pictures, storing the picture in a memory for inter-view prediction of the other pictures; and if the picture is determined to be not a reference picture referred to for inter-view prediction of the other pictures, not storing the picture in a memory for inter-view prediction of the other pictures.