A method of linear model prediction decoding video data, the method comprising: determining a luma block of the video data that corresponds to a chroma block of the video data that is being decoded; if the chroma block borders a left boundary of a picture, slice, coding unit, prediction unit or transform unit: determining a first filter from a set of filters to apply to luma samples of the luma block that correspond to chroma samples of the chroma block which are immediately adjacent to the left boundary of the picture, slice, coding unit, prediction unit or transform unit; determining a second filter from a set of filters to apply to luma samples of the luma block that correspond to chroma samples of the chroma block which are not immediately adjacent to the left boundary of the picture, slice, coding unit, prediction unit or transform unit, wherein the second filter has a greater number of taps than the first filter; downsampling the luma samples of the luma block that correspond to chroma samples of the chroma block on the left boundary of the chroma block using the determined first filter; downsampling the luma samples of the luma block that correspond to chroma samples of the chroma block not on the left boundary of the chroma block using the determined second filter; determining a predictive block from the downsampled luma block using a linear model; and reconstructing the chroma block based on the predictive block and a residual block. determining a luma block of the video data that corresponds to a chroma block of the video data that is being decoded; if the chroma block borders a left boundary of a picture, slice, coding unit, prediction unit or transform unit: determining a first filter from a set of filters to apply to luma samples of the luma block that correspond to chroma samples of the chroma block which are immediately adjacent to the left boundary of the picture, slice, coding unit, prediction unit or transform unit; determining a second filter from a set of filters to apply to luma samples of the luma block that correspond to chroma samples of the chroma block which are not immediately adjacent to the left boundary of the picture, slice, coding unit, prediction unit or transform unit, wherein the second filter has a greater number of taps than the first filter; downsampling the luma samples of the luma block that correspond to chroma samples of the chroma block on the left boundary of the chroma block using the determined first filter; downsampling the luma samples of the luma block that correspond to chroma samples of the chroma block not on the left boundary of the chroma block using the determined second filter; determining a predictive block from the downsampled luma block using a linear model; and reconstructing the chroma block based on the predictive block and a residual block. determining a first filter from a set of filters to apply to luma samples of the luma block that correspond to chroma samples of the chroma block which are immediately adjacent to the left boundary of the picture, slice, coding unit, prediction unit or transform unit; determining a second filter from a set of filters to apply to luma samples of the luma block that correspond to chroma samples of the chroma block which are not immediately adjacent to the left boundary of the picture, slice, coding unit, prediction unit or transform unit, wherein the second filter has a greater number of taps than the first filter; downsampling the luma samples of the luma block that correspond to chroma samples of the chroma block on the left boundary of the chroma block using the determined first filter; downsampling the luma samples of the luma block that correspond to chroma samples of the chroma block not on the left boundary of the chroma block using the determined second filter; determining a predictive block from the downsampled luma block using a linear model; and reconstructing the chroma block based on the predictive block and a residual block.