A method of coding video data performed by a video coder, the method comprising: determining for a coding unit, CU, of video data having luma information, chroma information and a residual quad tree, RQT, having a plurality of depths a first RQT depth and a second RQT depth of the plurality of depths of the RQT, wherein the RQT represents a manner in which transforms are applied to the luma information and the chroma information, wherein: each respective depth of the plurality of depths of the RQT corresponds to a respective luma transform size and a respective chroma transform size, a height and a width of the respective luma transform size being two times greater than a height and a width of a luma transform size corresponding to a next depth deeper in the RQT than the respective depth, and a height and a width of the respective chroma transform size being two times greater than a height and a width of a chroma transform size corresponding to a next depth deeper in the RQT than the respective depth, the luma transform size corresponding to depth 0 of the RQT is equal to a size of a luma block of the CU that includes all samples of a luma component in the CU, and the chroma transform size corresponding to depth 0 of the RQT is equal to a size of a chroma block of the CU that includes all samples of a chroma component in the CU; coding luma information associated with the CU by applying a first transform to the luma information at the first residual quadtree, RQT, depth; coding chroma information associated with the CU by applying a second transform to the chroma information at the second RQT depth, wherein the second RQT depth is less deep in a RQT structure than the first RQT depth and wherein the second RQT depth is different than zero. determining for a coding unit, CU, of video data having luma information, chroma information and a residual quad tree, RQT, having a plurality of depths a first RQT depth and a second RQT depth of the plurality of depths of the RQT, wherein the RQT represents a manner in which transforms are applied to the luma information and the chroma information, wherein: each respective depth of the plurality of depths of the RQT corresponds to a respective luma transform size and a respective chroma transform size, a height and a width of the respective luma transform size being two times greater than a height and a width of a luma transform size corresponding to a next depth deeper in the RQT than the respective depth, and a height and a width of the respective chroma transform size being two times greater than a height and a width of a chroma transform size corresponding to a next depth deeper in the RQT than the respective depth, the luma transform size corresponding to depth 0 of the RQT is equal to a size of a luma block of the CU that includes all samples of a luma component in the CU, and the chroma transform size corresponding to depth 0 of the RQT is equal to a size of a chroma block of the CU that includes all samples of a chroma component in the CU; each respective depth of the plurality of depths of the RQT corresponds to a respective luma transform size and a respective chroma transform size, a height and a width of the respective luma transform size being two times greater than a height and a width of a luma transform size corresponding to a next depth deeper in the RQT than the respective depth, and a height and a width of the respective chroma transform size being two times greater than a height and a width of a chroma transform size corresponding to a next depth deeper in the RQT than the respective depth, the luma transform size corresponding to depth 0 of the RQT is equal to a size of a luma block of the CU that includes all samples of a luma component in the CU, and the chroma transform size corresponding to depth 0 of the RQT is equal to a size of a chroma block of the CU that includes all samples of a chroma component in the CU; coding luma information associated with the CU by applying a first transform to the luma information at the first residual quadtree, RQT, depth; coding chroma information associated with the CU by applying a second transform to the chroma information at the second RQT depth, wherein the second RQT depth is less deep in a RQT structure than the first RQT depth and wherein the second RQT depth is different than zero.