YUV in/out for SBF, selectCU and intraPred