[rbp] Fix non-square pixel display apect ratio and 3D TAB modes correctly