TEncSearch: simplify square block dim logic

this works around a bizarre MSVC warning on those lines.
 '<<' : result of 32-bit shift implicitly converted to 64 bits (was 64-bit shift intended?)

I have no idea why it was implicitly making the result 64bits.