shortcut shr when we have a small lhs but rhs is >= 32

Otherwise we will run into issues where a >> 32 == a, at
least on gcc.