Avoid more cases where signbit is treated as int