Remove -Wconversion warnings, too aggressive on Clang