Minor Dict-related performance enhancements

- Call `box` on ccall arguments in `bitmix`. Ironically this seems to
  be necessary to prevent the arguments from getting boxed.
- Use ifelse for NaN check when hashing Float32/Float64
Merge pull request #5780 from JuliaLang/sjk/dict

Minor Dict-related performance enhancements