Casting to Uint fixed from direct bytes slice