Remove compile time endian detection

uint32_from_le already works correctly for little and big endian systems.

Also the compile time endian detection did not work for cross compiling.