BuildSetup: Refactor 5e97cd45cf to better detect b.e.

* Looking back, we should not assume little endian if
  we see armv* as armv7l is little endian while armv7b
  is big endian