Fix --without-hwloc build
Silence a warning that would have caused a segfault as written