Add real comments to yields in qthreads sync var lock and unlock

These were added to resolve deadlock that cropped up when we switched to the
nemesis scheduler. I never commented them properly because we weren't sure it
was the final solution or if the values were good. Things seem to be in good
shape some I'm adding extensive comments.
Switch to hwloc v1.9.1 as default.
Merge pull request #265 from gbtitus/hwloc-1.9.1-is-default

Switch to hwloc v1.9.1 as default.

Reviewed by @bradcray, @sungeunchoi, @ronawho over email.
Wordsmithing based on gregs review
Merge pull request #260 from ronawho/qthreads-syncvar-deadlock

Add real comments to yields in qthreads sync var lock and unlock

[reviewed by @gbtitus]

These were added to resolve deadlock that cropped up when we switched to the
nemesis scheduler. I never commented them properly because we weren't sure it
was the final solution or if the values were good. Things seem to be in good
shape some I'm adding extensive comments.