comms/gasnet performance:

Remove some duplication in variable symmetry testing.

Add branch prediction macros (*LIKELY) to help compiler choose best path.
Some places left alone since they depend on programmer choices during
execution.

Inline some helper routines to remove call overhead.