Additional cleanup work on session affinity
Changed sessionAffinityMap a map to pointers instead of structs to improve performance.