Go pointers are kind of awesome. Refactor internal data structure to use maps to ActiveStream pointers