Sped up ActorMap.ActorsInBox.

The ```HashSet``` in ```ActorsInBox``` was causing the whole function to be fairly slow. By ensuring the partitioning bins will contain distinct actors we can avoid the set and that speeds up ```ActorsInBox``` nearly 3x. To ensure we have only distinct actors, we just need to make the add/remove lists into sets.