Changed removeActorPosition field in ActorMap into a set.

This is because it's purpose is to be queried via Contains when actors needed to be removed.
Merge pull request #5404 from RoosterDragon/remove-as-hashset

Changed removeActorPosition field in ActorMap into a set.