Remove some unnecessary object creation and switch to HashSet for better performance. See #3308
Merge pull request #1441 from akka/wip-3308-actorsystemspec-times-out-ban

ActorSystemSpec timeout fixes #3308