Add better synchronization around checking/adding to set of executors