This closes #828. The `synchronzized` block in `EvaluatorManager.close()` was ending a little too early, which created the race condition above.