Unit test: close evaluator immediately after its allocation

Unit test currently fails most of the time in local mode and on YARN