Make index population job not flip during shutdown

o Fix lucene directory locking related test flakyness