FALCON-483 Fix the failing test ConfigurationStoreTest.testConcurrentRemoves on jenkins. Contributed by Sowmya Ramesh