Handle case where file changes and tests are currently running.