No, it isn't. Now, the Search runtime dialog won't be open when there is no one runtime definition.
I have debugged and tested that. 
We would probably be able to test the wouldOpenSearchRuntimePathDialog method without adding UI/SWTBoot tests.