Don't recreate runtimes, only do that if necessary