Allow plugin to close if it hasn't been run yet.