Jenkins can restart itself, which means the configuration will be re-read