Reloads configuration yml on every time runner is loaded

[#66732798]