Dynamic configuration by monitored directory