Implement a command to tweak runtime configuration of plugins