Add functionality to execute ad-hoc java code to manipulate the config directly