Clean up folder to contain ONLY <exec-profile>