DEVOPS-976 Add support for classpath additions