[JENKINS-22834] Support additional classpaths

Continuation of #1.