Build classpath before creating custom annotator

Closes #256