Only download annotations if arg is set

Annotations are now only downloaded if --write-annotations is set,