> The annotations framework does need to load resources, so maybe this just needs to be wired up?

Does it? If so, it should probably be wired up. We can do it as part of this pull request or as a follow up issue. Can you point me to what you mean? I guess you are referring to the analyzer definition stuff, where you for example can load stop word files, etc.