Modify the way we fetch the installed version of the plugin

Fixes #2025