Only fetch remotes when adding/editing a pickme

Or if a new remote has been added