make sure we only perform absolute imports on loading a backend

Fixes #2309