Fix duplicate load in registrys

Fixes #4693. I decided to go down the exception based route as I didn't like the re-configuration approach or always building new instances.