delay loading metadata if created via .config/Xml ctor -- in line with how the IdentityModel 4.5 implementation works