I could go for newrelic.api.exceptions.ConfigurationError i suppose, see if that's enough. Not sure what it will throw, we'll find out :)