Slightly better configuration when talking to indexing service

Not completely happy with this but I think a lot of this will be rewritten once we introduce a better plugin framework for Druid.