smarter parsing on shard host urls