Fix bySegment metrics de-serialization

It is worth noting that the context given to DirectDruidClient is not the same context as the original query. As such, there are cases where bySegment appears at this level when it is not in the original query. (example: caching)