Support nested values in config overrides

I have accidentally merged #52 as I forgot that we need to wait for @shelbys to sign the CLA. Even though I reverted the change, github still thinks the change was merged.