Fix configuration caching

It looks like our config cache was never actually populated properly. This
patch caches the result after a successful fetch.

Change-Id: Ice51f268444345b13a48c812fa1ae89d87179219