Actually skip the memory cache for background loads of images.

The other PR only skipped the cache for loading the initial background image.