When tiles come from cache, make sure to switch layers as well