Added fill values only to the cache stack if a memory reallocation is actually required. If not, just create an extended view on the memory, which on a random sample should be more efficient than the caching, which involves a coordinate transform.