Drop sampler tile if it's trimmed from the cache

Otherwise the sampler will end up seeing a different
tile than buffer_get().