BUG: Test identifying issue with CacheableOffset. Release notes (GH4609)