If we move this `if` block inside the `if(!m_borderPtrVec.load(...)) {` block we will only need to do one `.load(...)` call once the cache is filled.