Place in the two frames skip logic for FB to memory

It fixes the overlapping issue when switching resolution in previous commit.