OGL: speed up the efb cache

gcc doesn't optimize this loops with -O2, so using memset now.
And add a flag to skip this unneeded work at all most of the time.