Fifo: don't mess up with swap requests

I don't know it this may happen, but it sounds wise.
Yeah, g_ActiveConfig is updated by the GPU thread. So on disabling XFB, the CPU could be blocked here...