Keep a buffer reffed until 2 buffers later
update the fps counter