The problem was that I didn't call the glClear, ouch!