If I turn off quantize and play around with rates, I get no drifting with this setup.  If I change the setup, the tracks drift apart.