Add a detection for drift vs jitter to avoid unnessesary sample drops