@julienw : 
Consider a case, I am moving finger very fast to go to next page immediately and I don't remove my finger from screen. Earlyswipe will be true initially. But it will become false once we reach 2nd page and it will force to do existing Pan logic (i.e .it will force to use RemovePanHandler again ).  Once we remove our finger then it will become true again.