animationComplete: Remove only the handler attached by us

Closes gh-7267
Fixes gh-7265