Adding fix for missing observer removal

Fixes crash issue due to missing observer removal on the
panGestureRecognizer