If child scrollview's pan gesture recognizer is not handling touch, we should.