Start the viewport interaction only once, on pinch start.

Reviewed by: Luciano Wolf