Provide way to not set OnTouchListener's on the refreshable view.

Closes #19.