Don't treat mousedown and touchstart as clicks.

Closes #1, provided @theshillito with his weird Compaq PDA or whatever
agrees.