> making sure that any implementation works wit a JS library that has support for touch events has value

Good point. In that case we can probably include not full library, but only relevant parts of it - https://github.com/madrobby/zepto/blob/master/src/touch.js