Removed checks for touch enabled in order to support both touch and mouse

Also cleaned up some of the user activity watching code, adding support for
tracking when the mouse continues to be down without any movement