Remove some extranneous mouse and touch event copying