Move mousedown handler completely out of event handlers.

This seems to be the only way to make it work reliably.