Only bind to mousedown events of left mouse button

If the user pulls up their context menu, it shouldn't start dragging.