Make dragging behaviour a bit more sensible

Now we don't actually initialise the dragging stuff until you move the mouse