Only remove the previously set document bindings

Previously all document bindings were removed, this commit removes
precisely the two that were previously set (mouseup and mousemove)