Adjust mouse drag position for whole marker offset