Use (push-mark) to enable going back to previous position using set-mar...

...k-command (C-u C-SPC)