Yes, you can easily undo the background rotation by either using the undo button or manually resetting the rotation angle to 0 degrees in the Format Picture pane.