I think there should be an initial background position set here, so that the image starts off centered.  The ability to pan the image is not easily discoverable, so I think many users won't know they can adjust the image. So we should start off with the center of the image which is most likely what the user wants.