You can increase or decrease the speed at which your image pans when using this shortcut by adjusting the value under Preferences > Tools or Edit > Preferences > General to make it more comfortable towards preference.