The problem is that if you want to move your whole chart with the help of your arrow keys, you usually have to move each element one by one. Your chart will stay in its place.
To move your chart you have to follow these steps:
Unset all your selections by clicking next to your chart
Press the Ctrl-key and click the frame of your chart
You can see that your chart is selected when a round corner mark appears
You can now easily move your selected chart