Save the game after using an orb.

Otherwise it has to be, annoyingly, reused when you load the save.