SDL fullscreen toggle: Palette fixups

Re-use the old palette when we toggle fullscreen