Shift-clicking an already selected background object now deselects it on the background panel.