Store setting before installation and restores when disabled