Correctly restore colors after clean up in the jsoo backend.