Handle desk and last_desk in remove_desktop