Remove autostart conf on delete