power: Prevent UpDevice being kept alive

If a UpDevice was removed while the panel was opened, it was
removed from the list of devices, and never unref'ed, still receiving
signals.