also clear cached users when removing a single backend