Fix a crash when you delete a user with more than one attached client

Fixes #403