Hook into unmanage signal and remove client from stack

This fixes a weird crash, when the stack item was being
accessed/returned etc.