Fix a bug with actors not leaving their groups
This bug was reported on the mailing list