Update user lists when a user is added or removed from a task

Change-Id: If3e7584e97827f6683f55a005f5444c28827f221