Remove user list check that doesn't make sense.

It's OK for this to be empty, or have one item in, or have any number of
items in -- so there's nothing to test here.