Show all invited users and infinite scroll active

Closes #4239
There's a lot of store.finding going on in here, I think some comments explaining that the model is "1. all invited users + 2. 20(?) normal users paginated" would be helpful for das future