Show all invited users and infinite scroll active

Closes #4239
Yes?  They're in different scopes doing different things but if you have an idea for re-working it I'm open to it.