Show all invited users and infinite scroll active

Closes #4239
What's the point of setting pagination settings' role if we then have to manually filter anyways? Talking about lines 25 and 29