Show all invited users and infinite scroll active

Closes #4239