Unscope the user collection when sorting

Fix #1181