Properly check for user equality for user modes