Fix a crash when a user mode doesn't have a prefix symbol