Remove unused user_modes dict