###### Abstract  
After the introduction of the ChatGPT conversational artificial intelligence (CAI) tool in November 2022, there has been a rapidly growing interest in the use of such tools in higher education. While the educational uses of some other information technology (IT) tools (including collaboration and communication tools, learning management systems, chatbots, and videoconferencing tools) have been frequently evaluated regarding technology acceptance and usability attributes of those technologies, similar evaluations of CAI tools and services like ChatGPT, Bing Chat, and Bard have only recently started to appear in the scholarly literature. In our study, we present a newly developed set of assessment scales that are related to the usability and user experiences of CAI tools when used by university students, as well as the results of evaluation of these assessment scales specifically regarding the CAI Bing Chat tool (i.e., Microsoft Copilot). The following scales were developed and evaluated using a convenience sample (N = 126) of higher education students: Perceived Usefulness, General Usability, Learnability, System Reliability, Visual Design and Navigation, Information Quality, Information Display, Cognitive Involvement, Design Appeal, Trust, Personification, Risk Perception, and Intention to Use. For most of the aforementioned scales, internal consistency (Cronbach alpha) was in the range from satisfactory to good, which implies their potential usefulness for further studies of related attributes of CAI tools. A stepwise linear regression revealed that the most influential predictors of Intention to Use Bing Chat (or ChatGPT) in the future were the usability variable Perceived Usefulness and two user experience variables--Trust and Design Appeal. Also, our study revealed that students' perceptions of various specific usability and user experience characteristics of Bing Chat were predominantly positive. The evaluated assessment scales could be beneficial in further research that would include other CAI tools like ChatGPT/GPT-4 and Bard. onversational artificial intelligence; higher education; Bing Chat; usability; user experience; survey +
Footnote †: journal:  
0000-0001-4600-788X/0000-0000-0000-0000-0000-0000-0000-0000-00000-0000-00  
including those focused on specific fields like medical education [9] and second language learning [10]. However, the adoption of CAI tools did not meet the early expectations that were driven by the initially rapid adoption of ChatGPT after its launch on 30 November 2023, when in its first week it attracted one million users, with an increase to over 100 million users in less than 2 months [11]. For instance, a survey performed by Ipsos [12] in April 2023 (N = 1008) revealed that only 16% of adults (aged 18+) in the USA reported having ever used a text-based or visual generative AI system (ChatGPT, DALL-E, Bard, Midjourney, Stable Diffusion, etc.). A similar rate of use was established by a Pew Research Center survey [13] performed in July 2023, in which only 18% of adults aged 18+ (N = 5057) stated that they had used ChatGPT, with most of the users (41%) belonging to the 18-29 age group. Another Pew Research Center survey [14], performed in the period from 26 September to 23 October 2023, revealed that 13% of teens aged 13-17 (N = 1453) had used ChatGPT for their schoolwork. The fact that a much larger adoption rate is to be expected in higher education was revealed by a large-scale survey performed among college students in Germany [15] from 15 May to 5 June 2023 (N = 6311 in the final sample). In this study, 63.2% of the students reported that they had used ChatGPT or other AI tools, but still, only 34.8% of them had used such tools \"occasionally\", \"frequently\", or \"very often\".