# Automated Test Creation Using Large Language Models: A Practical Application
## 3 Using ChatGPT for Test Creation
These can include, for example:  
* Purpose of the test: the specific purpose of the test to be considered when creating the questions (e.g., assessment of understanding, self-preparation, competition preparation);
* Topic coverage: distribution of questions across different subtopics (e.g., five questions for each of the four subtopics within one main topic);
* Difficulty level: the complexity level of the questions (e.g., easy, medium, hard);
* Question type: the type of questions to be generated (e.g., multiple choice, open-ended questions, true/false, fill-in-the-blank);
* Question format: additional requirements for the format of the questions (e.g., use of diagrams or charts, inclusion of case studies or scenarios);
* Question style: the type of expression (e.g., academic, conversational, technical);
* Number of answers: how many answers the multiple-choice questions should have (e.g., four possible answers, one correct). * Feedback: inclusion of explanations or comments for correct and incorrect answers (e.g., a brief explanation for each correct answer);
* Specific guidelines: additional instructions or criteria for creating the questions (e.g., avoiding questions with misleading answers, including questions that require critical thinking);
* Use of sources: inclusion of questions based on specific sources or texts (e.g., questions based on a specific article, textbook, or study);
* Context and examples: inclusion of questions with context or examples (e.g., questions that use real-life situations or case studies);
* Test format: the output format in which ChatGPT should provide the questions and answers (e.g., table, text file, Excel file);
* Target audience: the age group or education level of the learners (e.g., high school students, university students, professionals), etc. An example request for test creation might look like this (Box 1):  
```
Subject: Databases Subtopic: Relational Algebra Difficulty Level: Medium Question Types: Multiple choice, true/false, fill-in-the-blank, short answer, graphical questions Number of Questions: 25 Answer Format: docx file Target Audience: University students Language: Bulgarian Number of Answers (for multiple choice): 4 possible answers, 1 correct Topic Coverage: 5 questions on selection, 5 questions on projection, 5 questions on union, 5 questions on difference, 5 questions on Cartesian product Purpose of the Test: Assess understanding and application of relational algebra Question Style: Academic Feedback: Explanation for the correct answer Specific Guidelines: Avoid misleading questions, include examples and case studies, focus on critical thinking and application of theoretical knowledge, use ER diagrams and SQL queries as part of the questions Training for Specific Skills: Data analysis and synthesis, data retrieval and manipulation through relational algebra, problem-solving skills in the context of databases
```  
**Box 1. ** Create a test with the following characteristics. By fulfilling this request, the chatbot will create a test and display it in the workspace. The educator can copy and use it appropriately. The inconvenience in this case is that the educator will find it difficult to manage the tests created in this manner. Their work can be facilitated by developing a specialized application for test generation based on ChatGPT. The potential benefits are:* Reusability: Questions and tests can be stored in a database and reused multiple times. This eliminates the need for the educator to store tests in files, which makes searching for and reusing tests more difficult. * Personalization: The application can include specific criteria for creating tests that are tailored to a particular subject area, educator, or educational institution. This allows for the creation of tests adapted to specific needs and teaching styles. * Flexibility and adaptability: Developing a custom application can provide greater flexibility in design and features, allowing adaptation to various test formats and question types.