# Research on Information Retrieval Effectiveness of University Scientific Researchers Based on Mental Model

Authors: Yundi Zhang; Yiyang; Jinshan Yang
Journal: Wireless Communications and Mobile Computing
 (2022)

---

## Abstract

The information retrieval behavior of scientific researchers is a behavior that is affected by multiple factors such as cognition, emotion, task, and user type and has its unique cognitive characteristics. In the context of scientific research, this paper conducts research on the information retrieval behavior of scientific researchers and analyzes the three levels of user mental model “user cognition, user behavior, and user emotion.” According to the mental model construction process, define the user segmentation of basic tasks, formulate recruitment plan, set interview scope, analyze data, construct mental model, product adjustment and gap analysis, export structure seven steps, construct the mental model of scientific research workers’ information retrieval, carry out research on the information retrieval efficiency of scientific researchers, describe the user portrait based on the mental model, and put forward strategies to improve the efficiency of user information retrieval.


---

## Body

## 1. Introduction

Information retrieval is an indispensable link for scientific research workers. The information retrieval behavior of scientific research workers is a kind of behavior under the joint influence of many factors such as cognition, emotion, task, and user type, which has its unique cognitive characteristics. The efficiency of information retrieval also directly affects the scientific research efficiency of researchers. Mental model is a research method of psychology and has made many achievements in many application fields. The concept of mental model was first put forward by psychologist Kenneth Craik in 1943. He believed that mental model can predict the danger in unfamiliar environment and help human beings reduce their potential harm [1]. Professor Johnson Laird further developed the mental model, which made the concept of mental model really come into being. He proposed to use the mental model to understand people’s cognition, experience, and knowledge structure of the real world. Because of the differences in individual cognition, the mental model is iterative and corrective [2]. The most frequently cited definition of mental model in recent years was proposed by Rouse and Morris in 1986. Rouse and Morris think that mental model is a psychological mechanism or established cognitive framework by which people describe the goals and forms of the system, explain the functions of the system, observe the state of the system, and predict the future state of the system. People use mental model to improve the efficiency of cognitive activities [3]. In the field of management, the theory of mental model has been further extended, Johnson-Laird’s definition of mental model is that for a single individual’s understanding of the relationship among himself, other individuals, and groups, it assumes the way of social operation, and it is its main function for people to explain and describe the causes of phenomena and predict possible follow-up events in order to avoid or control them in time [4]. After the publication of the Fifth Discipline, the theory of mental model is well known in the field of management, and mental model plays an important role in the process of human cognition of the world. It is mentioned in the book that the mental model is deeply rooted in people’s hearts, and it is about the cognition of individuals, others, society, and the world [5].Applying mental model theory to the research of users’ scientific research behavior, it is a further exploration of the application of mental model theory, by analyzing the information retrieval behavior of scientific research users [6]. This paper constructs a mental model of information retrieval behavior of scientific research users from three levels, user cognition, user behavior, and user emotion, and applies it to the evaluation of user information retrieval efficiency and scientific research efficiency, in order to further improve the scientific research efficiency of scientific research users.


## 2. Construction of Mental Model of Information Retrieval Efficiency for Scientific Research Workers in Colleges and Universities

### 2.1. Basic Experiment of Mental Model

#### 2.1.1. Preparation for the Experiment

Mental model is the basis for individuals to recognize, think, and act internally and externally. Everyone has mental model, which determines our perspective of observing things and relevant conclusions. Mental model is a relatively abstract concept, so it is necessary to explore users’ mental information by establishing experiments, extract abstract information, transform it into concrete information, and analyze and evaluate it.The purpose of this experiment is to preliminarily construct the mental model of the target users, through interviews with scientific research workers, users can reproduce information retrieval scenes and answer corresponding questions, so as to discuss users’ scientific research behavior and information retrieval behavior mode, and obtain information such as cognition, retrieval demand, motivation, preference, habit, and evaluation of scientific research workers in the process of information retrieval [7, 8].


#### 2.1.2. Experimental Research Methods

This experiment constructs the mental model through two stages. The first is the representation and extraction of mental information, using certain methods to express the thinking activities and behaviors of the target users and extract the mental information of the target users. At this stage, focus groups and interviews, questionnaires, card classification, and other three research methods. The second is to analyze the data of the mental model and evaluate and analyze the mental information extracted from the previous stage. Commonly used methods of mental model data analysis include affinity graph method, concept map calculation, path search method, multidimensional scale method, and cluster analysis [9]. In the real process of building a user’s mental model, it is difficult to obtain a complete mental model by a single measurement method. To obtain different mental models, various methods are usually used to obtain them in combination with the research objects.


#### 2.1.3. Selection of Subjects

In order to obtain the mental model of scientific research workers’ information retrieval more effectively, the users selected in the early research should be more targeted and meet the target user groups of products. This research mainly focuses on the information retrieval behavior of scientific research workers, so we choose university teachers and students as the research objects. This group has a certain scientific research foundation, continues to carry out scientific research work, and has rich experience in information retrieval, so it meets the needs of this experiment. In the interview work, it is planned to establish classified user groups, including three groups: university teachers, university graduate students, and university undergraduates, with 5 interviews in each group, totaling 15 people. Questionnaires are distributed to college teachers and students, and 200 questionnaires are planned to be distributed.


#### 2.1.4. Experimental Flow Design

In order to get the mental model experiment to be carried out smoothly, it is necessary to make a detailed plan for the specific experimental steps, time, and place in advance, mainly writing the interview outline needed when communicating with interviewers. The interview outline is semistructured, mainly through the problem from shallow to deep, first, guide the interviewee into the state through simple questions, after understanding the retrieval habits of users, then encourage the respondents to review the latest information retrieval experience, let the user tell the whole retrieval process completely, and then interview the main line of information retrieval preparation, retrieval process, and retrieval effect evaluation according to the user’s statement, so as to gradually dig out the user’s cognition, retrieval demand, retrieval preference, retrieval habit, some interactive operations, and emotional changes of retrieval evaluation [10, 11]. The whole process of the interview is divided into five parts: the first part is warm-up, that is to introduce the subject, form, purpose, and data protection instructions of the interview to the interviewee first, it is mainly to let users enter the interview preparation state and understand what needs to be done next; then ask the interviewee basic information and other basic questions; the third part is to interview users with some related problems before retrieval, including retrieval needs, motivation, frequency, and software used, and then encourage users to recall the latest retrieval behavior and tell it out; the fourth part is according to the user’s statement, continue to discuss the interactive operation and feelings that users will have in the retrieval process, and ask the pain points and cool points in the whole retrieval process; the fifth part is a summary of the whole interview content. The following is an outline of the whole interview.
(1)
Basic informationGender, age, educational background, and occupation.(2)
Basic ability of information retrievalDo you often search for information? What is the frequency of information retrieval?As a researcher, do you know the commonly used databases for academic information retrieval?Which database is often used for information retrieval?(3)
Preparation before information retrievalUnder what circumstances will information retrieval be carried out?What is the purpose of information retrieval?Do you have basic information retrieval skills?Before carrying out information retrieval, can you clearly realize your retrieval needs?Before information retrieval, can the retrieval requirements be accurately described as search terms?(4)
Information retrieval processWhen was the last information search?Please describe the process of the latest information retrieval, including motivation, time, retrieval scene, equipment, database used, retrieval behavior, retrieval effect, and retrieval evaluation.(5)
Evaluation of information retrievalWhy do you choose one or several databases for information retrieval?Information retrieval results meet the needs.Score the satisfaction of information retrieval experience, with a full score of 10 points.The effect of information retrieval results on scientific research.Will there be any problems in the process of retrieval?After encountering problems, how will they be solved? Such as asking others for help and looking for answers in the network.Will the retrieval function be expanded for the database used? Such as using advanced retrieval and professional retrieval.Is there any function that needs to be improved in the database that is used at present?Will you explore other unfamiliar databases for retrieval?When there is no clear scientific research demand, will you use the database to browse professional information?


#### 2.1.5. Experimental Implementation

Before the experiment, we should make corresponding preparations, including preparing the outline of the interview, recording equipment (convenient for playback in later analysis), selecting the appropriate experimental place, in order to make the interviewees stay in a relaxed and quiet scene as much as possible, due to the epidemic situation, 6 of the 15 subjects in this experiment completed the interview in the laboratory or library, and 9 people conducted video interviews, each experiment took about 40 minutes [12, 13].


#### 2.1.6. Experimental Conclusions

According to the interview outline, 15 users were interviewed in depth, the interview information was combed and descriptive statistics, and the representative conclusions were sorted out.In the basic ability of information retrieval, most users think that they often carry out information retrieval. The frequency of information retrieval varies, and some users indicate that it will be carried out at any time according to the scientific research plan, more than 10 times a week. The information retrieval frequency of most users exceeds 5 times a week. Respondents said that as researchers, they know more about the commonly used databases of information retrieval and have their own databases. The Chinese databases are CNKI and Wanfang databases, while the foreign databases are Web of Science and Elsevier. In the preparation before information retrieval, most users indicated that they would carry out information retrieval in the scenarios of project declaration, writing papers, project research, and completing course assignments. The main purpose of information retrieval is to find relevant research documents and provide research basis for their own research. About half of the users think that they have mastered the basic information retrieval skills and implemented them in the retrieval process. Before information retrieval, most users think that they can clearly realize their retrieval needs. But in the transformation of retrieval requirements, about half of users said that they can describe the retrieval requirements as appropriate search terms and get the required retrieval results, while some users think that they have not clearly expressed them as appropriate search terms, so they need to search for many times. In the description of information retrieval process, most users reviewed the latest information retrieval scene; clearly expounded the retrieval motivation, time, retrieval scene, equipment, and database used; described the retrieval process; and evaluated the retrieval effect. In the aspect of information retrieval evaluation, more than half of users said that the retrieval results can meet their own retrieval needs and scored the satisfaction of retrieval experience above 8 points. Most users think that information retrieval results can play a positive role in scientific research [14]. In the process of retrieval, more than half of users have encountered corresponding problems. Some of these problems have been solved by turning to librarians, contacting database customer service or looking for answers in the network, and some users’ problems have not been solved, so they are shelved. One-third of users indicated that they would take advantage of the expansion functions of the database, such as advanced retrieval, reference export, and sorting. For the database currently used, some users have proposed to improve the corresponding functions, such as batch download and synchronization between mobile phone and computer. In the absence of clear scientific research needs, only a few users will use the database to browse professional information [15, 16].


### 2.2. Quantitative Collection of Mental Information

#### 2.2.1. Purpose of Research

In the first stage, the author conducted in-depth interviews with learners and collected a large number of mental information of users during information retrieval. In the second stage, on the one hand, in order to make the results more accurate and effective, the author compiles the information obtained from the interview into a questionnaire and uses the quantitative characteristics of the questionnaire to carry out a large-scale delivery, thus verifying the effectiveness of the previous interview results. On the other hand, using the large-scale questionnaire, as well as easy to quantify the characteristics of the user’s mental model information to collect again, so that the mental model is more complete [17].


#### 2.2.2. Design of Questionnaire

The questionnaire design is based on the results of the first stage of user interviews. The content of the questionnaire is designed from five aspects: basic information, information behavior habits, basic ability of information retrieval, and current situation of information retrieval, expectation, and evaluation of information retrieval.(1)
Basic informationIncluding gender, age, educational background, and occupation.(2)
Behavior habit of information retrievalIncluding information retrieval scene, retrieval frequency, single retrieval time, retrieval result viewing rate, and retrieval result acquisition rate.(3)
Information retrieval abilityIncluding the selection of information retrieval sources, the understanding of information retrieval database, the degree of information demand transformation, and the use of information retrieval technology.(4)
Present situation of information retrievalIncluding the motivation of information retrieval, the attitude towards information retrieval, the advantages and disadvantages of information retrieval database, the willingness of information retrieval to continue, and the differences between information retrieval and other users.(5)
Expectation and evaluation of information retrievalIncluding users’ expectation of information retrieval, satisfaction of information retrieval experience, satisfaction rate of information retrieval to scientific research needs, and expansion needs of information retrieval.


#### 2.2.3. Distribution of Questionnaires

The teachers and students of some universities in Jilin Province, Liaoning Province and Beijing City were selected as samples, and 200 questionnaires were distributed and 186 questionnaires were recovered [18, 19].


### 2.3. Construction of Mental Model of User Information Retrieval

#### 2.3.1. Construction of Mental Model

Combining the basic experimental results of mental model and the quantitative collection of mental information, the mental data are analyzed to form clustering tasks, and the extracted tasks are classified into one class according to similarity and then aggregated into task towers, which are named, Similar “mission towers” are grouped into “mental spaces” and named separately. Finally, three mental spaces are formed, and the mental model of scientific research workers’ information retrieval is constructed with the three-layer structure of task-task tower-mental space, as shown in Table1.Table 1
Mental model of information retrieval for scientific researchers.
Information retrieval motivation and preparationRetrieval habitsCommon databasesRetrieval frequencyRetrieve preferencesRetrieval motivationRetrieval sceneRetrieval purposeAttitude towards information retrievalRetrieval preparationSelection and understanding of databaseRetrieve requirement descriptionRetrieval requirement transformationSelection of search wordsSelection of retrieval modeRetrieval result presetInformation retrieval ability and implementationCompetenceProficiency in databaseAble to complete the retrieval process skillfullyApplying certain information retrieval technologyRetrieval implementationSingle retrieval timeRetrieve policy changesView rate of retrieval resultsRetrieval result acquisition rateScreening of retrieval resultsSorting of retrieval resultsInformation retrieval effect and evaluationRetrieval effectExpectation degree of retrievalRecall and precisionSatisfaction degree of retrieval requirementsEncounter resultWillingness to continue information retrievalDifferences between information retrieval and other usersSatisfactionSatisfaction of retrieval systemSatisfaction of retrieval experienceExtensive demandExpanding requirements for retrieval resultsExpanding requirements for retrieval systemSuggestions on retrieval system


#### 2.3.2. User Portrait

By constructing the mental model of users, the author has a deeper understanding of the whole process of information retrieval for scientific research workers in colleges and universities. In order to have a clearer and macroscopic grasp of the target user groups and deeply understand their needs, the author constructs a typical user role model through cluster analysis according to the previous survey data (as shown in Table2). User role does not refer to a specific person, but a collection of user behavior characteristics with the same attributes. Through abstract processing of a large amount of data, typical users of products are constructed, mainly including basic information, information retrieval habits, demand intensity, and pain points. Create fictional characters to help researchers understand more clearly the current cognitive status and core needs of users involved and provide better promotion strategies.Table 2
Typical user portraits.
123Gender equalityWomenWomen and menMenAge18-2222-3030-40Retrieval motivationLearning needsLearning needs and scientific research needsScientific research needsFrequencyLow frequencyVery high frequencyHigh frequencySearch databaseChineseChinese, foreign languageChinese, foreign languageThe single retrieval time20 min30-60 min30-40 minRetrieval methodsBasic retrievalBasic retrieval, advanced retrievalBasic retrieval, advanced retrievalExpected resultsLess than 1000 articlesLess than 500 articlesAdjust the retrieval strategyOccasionallyOftenOftenDemand satisfactionBasically satisfiedHigh satisfiedBasically satisfiedPersistent willingnessLowHighHighExtended functionsFrequently screening, sorting, deriving references, document managementFrequently screening, indexThe satisfaction of systemGenerally satisfactoryVery satisfactoryRelatively satisfactoryUser experienceGenerallyBetterBetterExpectationsEasily accessible, sense of purposeEasy retrieval, easy access, diversity, timelinessEasy retrieval, easy access and concisenessMeaningMeaningVery meaningMeaning


## 2.1. Basic Experiment of Mental Model

### 2.1.1. Preparation for the Experiment

Mental model is the basis for individuals to recognize, think, and act internally and externally. Everyone has mental model, which determines our perspective of observing things and relevant conclusions. Mental model is a relatively abstract concept, so it is necessary to explore users’ mental information by establishing experiments, extract abstract information, transform it into concrete information, and analyze and evaluate it.The purpose of this experiment is to preliminarily construct the mental model of the target users, through interviews with scientific research workers, users can reproduce information retrieval scenes and answer corresponding questions, so as to discuss users’ scientific research behavior and information retrieval behavior mode, and obtain information such as cognition, retrieval demand, motivation, preference, habit, and evaluation of scientific research workers in the process of information retrieval [7, 8].


### 2.1.2. Experimental Research Methods

This experiment constructs the mental model through two stages. The first is the representation and extraction of mental information, using certain methods to express the thinking activities and behaviors of the target users and extract the mental information of the target users. At this stage, focus groups and interviews, questionnaires, card classification, and other three research methods. The second is to analyze the data of the mental model and evaluate and analyze the mental information extracted from the previous stage. Commonly used methods of mental model data analysis include affinity graph method, concept map calculation, path search method, multidimensional scale method, and cluster analysis [9]. In the real process of building a user’s mental model, it is difficult to obtain a complete mental model by a single measurement method. To obtain different mental models, various methods are usually used to obtain them in combination with the research objects.


### 2.1.3. Selection of Subjects

In order to obtain the mental model of scientific research workers’ information retrieval more effectively, the users selected in the early research should be more targeted and meet the target user groups of products. This research mainly focuses on the information retrieval behavior of scientific research workers, so we choose university teachers and students as the research objects. This group has a certain scientific research foundation, continues to carry out scientific research work, and has rich experience in information retrieval, so it meets the needs of this experiment. In the interview work, it is planned to establish classified user groups, including three groups: university teachers, university graduate students, and university undergraduates, with 5 interviews in each group, totaling 15 people. Questionnaires are distributed to college teachers and students, and 200 questionnaires are planned to be distributed.


### 2.1.4. Experimental Flow Design

In order to get the mental model experiment to be carried out smoothly, it is necessary to make a detailed plan for the specific experimental steps, time, and place in advance, mainly writing the interview outline needed when communicating with interviewers. The interview outline is semistructured, mainly through the problem from shallow to deep, first, guide the interviewee into the state through simple questions, after understanding the retrieval habits of users, then encourage the respondents to review the latest information retrieval experience, let the user tell the whole retrieval process completely, and then interview the main line of information retrieval preparation, retrieval process, and retrieval effect evaluation according to the user’s statement, so as to gradually dig out the user’s cognition, retrieval demand, retrieval preference, retrieval habit, some interactive operations, and emotional changes of retrieval evaluation [10, 11]. The whole process of the interview is divided into five parts: the first part is warm-up, that is to introduce the subject, form, purpose, and data protection instructions of the interview to the interviewee first, it is mainly to let users enter the interview preparation state and understand what needs to be done next; then ask the interviewee basic information and other basic questions; the third part is to interview users with some related problems before retrieval, including retrieval needs, motivation, frequency, and software used, and then encourage users to recall the latest retrieval behavior and tell it out; the fourth part is according to the user’s statement, continue to discuss the interactive operation and feelings that users will have in the retrieval process, and ask the pain points and cool points in the whole retrieval process; the fifth part is a summary of the whole interview content. The following is an outline of the whole interview.
(1)
Basic informationGender, age, educational background, and occupation.(2)
Basic ability of information retrievalDo you often search for information? What is the frequency of information retrieval?As a researcher, do you know the commonly used databases for academic information retrieval?Which database is often used for information retrieval?(3)
Preparation before information retrievalUnder what circumstances will information retrieval be carried out?What is the purpose of information retrieval?Do you have basic information retrieval skills?Before carrying out information retrieval, can you clearly realize your retrieval needs?Before information retrieval, can the retrieval requirements be accurately described as search terms?(4)
Information retrieval processWhen was the last information search?Please describe the process of the latest information retrieval, including motivation, time, retrieval scene, equipment, database used, retrieval behavior, retrieval effect, and retrieval evaluation.(5)
Evaluation of information retrievalWhy do you choose one or several databases for information retrieval?Information retrieval results meet the needs.Score the satisfaction of information retrieval experience, with a full score of 10 points.The effect of information retrieval results on scientific research.Will there be any problems in the process of retrieval?After encountering problems, how will they be solved? Such as asking others for help and looking for answers in the network.Will the retrieval function be expanded for the database used? Such as using advanced retrieval and professional retrieval.Is there any function that needs to be improved in the database that is used at present?Will you explore other unfamiliar databases for retrieval?When there is no clear scientific research demand, will you use the database to browse professional information?


### 2.1.5. Experimental Implementation

Before the experiment, we should make corresponding preparations, including preparing the outline of the interview, recording equipment (convenient for playback in later analysis), selecting the appropriate experimental place, in order to make the interviewees stay in a relaxed and quiet scene as much as possible, due to the epidemic situation, 6 of the 15 subjects in this experiment completed the interview in the laboratory or library, and 9 people conducted video interviews, each experiment took about 40 minutes [12, 13].


### 2.1.6. Experimental Conclusions

According to the interview outline, 15 users were interviewed in depth, the interview information was combed and descriptive statistics, and the representative conclusions were sorted out.In the basic ability of information retrieval, most users think that they often carry out information retrieval. The frequency of information retrieval varies, and some users indicate that it will be carried out at any time according to the scientific research plan, more than 10 times a week. The information retrieval frequency of most users exceeds 5 times a week. Respondents said that as researchers, they know more about the commonly used databases of information retrieval and have their own databases. The Chinese databases are CNKI and Wanfang databases, while the foreign databases are Web of Science and Elsevier. In the preparation before information retrieval, most users indicated that they would carry out information retrieval in the scenarios of project declaration, writing papers, project research, and completing course assignments. The main purpose of information retrieval is to find relevant research documents and provide research basis for their own research. About half of the users think that they have mastered the basic information retrieval skills and implemented them in the retrieval process. Before information retrieval, most users think that they can clearly realize their retrieval needs. But in the transformation of retrieval requirements, about half of users said that they can describe the retrieval requirements as appropriate search terms and get the required retrieval results, while some users think that they have not clearly expressed them as appropriate search terms, so they need to search for many times. In the description of information retrieval process, most users reviewed the latest information retrieval scene; clearly expounded the retrieval motivation, time, retrieval scene, equipment, and database used; described the retrieval process; and evaluated the retrieval effect. In the aspect of information retrieval evaluation, more than half of users said that the retrieval results can meet their own retrieval needs and scored the satisfaction of retrieval experience above 8 points. Most users think that information retrieval results can play a positive role in scientific research [14]. In the process of retrieval, more than half of users have encountered corresponding problems. Some of these problems have been solved by turning to librarians, contacting database customer service or looking for answers in the network, and some users’ problems have not been solved, so they are shelved. One-third of users indicated that they would take advantage of the expansion functions of the database, such as advanced retrieval, reference export, and sorting. For the database currently used, some users have proposed to improve the corresponding functions, such as batch download and synchronization between mobile phone and computer. In the absence of clear scientific research needs, only a few users will use the database to browse professional information [15, 16].


## 2.1.1. Preparation for the Experiment

Mental model is the basis for individuals to recognize, think, and act internally and externally. Everyone has mental model, which determines our perspective of observing things and relevant conclusions. Mental model is a relatively abstract concept, so it is necessary to explore users’ mental information by establishing experiments, extract abstract information, transform it into concrete information, and analyze and evaluate it.The purpose of this experiment is to preliminarily construct the mental model of the target users, through interviews with scientific research workers, users can reproduce information retrieval scenes and answer corresponding questions, so as to discuss users’ scientific research behavior and information retrieval behavior mode, and obtain information such as cognition, retrieval demand, motivation, preference, habit, and evaluation of scientific research workers in the process of information retrieval [7, 8].


## 2.1.2. Experimental Research Methods

This experiment constructs the mental model through two stages. The first is the representation and extraction of mental information, using certain methods to express the thinking activities and behaviors of the target users and extract the mental information of the target users. At this stage, focus groups and interviews, questionnaires, card classification, and other three research methods. The second is to analyze the data of the mental model and evaluate and analyze the mental information extracted from the previous stage. Commonly used methods of mental model data analysis include affinity graph method, concept map calculation, path search method, multidimensional scale method, and cluster analysis [9]. In the real process of building a user’s mental model, it is difficult to obtain a complete mental model by a single measurement method. To obtain different mental models, various methods are usually used to obtain them in combination with the research objects.


## 2.1.3. Selection of Subjects

In order to obtain the mental model of scientific research workers’ information retrieval more effectively, the users selected in the early research should be more targeted and meet the target user groups of products. This research mainly focuses on the information retrieval behavior of scientific research workers, so we choose university teachers and students as the research objects. This group has a certain scientific research foundation, continues to carry out scientific research work, and has rich experience in information retrieval, so it meets the needs of this experiment. In the interview work, it is planned to establish classified user groups, including three groups: university teachers, university graduate students, and university undergraduates, with 5 interviews in each group, totaling 15 people. Questionnaires are distributed to college teachers and students, and 200 questionnaires are planned to be distributed.


## 2.1.4. Experimental Flow Design

In order to get the mental model experiment to be carried out smoothly, it is necessary to make a detailed plan for the specific experimental steps, time, and place in advance, mainly writing the interview outline needed when communicating with interviewers. The interview outline is semistructured, mainly through the problem from shallow to deep, first, guide the interviewee into the state through simple questions, after understanding the retrieval habits of users, then encourage the respondents to review the latest information retrieval experience, let the user tell the whole retrieval process completely, and then interview the main line of information retrieval preparation, retrieval process, and retrieval effect evaluation according to the user’s statement, so as to gradually dig out the user’s cognition, retrieval demand, retrieval preference, retrieval habit, some interactive operations, and emotional changes of retrieval evaluation [10, 11]. The whole process of the interview is divided into five parts: the first part is warm-up, that is to introduce the subject, form, purpose, and data protection instructions of the interview to the interviewee first, it is mainly to let users enter the interview preparation state and understand what needs to be done next; then ask the interviewee basic information and other basic questions; the third part is to interview users with some related problems before retrieval, including retrieval needs, motivation, frequency, and software used, and then encourage users to recall the latest retrieval behavior and tell it out; the fourth part is according to the user’s statement, continue to discuss the interactive operation and feelings that users will have in the retrieval process, and ask the pain points and cool points in the whole retrieval process; the fifth part is a summary of the whole interview content. The following is an outline of the whole interview.
(1)
Basic informationGender, age, educational background, and occupation.(2)
Basic ability of information retrievalDo you often search for information? What is the frequency of information retrieval?As a researcher, do you know the commonly used databases for academic information retrieval?Which database is often used for information retrieval?(3)
Preparation before information retrievalUnder what circumstances will information retrieval be carried out?What is the purpose of information retrieval?Do you have basic information retrieval skills?Before carrying out information retrieval, can you clearly realize your retrieval needs?Before information retrieval, can the retrieval requirements be accurately described as search terms?(4)
Information retrieval processWhen was the last information search?Please describe the process of the latest information retrieval, including motivation, time, retrieval scene, equipment, database used, retrieval behavior, retrieval effect, and retrieval evaluation.(5)
Evaluation of information retrievalWhy do you choose one or several databases for information retrieval?Information retrieval results meet the needs.Score the satisfaction of information retrieval experience, with a full score of 10 points.The effect of information retrieval results on scientific research.Will there be any problems in the process of retrieval?After encountering problems, how will they be solved? Such as asking others for help and looking for answers in the network.Will the retrieval function be expanded for the database used? Such as using advanced retrieval and professional retrieval.Is there any function that needs to be improved in the database that is used at present?Will you explore other unfamiliar databases for retrieval?When there is no clear scientific research demand, will you use the database to browse professional information?


## 2.1.5. Experimental Implementation

Before the experiment, we should make corresponding preparations, including preparing the outline of the interview, recording equipment (convenient for playback in later analysis), selecting the appropriate experimental place, in order to make the interviewees stay in a relaxed and quiet scene as much as possible, due to the epidemic situation, 6 of the 15 subjects in this experiment completed the interview in the laboratory or library, and 9 people conducted video interviews, each experiment took about 40 minutes [12, 13].


## 2.1.6. Experimental Conclusions

According to the interview outline, 15 users were interviewed in depth, the interview information was combed and descriptive statistics, and the representative conclusions were sorted out.In the basic ability of information retrieval, most users think that they often carry out information retrieval. The frequency of information retrieval varies, and some users indicate that it will be carried out at any time according to the scientific research plan, more than 10 times a week. The information retrieval frequency of most users exceeds 5 times a week. Respondents said that as researchers, they know more about the commonly used databases of information retrieval and have their own databases. The Chinese databases are CNKI and Wanfang databases, while the foreign databases are Web of Science and Elsevier. In the preparation before information retrieval, most users indicated that they would carry out information retrieval in the scenarios of project declaration, writing papers, project research, and completing course assignments. The main purpose of information retrieval is to find relevant research documents and provide research basis for their own research. About half of the users think that they have mastered the basic information retrieval skills and implemented them in the retrieval process. Before information retrieval, most users think that they can clearly realize their retrieval needs. But in the transformation of retrieval requirements, about half of users said that they can describe the retrieval requirements as appropriate search terms and get the required retrieval results, while some users think that they have not clearly expressed them as appropriate search terms, so they need to search for many times. In the description of information retrieval process, most users reviewed the latest information retrieval scene; clearly expounded the retrieval motivation, time, retrieval scene, equipment, and database used; described the retrieval process; and evaluated the retrieval effect. In the aspect of information retrieval evaluation, more than half of users said that the retrieval results can meet their own retrieval needs and scored the satisfaction of retrieval experience above 8 points. Most users think that information retrieval results can play a positive role in scientific research [14]. In the process of retrieval, more than half of users have encountered corresponding problems. Some of these problems have been solved by turning to librarians, contacting database customer service or looking for answers in the network, and some users’ problems have not been solved, so they are shelved. One-third of users indicated that they would take advantage of the expansion functions of the database, such as advanced retrieval, reference export, and sorting. For the database currently used, some users have proposed to improve the corresponding functions, such as batch download and synchronization between mobile phone and computer. In the absence of clear scientific research needs, only a few users will use the database to browse professional information [15, 16].


## 2.2. Quantitative Collection of Mental Information

### 2.2.1. Purpose of Research

In the first stage, the author conducted in-depth interviews with learners and collected a large number of mental information of users during information retrieval. In the second stage, on the one hand, in order to make the results more accurate and effective, the author compiles the information obtained from the interview into a questionnaire and uses the quantitative characteristics of the questionnaire to carry out a large-scale delivery, thus verifying the effectiveness of the previous interview results. On the other hand, using the large-scale questionnaire, as well as easy to quantify the characteristics of the user’s mental model information to collect again, so that the mental model is more complete [17].


### 2.2.2. Design of Questionnaire

The questionnaire design is based on the results of the first stage of user interviews. The content of the questionnaire is designed from five aspects: basic information, information behavior habits, basic ability of information retrieval, and current situation of information retrieval, expectation, and evaluation of information retrieval.(1)
Basic informationIncluding gender, age, educational background, and occupation.(2)
Behavior habit of information retrievalIncluding information retrieval scene, retrieval frequency, single retrieval time, retrieval result viewing rate, and retrieval result acquisition rate.(3)
Information retrieval abilityIncluding the selection of information retrieval sources, the understanding of information retrieval database, the degree of information demand transformation, and the use of information retrieval technology.(4)
Present situation of information retrievalIncluding the motivation of information retrieval, the attitude towards information retrieval, the advantages and disadvantages of information retrieval database, the willingness of information retrieval to continue, and the differences between information retrieval and other users.(5)
Expectation and evaluation of information retrievalIncluding users’ expectation of information retrieval, satisfaction of information retrieval experience, satisfaction rate of information retrieval to scientific research needs, and expansion needs of information retrieval.


### 2.2.3. Distribution of Questionnaires

The teachers and students of some universities in Jilin Province, Liaoning Province and Beijing City were selected as samples, and 200 questionnaires were distributed and 186 questionnaires were recovered [18, 19].


## 2.2.1. Purpose of Research

In the first stage, the author conducted in-depth interviews with learners and collected a large number of mental information of users during information retrieval. In the second stage, on the one hand, in order to make the results more accurate and effective, the author compiles the information obtained from the interview into a questionnaire and uses the quantitative characteristics of the questionnaire to carry out a large-scale delivery, thus verifying the effectiveness of the previous interview results. On the other hand, using the large-scale questionnaire, as well as easy to quantify the characteristics of the user’s mental model information to collect again, so that the mental model is more complete [17].


## 2.2.2. Design of Questionnaire

The questionnaire design is based on the results of the first stage of user interviews. The content of the questionnaire is designed from five aspects: basic information, information behavior habits, basic ability of information retrieval, and current situation of information retrieval, expectation, and evaluation of information retrieval.(1)
Basic informationIncluding gender, age, educational background, and occupation.(2)
Behavior habit of information retrievalIncluding information retrieval scene, retrieval frequency, single retrieval time, retrieval result viewing rate, and retrieval result acquisition rate.(3)
Information retrieval abilityIncluding the selection of information retrieval sources, the understanding of information retrieval database, the degree of information demand transformation, and the use of information retrieval technology.(4)
Present situation of information retrievalIncluding the motivation of information retrieval, the attitude towards information retrieval, the advantages and disadvantages of information retrieval database, the willingness of information retrieval to continue, and the differences between information retrieval and other users.(5)
Expectation and evaluation of information retrievalIncluding users’ expectation of information retrieval, satisfaction of information retrieval experience, satisfaction rate of information retrieval to scientific research needs, and expansion needs of information retrieval.


## 2.2.3. Distribution of Questionnaires

The teachers and students of some universities in Jilin Province, Liaoning Province and Beijing City were selected as samples, and 200 questionnaires were distributed and 186 questionnaires were recovered [18, 19].


## 2.3. Construction of Mental Model of User Information Retrieval

### 2.3.1. Construction of Mental Model

Combining the basic experimental results of mental model and the quantitative collection of mental information, the mental data are analyzed to form clustering tasks, and the extracted tasks are classified into one class according to similarity and then aggregated into task towers, which are named, Similar “mission towers” are grouped into “mental spaces” and named separately. Finally, three mental spaces are formed, and the mental model of scientific research workers’ information retrieval is constructed with the three-layer structure of task-task tower-mental space, as shown in Table1.Table 1
Mental model of information retrieval for scientific researchers.
Information retrieval motivation and preparationRetrieval habitsCommon databasesRetrieval frequencyRetrieve preferencesRetrieval motivationRetrieval sceneRetrieval purposeAttitude towards information retrievalRetrieval preparationSelection and understanding of databaseRetrieve requirement descriptionRetrieval requirement transformationSelection of search wordsSelection of retrieval modeRetrieval result presetInformation retrieval ability and implementationCompetenceProficiency in databaseAble to complete the retrieval process skillfullyApplying certain information retrieval technologyRetrieval implementationSingle retrieval timeRetrieve policy changesView rate of retrieval resultsRetrieval result acquisition rateScreening of retrieval resultsSorting of retrieval resultsInformation retrieval effect and evaluationRetrieval effectExpectation degree of retrievalRecall and precisionSatisfaction degree of retrieval requirementsEncounter resultWillingness to continue information retrievalDifferences between information retrieval and other usersSatisfactionSatisfaction of retrieval systemSatisfaction of retrieval experienceExtensive demandExpanding requirements for retrieval resultsExpanding requirements for retrieval systemSuggestions on retrieval system


### 2.3.2. User Portrait

By constructing the mental model of users, the author has a deeper understanding of the whole process of information retrieval for scientific research workers in colleges and universities. In order to have a clearer and macroscopic grasp of the target user groups and deeply understand their needs, the author constructs a typical user role model through cluster analysis according to the previous survey data (as shown in Table2). User role does not refer to a specific person, but a collection of user behavior characteristics with the same attributes. Through abstract processing of a large amount of data, typical users of products are constructed, mainly including basic information, information retrieval habits, demand intensity, and pain points. Create fictional characters to help researchers understand more clearly the current cognitive status and core needs of users involved and provide better promotion strategies.Table 2
Typical user portraits.
123Gender equalityWomenWomen and menMenAge18-2222-3030-40Retrieval motivationLearning needsLearning needs and scientific research needsScientific research needsFrequencyLow frequencyVery high frequencyHigh frequencySearch databaseChineseChinese, foreign languageChinese, foreign languageThe single retrieval time20 min30-60 min30-40 minRetrieval methodsBasic retrievalBasic retrieval, advanced retrievalBasic retrieval, advanced retrievalExpected resultsLess than 1000 articlesLess than 500 articlesAdjust the retrieval strategyOccasionallyOftenOftenDemand satisfactionBasically satisfiedHigh satisfiedBasically satisfiedPersistent willingnessLowHighHighExtended functionsFrequently screening, sorting, deriving references, document managementFrequently screening, indexThe satisfaction of systemGenerally satisfactoryVery satisfactoryRelatively satisfactoryUser experienceGenerallyBetterBetterExpectationsEasily accessible, sense of purposeEasy retrieval, easy access, diversity, timelinessEasy retrieval, easy access and concisenessMeaningMeaningVery meaningMeaning


## 2.3.1. Construction of Mental Model

Combining the basic experimental results of mental model and the quantitative collection of mental information, the mental data are analyzed to form clustering tasks, and the extracted tasks are classified into one class according to similarity and then aggregated into task towers, which are named, Similar “mission towers” are grouped into “mental spaces” and named separately. Finally, three mental spaces are formed, and the mental model of scientific research workers’ information retrieval is constructed with the three-layer structure of task-task tower-mental space, as shown in Table1.Table 1
Mental model of information retrieval for scientific researchers.
Information retrieval motivation and preparationRetrieval habitsCommon databasesRetrieval frequencyRetrieve preferencesRetrieval motivationRetrieval sceneRetrieval purposeAttitude towards information retrievalRetrieval preparationSelection and understanding of databaseRetrieve requirement descriptionRetrieval requirement transformationSelection of search wordsSelection of retrieval modeRetrieval result presetInformation retrieval ability and implementationCompetenceProficiency in databaseAble to complete the retrieval process skillfullyApplying certain information retrieval technologyRetrieval implementationSingle retrieval timeRetrieve policy changesView rate of retrieval resultsRetrieval result acquisition rateScreening of retrieval resultsSorting of retrieval resultsInformation retrieval effect and evaluationRetrieval effectExpectation degree of retrievalRecall and precisionSatisfaction degree of retrieval requirementsEncounter resultWillingness to continue information retrievalDifferences between information retrieval and other usersSatisfactionSatisfaction of retrieval systemSatisfaction of retrieval experienceExtensive demandExpanding requirements for retrieval resultsExpanding requirements for retrieval systemSuggestions on retrieval system


## 2.3.2. User Portrait

By constructing the mental model of users, the author has a deeper understanding of the whole process of information retrieval for scientific research workers in colleges and universities. In order to have a clearer and macroscopic grasp of the target user groups and deeply understand their needs, the author constructs a typical user role model through cluster analysis according to the previous survey data (as shown in Table2). User role does not refer to a specific person, but a collection of user behavior characteristics with the same attributes. Through abstract processing of a large amount of data, typical users of products are constructed, mainly including basic information, information retrieval habits, demand intensity, and pain points. Create fictional characters to help researchers understand more clearly the current cognitive status and core needs of users involved and provide better promotion strategies.Table 2
Typical user portraits.
123Gender equalityWomenWomen and menMenAge18-2222-3030-40Retrieval motivationLearning needsLearning needs and scientific research needsScientific research needsFrequencyLow frequencyVery high frequencyHigh frequencySearch databaseChineseChinese, foreign languageChinese, foreign languageThe single retrieval time20 min30-60 min30-40 minRetrieval methodsBasic retrievalBasic retrieval, advanced retrievalBasic retrieval, advanced retrievalExpected resultsLess than 1000 articlesLess than 500 articlesAdjust the retrieval strategyOccasionallyOftenOftenDemand satisfactionBasically satisfiedHigh satisfiedBasically satisfiedPersistent willingnessLowHighHighExtended functionsFrequently screening, sorting, deriving references, document managementFrequently screening, indexThe satisfaction of systemGenerally satisfactoryVery satisfactoryRelatively satisfactoryUser experienceGenerallyBetterBetterExpectationsEasily accessible, sense of purposeEasy retrieval, easy access, diversity, timelinessEasy retrieval, easy access and concisenessMeaningMeaningVery meaningMeaning


## 3. Strategies for Improving the Efficiency of User Information Retrieval

### 3.1. Understand the Retrieval System and Subdivide the Retrieval Purpose

Scientific research workers first need to information retrieval system, that is, we often say that the database has enough understanding, understand the basic information of the database, such as literature composition, basic retrieval function, expansion function, advantages and disadvantages of the database, requirements for retrieval and downloading of database resources, and define your commonly used Chinese and foreign databases as the main source of retrieval, and at the same time, understand some basic knowledge of standby databases as supplementary databases for retrieval. Before carrying out information retrieval, researchers should subdivide their retrieval purposes, including course study, thesis writing, project demonstration, patent application, and search criteria and formulate corresponding retrieval strategies according to the retrieval purposes [20].


### 3.2. Clarify Retrieval Needs and Improve Retrieval Skills

Researchers should clarify their own retrieval needs, and retrieval requirement is a kind of tacit knowledge and is in the brain of the searcher. This retrieval requirement may be clear or vague, but no matter what, it is necessary to transform the retrieval requirement into search words that can be read by the system. In the retrieval system, the selection of search words is very important, which is related to the comprehensiveness and accuracy of the retrieval results, that is, the recall and precision that we are familiar with. In order to transform the retrieval demand into search terms, researchers need to master the necessary retrieval skills, including the selection of retrieval ways, retrieval methods, the use of Boolean logic retrieval, and the use of retrieval operators. The improvement of retrieval skills will help researchers complete the information retrieval work more smoothly.


### 3.3. Adjust the Retrieval Strategy to Accurately Hit the Results

In the process of information retrieval, one search may not complete the search task successfully. It is necessary for researchers to constantly adjust the retrieval strategy to ensure the smooth development of retrieval. In the process of adjusting the retrieval strategy, we can make full use of the expansive functions in the information retrieval system, such as screening, sorting, Boolean logic assembly, superposition of retrieval approaches, and export of retrieval results, so as to accurately hit the results and improve the retrieval efficiency.


### 3.4. Carry Out Retrieval Education to Improve Information Literacy

For most researchers, receive certain information retrieval training, is the necessary way to improve the efficiency of information retrieval, through the education of information retrieval courses, it can make searchers better master the basic knowledge of information retrieval system, basic skills of information retrieval, skills of improving information retrieval efficiency and related knowledge of information ethics, and improve information literacy and “search for business” from four aspects of information awareness, information thinking, information skills, and information ethics, thus improving scientific research efficiency.


## 3.1. Understand the Retrieval System and Subdivide the Retrieval Purpose

Scientific research workers first need to information retrieval system, that is, we often say that the database has enough understanding, understand the basic information of the database, such as literature composition, basic retrieval function, expansion function, advantages and disadvantages of the database, requirements for retrieval and downloading of database resources, and define your commonly used Chinese and foreign databases as the main source of retrieval, and at the same time, understand some basic knowledge of standby databases as supplementary databases for retrieval. Before carrying out information retrieval, researchers should subdivide their retrieval purposes, including course study, thesis writing, project demonstration, patent application, and search criteria and formulate corresponding retrieval strategies according to the retrieval purposes [20].


## 3.2. Clarify Retrieval Needs and Improve Retrieval Skills

Researchers should clarify their own retrieval needs, and retrieval requirement is a kind of tacit knowledge and is in the brain of the searcher. This retrieval requirement may be clear or vague, but no matter what, it is necessary to transform the retrieval requirement into search words that can be read by the system. In the retrieval system, the selection of search words is very important, which is related to the comprehensiveness and accuracy of the retrieval results, that is, the recall and precision that we are familiar with. In order to transform the retrieval demand into search terms, researchers need to master the necessary retrieval skills, including the selection of retrieval ways, retrieval methods, the use of Boolean logic retrieval, and the use of retrieval operators. The improvement of retrieval skills will help researchers complete the information retrieval work more smoothly.


## 3.3. Adjust the Retrieval Strategy to Accurately Hit the Results

In the process of information retrieval, one search may not complete the search task successfully. It is necessary for researchers to constantly adjust the retrieval strategy to ensure the smooth development of retrieval. In the process of adjusting the retrieval strategy, we can make full use of the expansive functions in the information retrieval system, such as screening, sorting, Boolean logic assembly, superposition of retrieval approaches, and export of retrieval results, so as to accurately hit the results and improve the retrieval efficiency.


## 3.4. Carry Out Retrieval Education to Improve Information Literacy

For most researchers, receive certain information retrieval training, is the necessary way to improve the efficiency of information retrieval, through the education of information retrieval courses, it can make searchers better master the basic knowledge of information retrieval system, basic skills of information retrieval, skills of improving information retrieval efficiency and related knowledge of information ethics, and improve information literacy and “search for business” from four aspects of information awareness, information thinking, information skills, and information ethics, thus improving scientific research efficiency.


## 4. Conclusion

Information retrieval is one of the essential work contents for scientific research workers to carry out scientific research work. How to improve the efficiency of information retrieval is a concern of many scientific research work. In this paper, mental model is applied to the study of information retrieval efficiency, through the basic experimental results of mental model and the quantitative collection of mental information, construct the mental model of information retrieval for scientific research workers, it also depicts the user portrait, which has certain reference value for understanding and improving the information retrieval efficiency of scientific research workers. However, this paper does not further explore the mental model system and does not apply necessary evaluation methods to calculate its weight and conduct empirical research, which needs further exploration in future research.



---

*Source: 5852946-2022-07-18.xml*