# Factors Influencing Information Service Quality of China Hospital: The Case Study of since 2017 of a Hospital Information Platform in China

Authors: Lei Jiao; HuaPing Xiao; XiaoZhuo Zhu; Xu Zhao
Journal: Computational and Mathematical Methods in Medicine
 (2020)

---

## Abstract

Background: As a country with the largest number of netizens around the world, China enjoys improving social information services based on the Internet. With such a large quantity of network users, it is inevitable for China’s hospitals at various levels to provide patients and the public with information services by setting up their own official websites. But it is still elusive for the factors affecting the information service quality of China Hospital. Objective: Identifies the factors affecting the information service quality of the case of the Online website of a hospital in China.adding new content to the research fruits in this field. The research can effectively enhance the efficiency of hospital resource utilization, allocating limited resources to most efficient areas and leveling up the information service quality of hospitals to the largest extent. This ultimately improves patient satisfaction. Method: This research investigates the factors affecting the information service quality of the case of a Chinese hospital online website and by means of Delphi method, statistical analysis, and other research methods, formulates the Evaluation Indicator System for the Information Service Quality of the case of the Online website of a hospital in China. The research applies this system to the empirical research on the information service quality of the hospital’s website and then makes a comparative analysis between the research results and traffic data of the websites of other hospitals over the same period. Results: By means of the Bivariate Correlation, the author carried out a correlation analysis of the comprehensive evaluations of the information service of the Online website of a hospital in China and the traffic data of the Online website of a hospital in China, including the total traffic, PV and UV. For details of the analysis results, indicates that the correlation coefficient among the three objects is 1, a significant correlation. It also suggests that the comprehensive evaluations of the information service of A Chinese hospital website and the traffic of A Chinese hospital website are positively correlated. The information service quality of China Hospital website is an important component of the hospital’s overall service quality. This research on the information service quality of China Hospital website covers the website’s service functions, service quality, resources and the front-end and back-end technology systems. Discussion and conclusion: In the case that the China Hospital information service function is still not perfect, perfecting the functions of China Hospital website plays a decisive role in improving the information service quality of the hospital. In addition, it can be inferred that after the information service function of China Hospital website is improved or the evaluation of the functional quality attribute of website information service scores higher, the supporting attribute of website information service will be the next key task for the hospital in enhancing its information service quality is the improvement ratio of Functional quality attribute of website information service and the supporting attribute of website information service tend to be the same., And even the improvement rate of the supporting attribute is sometimes higher than the improvement rate of Functional quality. So The construction of a model of the comprehensive evaluation system on the information service of has pointed out a new direction in China’s research in this field, This model is both of high theoretical value and practical value.


---

## Body

## 1. Introduction

According to statistics of China Internet Network Information Center (CNNIC), the number of Chinese netizens, including Internet users on mobile phones, has reached 1.701 billion, which is the largest number in the world, and this number has been increasing year by years [1]. Therefore, the Internet has already been the main approach for the public to acquire information in China. In the meanwhile, medical institutions that provide services for the public are also carrying through the informatization reform. The hospital information platforms thus become the main representative in this reform. Hospitals usually provide more than just medical treatments to patients. They also offer other services including information service. Among them, using hospital information platform is one of the important approaches for a hospital to provide information service to patients. After ten years of informatization, as of 2019, the average rate of third-level hospitals launching information platforms in each province of China has reached 82% [2]. China Hospitals usually provide more than just medical treatments to patients. They also offer other services including information service, consultation service, and psychological service. Among them, using hospital information platform is one of the important approaches for a hospital to provide information service to patients.In China’s mainland, when patients have medical needs and choose hospitals online, they tend to choose a hospital that has high quality information service on the hospital website. They gain information service on the website and proceed with subsequent medical service accordingly. They usually recommend the website providing good experience of online information service to their families or friends in need of medical service. It can be seen that an advanced hospital information platform with high quality information service can not only bring profits to the hospital but also establish the hospital reputation, and more importantly patients can enjoy high quality information service. Therefore, it is of importance to study factors influencing information service quality of hospital information platforms so as to improve their information service quality.Research on information service quality of hospital information platforms is firstly carried out on information service quality of hospital information system, such as the measurement of effectiveness of the information system and the study on SERVQUAL scale that is used to measure the service quality of information system [3, 4]. Then, with the popularity of computers and networks as well as the increase in web browsing, the academic community pays more attention to the research on the service quality of the information system of webpages since 2000. Tan in 2003 studied the service quality frame of the information system [5]. Pinho in 2011 studied the influences of network service quality on network usage [6]. Baldwin in 2014 studied the relationship between the rating of patients’ satisfaction and the quality of hospital information platforms and measures [7]. However, China’s research on information service quality of hospital information platforms has just started. The major contributions have been made mainly by some scholars in Taiwan and coastal universities in China’s mainland. For example, Liang in 2009 conducted a research on the influences of the quality of information platforms on the performance of an organization’s relationship with customerss [8]. Pei and Wang in 2009 researched on the evaluation system of information service quality of user-oriented information platforms [9]. Zhu and Xiong in 2012 studied the evaluation criteria on information service quality of medical information platforms [10]. This article shows investigating and studying the information platform of a Hospital Information Platform from the perspective of management, the thesis intends to identify factors influencing the information service quality of hospital information platforms, so as to figure out factors affecting the information service quality of the information platform of a Hospital Information Platform in China and the interaction among these factors.


## 2. Methods

This study aimed to understand Factors Influencing Information Service Quality of the Information Platform of China Hospital. To achieve this goal a case study and Delphi and Questionnaire methodology were followed. This study will discuss information service quality of hospital information platforms in two aspects—the essence of the information service of hospital information platforms and perception of information service. Then an evaluation system will be established and verified.To begin with, following the case study method, this study’s object is set within a certain range in order to perform in-depth and comprehensive analysis through dynamic follow-up investigation into them. This study selects the a Hospital Information Platform in China as the object of the case study. Through study design, data collection, data analysis, and study report draft, factors influencing information are sought out as reference for the improvement of service quality of hospital information platforms in China.Second, Use Delphi and Questionnaire method. In this study Use Delphi, experts in this field are consulted to discuss how to determine or quantify indicators of various dimensions, indicator weights of medical information service quality of information platforms in Chinese hospitals so as to help finish the study [11, 12]. In this study Use Questionnaire, In this Questionnaire method, the subjects are given brief forms and asked to offer suggestions or file complaints on certain issues so as to collect information. Based on literature research nd experts’ views, a questionnaire is designed for the front-line hospital staff and patients. The questionnaire consists of hospital staff investigation, patient investigation and expert investigation. Every investigation will be carried out two times, and there are two rounds for all the investigations. The first investigation is on the dimension structure of evaluation system for medical information service function and quality of a Hospital Information Platform in China, and the second one is on evaluation system index coefficient of medical information service function and quality of a Hospital Information Platform in China. At last, Statistical Analysis. In this study, Excel is used for data-entry of information in the expert consultation, and SPSS is used for statistical analysis of data in the questionnaire so as to examine the consistency and logic of the data and to ensure the correctness of the data.


## 3. Comprehensive Evaluation System for Medical Information Service of a Hospital Information Platform in China

### 3.1. The Structure of System Evaluating the Information Service

This study has randomly chosen 101 experts across China to put into the expert bank of consultation object, ranging from professors in management or other disciplines with deputy senior or above titles to information technology experts at hospitals and professional technicians at information technology web design companies. Next, send the initial dimension indicator set to about 20 experts via mobile phones, letters and emails for at least two rounds of consultation to settle the names, categories, quantity and structure of the evaluation system’s dimension indicators. Each round of consultation randomly chooses experts among the 101 consultation objects to send consultation forms, See Figure1 for details.Figure 1
Statistics of Status of Consultation Experts.The expert difference coefficient Q indicates the difference of expert opinion. This variable coefficient demonstrates different degree of expert recognition of the evaluated indicators. The smaller the variable coefficient is, the less the difference of expert opinion is. Calculation equation of variable coefficient:(1)Qi=siviIn the equation, Qi refers to the variable coefficient of indicator i, si standard deviation and vi weighted arithmetic mean. In the two rounds of expert consultations, 45 consultation forms were sent out, and 40 valid feedbacks were collected. The effectiveness of the two rounds of consultations was 86%, both of which were higher than 60%.18 dimensional indicators’ difference coefficients in the first round are over 0.25, and all these 18 dimensions have been adjusted accordingly; while the difference coefficients of 73 dimensional indicators are all between 0.08-0.24 (less than 0.25). In the second round, only one dimension’s difference coefficient is bigger than 0.25, which has been modified, and the difference coefficients of 72 dimensional indicators are all between 0-0.24 (less than 0.25).In summary, The expert authority degree is 0.846. In the Delphi Method, when the expert authority degree >0.7 it can be seen as relatively high. Hence, the expert authority degree in this round of expert consultation is quite good. Experts have given positive responses to the dimension structure of the indicator system in this thesis quite unanimously, which demonstrates that both the first and second round of research have been recognized by consultation experts as scientific and rational. The attributes, dimensions and indicators of the information service evaluation system of a Hospital Information Platform in China have been identified. According to Their respective arithmetic averages are less than 3, which does not reach the predetermined indicator of consistency. After two rounds of questionnaires, the old indicators are eliminated to construct new indicators. Based on the above indicators, this thesis has developed it into Figures2 and 3 the formal version.Figure 2
Theoretical Research Platform of Information Service Quality of a Hospital Information Platform in China (Formal Version).Figure 3
Dimension Structure of Information Service Quality Indicator System of a Hospital Information Platform in China (Final Version).


### 3.2. System Construction of Information Service Quality Indicators and Weight Determination

Through the Delphi method, this thesis conducts two rounds of expert consultation and discussion according to the importance of the dimensional indicators of information service evaluation system of a Hospital Information Platform in China. The consultation form is basically the same as the one constructed in the information service evaluation system in the hospital information platform. The difference lies in that the consulting content is changed into the 4 initial weight schemes and the experts can either choose a scheme from the above four schemes or propose their own ones. If the experts do not have a unified opinion after the first round of consultation, the author can merge and sort out the four schemes and the schemes put forward by experts in the first round.Through the first and second rounds of expert consultation, the final weight distribution scheme is determined. The combined weight values of secondary and tertiary indicators are obtained through multiplication. The combined weight values of the secondary indicators are obtained by Equation (2), while those of tertiary indicators are got by Equation (3).(2)Swi=S1i×S2iSwi is the combined weight value of the secondary indicators, S1i refers to the weight of primary indicator corresponding to indicator i, and S2i the weight of secondary indicator corresponding to indicator i. See Table 1.(3)Swi=S1i×S2i×S3iTable 1
Indicator Combined Weight Values of Information Service Evaluation System of a Hospital Information Platform in China.
(1) distribution scheme of primary indicatorsNo.Evaluation IndicatorScheme 4Weight value1Functional quality attribute of website information service700.72Supporting attribute of website information service300.3Total1(2) distribution scheme of secondary indicatorsNo.Evaluation IndicatorScheme 3Original first-round my scheme 2)Combined weight value1.1Dimension of online medical information services350.2451.2Dimension of online medical service information300.211.3Dimension of online interactive information200.141.4Dimension of digital media service information150.105No.Evaluation IndicatorScheme 2Combined weight value2.1Dimension of resource quality of information service400.122.2Dimension of resource administration of information service300.092.3Dimension of information service technology150.0452.4Dimension of information construction150.045Total1(3) distribution scheme of tertiary indicatorsNo.Evaluation IndicatorScheme 1Combined weight value1.1.1Hospital profile100.02451.1.2News and bulletin70.017151.1.3Introduction of hospital experts70.017151.1.4Introduction of departments50.012251.1.5Publicity of medical events50.012251.1.6Special medical treatment50.012251.1.7Emergency service and outpatient service hour100.02451.1.8Treatment guidelines100.02451.1.9Device introduction100.02451.1.10Accompanying services40.00981.1.11Medical insurance information50.012251.1.12Charging standard notes50.012251.1.13Handy Services50.012251.1.14Appointments and registration by phone60.01471.1.15Contact information60.0147No.Evaluation IndicatorScheme 4Combined weight value1.2.1Signing in service250.05251.2.2Online appointment and registering350.07351.2.3Examination results query250.05251.2.4Online complaint100.0211.2.5Virtual hospital50.0105No.Evaluation IndicatorScheme 4Combined weight value1.3.1Online advisory300.0421.3.2E-mail advisory100.0141.3.3Text message advisory100.0141.3.4Online medical service300.0421.3.5BBS150.0211.3.6Online message board50.007No.Evaluation IndicatorScheme 2Combined weight value1.4.1Disease knowledge150.015751.4.2Popular science150.015751.4.3Multimedia video7.50.0078751.4.4Medical policy150.015751.4.5Medical education7.50.0078751.4.6Drug usage150.015751.4.7Academic database12.50.0131251.4.8Hospital E-journal12.50.013125No.Evaluation IndicatorScheme 2Combined weight value2.1.1Readability200.0242.1.2Accuracy300.0362.1.3Completeness200.0242.1.4Information source300.036No.Evaluation IndicatorScheme 4Combined weight value2.2.1Copyright350.03152.2.2Qualification licenses for website operation250.02252.2.3Author’s identity100.0092.2.4Title marking100.0092.2.5Accessibility of resource100.0092.2.6Release date100.009No.Evaluation IndicatorScheme 3Combined weight value2.3.1Information classification250.011252.3.2Information stratification100.00452.3.3Navigation mark200.0092.3.4Format specification200.0092.3.5Specification of domain name100.00452.3.6Language150.00675No.Evaluation IndicatorScheme 4Combined weight value2.4.1Time taken to open the homepage300.01352.4.2Digital multimedia function200.0092.4.3Website page view200.0092.4.4Background data300.0135Total1Swi is the combined weight value of the tertiary indicators, S1i refers to the weight of primary indicator corresponding to indicator i, S2i the weight of secondary indicator corresponding to indicator i, and S3i the weight of tertiary indicator corresponding to indicator i. The weighting allocation interval is [0,1], See Table 1.


### 3.3. Explanation of Evaluation Indicator Assignment

After determining the structure and weight of the comprehensive evaluation system, to improve it and strengthen its operability, there is still need to take different quantitative assignment methods in accordance with the characteristics of each indicator. Since the assignment interval of all the indicators in the comprehensive evaluation system is set within [0, 1]. According to the characteristics of each indicator, different grades and quantified assignments are divided, and the quantitative scores of all the indicators are calculated. For details about the quantitative assignment of all standards in the comprehensive evaluation system, see Table2.Table 2
The Quantification and Assignment Standards of the Dimensions of Online Medical Information Services.
No.Evaluation standardsDescription of quantitative assignmentQuantitative assignment of the dimensions of online medical information services1.1.1Hospital profileThe hospital profile item includes ten sub-items:(introduction, logo, history, leadership, culture, qualification, honor, environment, words by the president and video of the hospital.) each of these items has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 10.W1 is the specific value of the i sub-item.1.1.2News and bulletinThe news and announcement include two sub-items: News and announcement, respectively, valued 0.7 and 0.3. According to the updating frequency, the sub-item news falls into four categories, no updating, updating every one month and over, updating every week and updating every two days, which are valued, respectively, 0, 0.34, 0.67 and 1. The sub-item announcement has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:0.7×W1+0.3×W2W1is the value of news and W2 is that of announcement.1.1.3Introduction of hospital expertsThe introduction of hospital experts includes five sub-items: (personal introduction, expertise, honor and academic achievements, positions and contacts.) this item has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.4Introduction of departmentsThe item introduction of departments includes five sub-items: (departments introduction, expertise, medical teams, honor and contacts.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.5Publicity of medical eventsThe publicity of medical events includes five sub-items:(clinical service management, nursing management, hospital regulations, academic research and medical education.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.6Special medical treatmentThe special medical treatment includes three sub-items: Programs, introduction and effects. It has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 3.Wi is the specific value of the i sub-item.1.1.7Emergency service and outpatient service hourThe emergency service and outpatient service hour include two sub-items: Time and doctors. It has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 2.Wi is the specific value of the i sub-item.1.1.8Treatment guidelinesThe treatment guidelines include eight sub-items: (transportation guides, hospital indoor navigation, outpatient information, registration information, emergency information, medical test information, inpatient treatment and discharge guidelines.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 8.Wi is the specific value of the i sub-item.1.1.9Device introductionThe device introduction includes five sub-items: (types, names, functions, distribution and numbers.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.10Accompanying serviceThe accompanying service includes five sub-items: (home care, inpatient care, postpartum care, pregnancy care and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.11Medical insurance informationThe medical insurance information includes four sub-items: (news, policies, guidelines, and organizations.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 4.Wi is the specific value of the i sub-item.1.1.12Charging standard notesThe charging standard notes include six sub-items: (outpatient, emergency and comprehensive medical services, traditional Chinese and folk medicine, medical technologies, clinical treatment, special medical treatment services and pharmaceutical drugs.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item.1.1.13Handy ServiceThe item Handy Services includes ten sub-items:(guiding services, drinking water, body temperature measurement, Presbyopic glasses, wheelchairs and stretchers, medical record copying, free magazines, parking guides, testing report post service and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 10.Wi is the specific value of the i sub-item.1.1.14Appointments and registration by phoneAccording to its functions, the item appointments and registration by phone has four levels:(1) no telephone appointment service is provided on the website, which is valued 0(2) the website offers telephone number for appointment but it is not accessible. The value is 0.34(3) the website has accessible telephone number but users cannot make appointment through it. The value is 0.67(4) the website provides telephone appointment service and users can make an appointment successfully, which is valued 1The state that the website provides telephone appointment service and users can make an appointment successfully is: When researchers acting as patients make an appointment over the telephone, operators answer the phone promptly, make a registration in appropriate departments for the patients according to the symptoms described by the researchers, record the patients’ information and thus finish all the registration procedures.1.1.15Contact informationThe contact information includes ten sub-items for contacting the hospitals: (hospital switchboard, phone numbers of departments, discipline inspection phone number, E-mail address, hospital address, location, traffic, digital map, President’s mail-box and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 10.Wi is the specific value of the i sub-item.Online medical service information1.2.1Signing in serviceAccording to its functions, the signing in service has four levels:(1) the hospital website does not provide registration service. The value is 0(2) the website provides registration service but users cannot finish the registration. The value is 0.34(3) the website has registration service and users can register successfully. The value is 0.67(4) the website has registration service and users can register successfully and use the registered accounts to use website’s functions. The value is 11.2.2Online appointments and registeringThe online appointments and registering has two levels: “Established” valued 1 and “to be established” valued 0.1.2.3Examination results queryAccording to patients’ names and medical service numbers, the examination results query has two levels: “Established” valued 1 and “to be established” valued 0.1.2.4Online complaintThe online complaint item has two levels: “Established” valued 1 and “to be established” valued 0.1.2.5Virtual hospitalThe virtual hospital includes six sub-items:(medical service appointment, guidelines, specialist clinic, hospital indoor navigation, online test and 3D virtual hospital.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item.Online interactive information1.3.1Online advisoryStandards of this kind include two parts:Service functions valued 0.6 and service quality valued 0.4. The service functions has two levels: “Established” valued 1 and “to be established” valued 0. In terms of the value of service functions, researchers acting as users send consultation to designated e-mail address or phone number. According to the time period before the consultation is answered and the accuracy of the answers, the service function has four levels: Half a month and over, valued 0, in half a month, valued 0.34, in a week, valued 0.67, and in three days, valued 1. The calculation of the value of the quantitative standard is:0.6×W1+0.4×W2W1 is the value of the service functions and W2 is that of the service quality.1.3.2E-mail advisory1.3.3Text message advisory1.3.4Online medical serviceAccording to its functions, the online medical service has three levels:(1) researchers acting as users try the medical services provided on the hospital website to assign the value of the item. If the website does not provide online medical services, the value is 0(2) if the website provides online medical services but users cannot register and further access these services, the value is 0.5(3) if the website provides online medical services and these services are accessible for users, the value is 11.3.5BBSThe BBS item has four levels:(1) if the website does not provide the function of online forum, the value is 0(2) if the website provides this function and users can register and log in to use it, the value is 0.34(3) if the website has an online forum and users can register, log in and search for information by categories, but the number of posts is relatively small (less than 100), the value is 0.67(4) if the website has an online forum with various functions, users can register, log in and search for information by categories, and the number of posts is relatively large (more than 100), the value is 11.3.6Online message boardThis item has two levels: “Established” valued 1 and “to be established” valued 0.Digital media service information1.4.1Disease knowledgeAccording to the amount of its contents, the disease knowledge has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of knowledge items is no more than 50, the value is 0.34(3) if the website provides knowledge about diseases and categorizes these knowledge, and the number of knowledge items is between 50 and 100 (100 included), the value is 0.67(4) if the website provides knowledge about diseases and categorizes these knowledge, and the number of knowledge items is over 100, the value is 11.4.2Popular scienceAccording to the amount of its contents, the popular science has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of knowledge items is no more than 50, the value is 0.34(3) if the website provides knowledge about science and categorizes these knowledge, and the number of knowledge items is between 50 (50 included) and 100, the value is 0.67(4) if the website provides knowledge about science and categorizes these knowledge, and the number of knowledge items is over 100 (100 included), the value is 11.4.3Multimedia videoAccording to the amount of its contents, the multimedia video has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of videos is less than 10, the value is 0.34(3) if the website provides multimedia videos and the number of videos is between 10 (10 included) and 50, the value is 0.67(4) if the website provides multimedia videos and categorizes videos, and the number of videos is 50 and over, the value is 11.4.4Medical policyThe medical policy has two levels: “Established” valued 1 and “to be established” valued 0.1.4.5Medical educationAccording to the amount of its contents, the medical education has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of resources for downloading is no more than 10 (10 included), the value is 0.34(3) if the website provides resources for downloading and the number is over 10, the value is 0.67(4) if the website provides resources for downloading and categorized these resources, and the number is over 50, the value is 11.4.6Drug usageThe drug usage has two levels: “Established” valued 1 and “to be established” valued 0.1.4.7Academic databaseThe academic database has three levels: An academic database with owned academic resources, an academic database and to be established, which valued, respectively, 1, 0.5 and 0.1.4.8Hospital E-journalAccording to its function and contents, the hospital E-journal has four levels:(1) if the website does not provide this function, the value is 0(2) if the website provides this function, and the number of e-journals is no more than 5 (5 included), the value is 0.34(3) if the website has this function, and the number of e-journals is between 5 and 10 (10 included), the value is 0.67(4) if the website has e-journals and provides the function of categorization and searching, and the number of the e-journals is over 10, the value is 1The resource quality of information service2.1.1ReadabilityAccording to whether the contents on the hospital website are easy to be understood by users, readability has four levels valued, respectively, 0, 0.34, 0.67 and 1.2.1.2AccuracyThe accuracy concerns with the accuracy of information published on the website, pronunciation and grammar. According to this accuracy, the item has four levels valued, respectively, 0, 0.34, 0.67 and 1.2.1.3CompletenessThe completeness is whether the information released by the website covers a sufficiently wide range of topics. According to this completeness, the item has four levels valued, respectively, 0, 0.34, 0.67 and 1.2.1.4Information sourceThe information source has five sub-items:(source of the article, reprint mark, reprint review, online reference links and reminding.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 3. The calculation of the value of the quantitative standard is:1/3min3,∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.The “min” function is used to find the smallest value in the given parameter list.Information service resources management2.2.1CopyrightThe copyright has two levels: “Established” valued 1 and “to be established” valued 0.2.2.2Qualification licenses for website operationThe qualification licenses for website operation includes ten sub-items:(internet drug information service license, MOH health information service network management review, internet medical and health information service license, internet education information service license, internet domain name accreditation, internet publishing license, internet broadcasting program license, internet payment license, value added telecommunication business license and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 5. The calculation of the value of the quantitative standard is:1/5min5,∑i=1nWi“n” is the number of the sub-items and equals 10.Wi is the specific value of the i sub-item.The “min” function is used to find the smallest value in the given parameter list.2.2.3Author’s identityThe Author’s identity includes six sub-items:(name, education, title, organization, contact and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 4. The calculation of the value of the quantitative standard is:1/4min4,∑i=1nWi“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item.The “min” function is used to find the smallest value in the given parameter list.2.2.4Title markingThe title marking item has four levels:(1) if the website does not mark any titles, the value is 0(2) if the homepage or a certain web page has a marked title, the value is 0.34(3) if the homepage and other pages all have marked titles, the value is 0.67(4) if the homepage and other pages have different title marks, the value is 1The level of the sub-item is figured out through the random examination of 20 page titles of the hospital’s website.2.2.5Accessibility of resourcesAccording to the number of the website’s invalid links, the accessibility of resources has four levels:(1) if the number of invalid links is no less than 10 (10 included), the value is 0(2) if the number of invalid links is between 5 and 10, the value is 0.34(3) if the number of invalid links is less than 5 (5 included), the value is 0.67(4) if the website has no invalid links, the value is 1The number of invalid links is figured out through the random examination of 20 internal links of the website.2.2.6Release dateThe release date has four levels:(1) if the publishing time or date is not marked, the value is 0(2) if the time or date is marked, the value is 0.5(3) if the time and date are both marked, the value is 1Information service technology2.3.1Information classificationThe information classification includes five sub-items:(1) the layout of pages on the website(2) the homepage has information classification(3) the information classification is reasonable(4) the information classification meets users’ demands(5) the names of classified information are easy to understandThe above five sub-items have four levels: Excellent, good, general and bad, valued, respectively, 0, 0.34, 0.67 and 1. The calculation of the value of this item is:0.2×W1+W2+W3+W4+W5W1,W2,W3,W4 AndW5 are, respectively, the values of the five sub-items.2.3.2Information stratificationAccording to the number of the grades of information classification, the item has four levels:(1) if the number of the grades is no less than 10, the value is 0(2) if the number of the grades is between 5 and 10, the value is 0.34(3) if the number of the grades is between 4 (4 included) and 5 (5 included), the value is 0.67(4) if the number of the grades is less than 4, the value is 12.3.3Navigation markThe navigation mark includes five items:(A back link to the last page, a back link to the homepage, a back link to the information classification page, a link to homepage prompt message and a navigation map for the website.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 3. The calculation of the value of the quantitative standard is:1/3min3,∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.The level of the sub-item is figured out through the random examination of 20 page titles of the hospital’s website.The “min” function is used to find the smallest value in the given parameter list.2.3.4Format specificationThe format specification includes eight sub-items:(well-designed pages, user-friendly font size, uniform page layout, appropriate page margin, pagination on long pages, a horizontal scroll bar on large pages, zoom-in and zoom-out function, all browsers supported.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 7. The calculation of the value of the quantitative standard is:14min4,∑i=1nwi“n” is the number of the sub-items and equals 8.Wi is the specific value of the i sub-item.The level of the sub-items is figured out through the random examination of 20 pages of the hospital’s website.The “min” function is used to find the smallest value in the given parameter list.2.3.5Specification of domain nameThe specification of domain name is whether the URL of the hospital website is composed of the hospital’s English name or Chinese pinyin initials, whether it has multiple corresponding domain names and whether users find it easy to remember and use. This item has three levels:(1) if the domain name is not composed of the hospital’s English name or Chinese pinyin initials, and it does not have multiple corresponding domain names, the value is 0(2) if the domain name is composed of the hospital’s English name or Chinese pinyin initials, while it does not have multiple corresponding domain names, the value is 0.5(3) if the domain name is composed of the hospital’s English name or Chinese pinyin initials, and it has multiple corresponding domain names formed by the hospital’s English name and Chinese pinyin initials, the value is 12.3.6LanguageIf the website only has simple Chinese version, the value is 0.5; if it has two or more language versions including Chinese, the value is 1.Information architecture2.4.1Time taken to open the homepageAccording to the time users need to open the hospital website’s homepage, the time taken to open the homepage (before flashes and videos are played) has four levels:(1) if the homepage open time exceeds 10 seconds, the value is 0(2) if the homepage open time is between 8 and 10 (10 included) seconds, the value is 0.34(3) if the homepage open time is between 4 and 8 (8 included) seconds, the value is 0.67(4) if the homepage open time is no more than 4 seconds, the value is 12.4.2Digital multimedia functionThe digital multimedia function refers to dynamic forms of information services provided by the hospital website, including pictures, sounds, videos, flashes, dynamic pages and 3D interaction programs. Each of the above six sub-items has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 4. In case that advertisement appears in the forms of dialog boxes and float bars on the website, 1 point is deducted. The calculation of the value of the quantitative standard is:14min4,∑i=1nwi−R“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item. R is the case that incurs any point deduction.The level of the sub-items is figured out through the random examination of 20 pages of the hospital’s website.The “min” function is used to find the smallest value in the given parameter list.2.4.3Website PageviewThe website page view is the function to calculate the number of visitors to the hospital website. According to its function, the item has two levels: “Established” valued 1 and “to be established” valued 0.2.4.4Background dataThe background data refers to that the information service resources on the website are posted in the format and form of background data. It has four sub-items:(1) if the resources are not in the format and form of background data, the value is 0(2) if part of the contents on the website is in the format and form of background data, the value is 0.34(3) if half or more of the contents of the website are in the format and form of background data, the value is 0.67(4) if all the contents of the website are in the format and form of background data, the value is 1Source: the author.


### 3.4. Indicator Quantification of Evaluation System and Assignment Standard and Construction of Comprehensive Evaluation Model

By weighting the dimensions of the system and assigning values in a quantitative way, the author establishes a comprehensive evaluation model for the information service of the a Hospital Information Platform in China according to the weight of its information service and the quantitative value assignment standards. For the total weighted score of the comprehensive indicators, see Equation (4).(4)R=∑i=1m∑j=1niWijRij×100R representing the total score is in the range between 0 and 100, Rij is the value of the j indicator in the i dimension, and Wij is the combined weight of the j indicator in the i dimension. i is 1 to m, j is 1 to ni, ni is the number of indicators covered by the i dimension, m is the number of the dimensions and equals 8, and S is the number of indicators in the tertiary level and equals 54.The author first collects data by using the Hospital Website Information Service Evaluation Form, then processes the data, assigns values in a quantitative way according to the evaluation of indicators at each level, and in the end, uses the equation of the comprehensive evaluation model to calculate the comprehensive score of the information service of the a Hospital Information Platform in China.


## 3.1. The Structure of System Evaluating the Information Service

This study has randomly chosen 101 experts across China to put into the expert bank of consultation object, ranging from professors in management or other disciplines with deputy senior or above titles to information technology experts at hospitals and professional technicians at information technology web design companies. Next, send the initial dimension indicator set to about 20 experts via mobile phones, letters and emails for at least two rounds of consultation to settle the names, categories, quantity and structure of the evaluation system’s dimension indicators. Each round of consultation randomly chooses experts among the 101 consultation objects to send consultation forms, See Figure1 for details.Figure 1
Statistics of Status of Consultation Experts.The expert difference coefficient Q indicates the difference of expert opinion. This variable coefficient demonstrates different degree of expert recognition of the evaluated indicators. The smaller the variable coefficient is, the less the difference of expert opinion is. Calculation equation of variable coefficient:(1)Qi=siviIn the equation, Qi refers to the variable coefficient of indicator i, si standard deviation and vi weighted arithmetic mean. In the two rounds of expert consultations, 45 consultation forms were sent out, and 40 valid feedbacks were collected. The effectiveness of the two rounds of consultations was 86%, both of which were higher than 60%.18 dimensional indicators’ difference coefficients in the first round are over 0.25, and all these 18 dimensions have been adjusted accordingly; while the difference coefficients of 73 dimensional indicators are all between 0.08-0.24 (less than 0.25). In the second round, only one dimension’s difference coefficient is bigger than 0.25, which has been modified, and the difference coefficients of 72 dimensional indicators are all between 0-0.24 (less than 0.25).In summary, The expert authority degree is 0.846. In the Delphi Method, when the expert authority degree >0.7 it can be seen as relatively high. Hence, the expert authority degree in this round of expert consultation is quite good. Experts have given positive responses to the dimension structure of the indicator system in this thesis quite unanimously, which demonstrates that both the first and second round of research have been recognized by consultation experts as scientific and rational. The attributes, dimensions and indicators of the information service evaluation system of a Hospital Information Platform in China have been identified. According to Their respective arithmetic averages are less than 3, which does not reach the predetermined indicator of consistency. After two rounds of questionnaires, the old indicators are eliminated to construct new indicators. Based on the above indicators, this thesis has developed it into Figures2 and 3 the formal version.Figure 2
Theoretical Research Platform of Information Service Quality of a Hospital Information Platform in China (Formal Version).Figure 3
Dimension Structure of Information Service Quality Indicator System of a Hospital Information Platform in China (Final Version).


## 3.2. System Construction of Information Service Quality Indicators and Weight Determination

Through the Delphi method, this thesis conducts two rounds of expert consultation and discussion according to the importance of the dimensional indicators of information service evaluation system of a Hospital Information Platform in China. The consultation form is basically the same as the one constructed in the information service evaluation system in the hospital information platform. The difference lies in that the consulting content is changed into the 4 initial weight schemes and the experts can either choose a scheme from the above four schemes or propose their own ones. If the experts do not have a unified opinion after the first round of consultation, the author can merge and sort out the four schemes and the schemes put forward by experts in the first round.Through the first and second rounds of expert consultation, the final weight distribution scheme is determined. The combined weight values of secondary and tertiary indicators are obtained through multiplication. The combined weight values of the secondary indicators are obtained by Equation (2), while those of tertiary indicators are got by Equation (3).(2)Swi=S1i×S2iSwi is the combined weight value of the secondary indicators, S1i refers to the weight of primary indicator corresponding to indicator i, and S2i the weight of secondary indicator corresponding to indicator i. See Table 1.(3)Swi=S1i×S2i×S3iTable 1
Indicator Combined Weight Values of Information Service Evaluation System of a Hospital Information Platform in China.
(1) distribution scheme of primary indicatorsNo.Evaluation IndicatorScheme 4Weight value1Functional quality attribute of website information service700.72Supporting attribute of website information service300.3Total1(2) distribution scheme of secondary indicatorsNo.Evaluation IndicatorScheme 3Original first-round my scheme 2)Combined weight value1.1Dimension of online medical information services350.2451.2Dimension of online medical service information300.211.3Dimension of online interactive information200.141.4Dimension of digital media service information150.105No.Evaluation IndicatorScheme 2Combined weight value2.1Dimension of resource quality of information service400.122.2Dimension of resource administration of information service300.092.3Dimension of information service technology150.0452.4Dimension of information construction150.045Total1(3) distribution scheme of tertiary indicatorsNo.Evaluation IndicatorScheme 1Combined weight value1.1.1Hospital profile100.02451.1.2News and bulletin70.017151.1.3Introduction of hospital experts70.017151.1.4Introduction of departments50.012251.1.5Publicity of medical events50.012251.1.6Special medical treatment50.012251.1.7Emergency service and outpatient service hour100.02451.1.8Treatment guidelines100.02451.1.9Device introduction100.02451.1.10Accompanying services40.00981.1.11Medical insurance information50.012251.1.12Charging standard notes50.012251.1.13Handy Services50.012251.1.14Appointments and registration by phone60.01471.1.15Contact information60.0147No.Evaluation IndicatorScheme 4Combined weight value1.2.1Signing in service250.05251.2.2Online appointment and registering350.07351.2.3Examination results query250.05251.2.4Online complaint100.0211.2.5Virtual hospital50.0105No.Evaluation IndicatorScheme 4Combined weight value1.3.1Online advisory300.0421.3.2E-mail advisory100.0141.3.3Text message advisory100.0141.3.4Online medical service300.0421.3.5BBS150.0211.3.6Online message board50.007No.Evaluation IndicatorScheme 2Combined weight value1.4.1Disease knowledge150.015751.4.2Popular science150.015751.4.3Multimedia video7.50.0078751.4.4Medical policy150.015751.4.5Medical education7.50.0078751.4.6Drug usage150.015751.4.7Academic database12.50.0131251.4.8Hospital E-journal12.50.013125No.Evaluation IndicatorScheme 2Combined weight value2.1.1Readability200.0242.1.2Accuracy300.0362.1.3Completeness200.0242.1.4Information source300.036No.Evaluation IndicatorScheme 4Combined weight value2.2.1Copyright350.03152.2.2Qualification licenses for website operation250.02252.2.3Author’s identity100.0092.2.4Title marking100.0092.2.5Accessibility of resource100.0092.2.6Release date100.009No.Evaluation IndicatorScheme 3Combined weight value2.3.1Information classification250.011252.3.2Information stratification100.00452.3.3Navigation mark200.0092.3.4Format specification200.0092.3.5Specification of domain name100.00452.3.6Language150.00675No.Evaluation IndicatorScheme 4Combined weight value2.4.1Time taken to open the homepage300.01352.4.2Digital multimedia function200.0092.4.3Website page view200.0092.4.4Background data300.0135Total1Swi is the combined weight value of the tertiary indicators, S1i refers to the weight of primary indicator corresponding to indicator i, S2i the weight of secondary indicator corresponding to indicator i, and S3i the weight of tertiary indicator corresponding to indicator i. The weighting allocation interval is [0,1], See Table 1.


## 3.3. Explanation of Evaluation Indicator Assignment

After determining the structure and weight of the comprehensive evaluation system, to improve it and strengthen its operability, there is still need to take different quantitative assignment methods in accordance with the characteristics of each indicator. Since the assignment interval of all the indicators in the comprehensive evaluation system is set within [0, 1]. According to the characteristics of each indicator, different grades and quantified assignments are divided, and the quantitative scores of all the indicators are calculated. For details about the quantitative assignment of all standards in the comprehensive evaluation system, see Table2.Table 2
The Quantification and Assignment Standards of the Dimensions of Online Medical Information Services.
No.Evaluation standardsDescription of quantitative assignmentQuantitative assignment of the dimensions of online medical information services1.1.1Hospital profileThe hospital profile item includes ten sub-items:(introduction, logo, history, leadership, culture, qualification, honor, environment, words by the president and video of the hospital.) each of these items has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 10.W1 is the specific value of the i sub-item.1.1.2News and bulletinThe news and announcement include two sub-items: News and announcement, respectively, valued 0.7 and 0.3. According to the updating frequency, the sub-item news falls into four categories, no updating, updating every one month and over, updating every week and updating every two days, which are valued, respectively, 0, 0.34, 0.67 and 1. The sub-item announcement has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:0.7×W1+0.3×W2W1is the value of news and W2 is that of announcement.1.1.3Introduction of hospital expertsThe introduction of hospital experts includes five sub-items: (personal introduction, expertise, honor and academic achievements, positions and contacts.) this item has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.4Introduction of departmentsThe item introduction of departments includes five sub-items: (departments introduction, expertise, medical teams, honor and contacts.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.5Publicity of medical eventsThe publicity of medical events includes five sub-items:(clinical service management, nursing management, hospital regulations, academic research and medical education.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.6Special medical treatmentThe special medical treatment includes three sub-items: Programs, introduction and effects. It has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 3.Wi is the specific value of the i sub-item.1.1.7Emergency service and outpatient service hourThe emergency service and outpatient service hour include two sub-items: Time and doctors. It has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 2.Wi is the specific value of the i sub-item.1.1.8Treatment guidelinesThe treatment guidelines include eight sub-items: (transportation guides, hospital indoor navigation, outpatient information, registration information, emergency information, medical test information, inpatient treatment and discharge guidelines.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 8.Wi is the specific value of the i sub-item.1.1.9Device introductionThe device introduction includes five sub-items: (types, names, functions, distribution and numbers.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.10Accompanying serviceThe accompanying service includes five sub-items: (home care, inpatient care, postpartum care, pregnancy care and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.1.1.11Medical insurance informationThe medical insurance information includes four sub-items: (news, policies, guidelines, and organizations.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 4.Wi is the specific value of the i sub-item.1.1.12Charging standard notesThe charging standard notes include six sub-items: (outpatient, emergency and comprehensive medical services, traditional Chinese and folk medicine, medical technologies, clinical treatment, special medical treatment services and pharmaceutical drugs.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item.1.1.13Handy ServiceThe item Handy Services includes ten sub-items:(guiding services, drinking water, body temperature measurement, Presbyopic glasses, wheelchairs and stretchers, medical record copying, free magazines, parking guides, testing report post service and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 10.Wi is the specific value of the i sub-item.1.1.14Appointments and registration by phoneAccording to its functions, the item appointments and registration by phone has four levels:(1) no telephone appointment service is provided on the website, which is valued 0(2) the website offers telephone number for appointment but it is not accessible. The value is 0.34(3) the website has accessible telephone number but users cannot make appointment through it. The value is 0.67(4) the website provides telephone appointment service and users can make an appointment successfully, which is valued 1The state that the website provides telephone appointment service and users can make an appointment successfully is: When researchers acting as patients make an appointment over the telephone, operators answer the phone promptly, make a registration in appropriate departments for the patients according to the symptoms described by the researchers, record the patients’ information and thus finish all the registration procedures.1.1.15Contact informationThe contact information includes ten sub-items for contacting the hospitals: (hospital switchboard, phone numbers of departments, discipline inspection phone number, E-mail address, hospital address, location, traffic, digital map, President’s mail-box and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 10.Wi is the specific value of the i sub-item.Online medical service information1.2.1Signing in serviceAccording to its functions, the signing in service has four levels:(1) the hospital website does not provide registration service. The value is 0(2) the website provides registration service but users cannot finish the registration. The value is 0.34(3) the website has registration service and users can register successfully. The value is 0.67(4) the website has registration service and users can register successfully and use the registered accounts to use website’s functions. The value is 11.2.2Online appointments and registeringThe online appointments and registering has two levels: “Established” valued 1 and “to be established” valued 0.1.2.3Examination results queryAccording to patients’ names and medical service numbers, the examination results query has two levels: “Established” valued 1 and “to be established” valued 0.1.2.4Online complaintThe online complaint item has two levels: “Established” valued 1 and “to be established” valued 0.1.2.5Virtual hospitalThe virtual hospital includes six sub-items:(medical service appointment, guidelines, specialist clinic, hospital indoor navigation, online test and 3D virtual hospital.) it has two levels: “Established” valued 1 and “to be established” valued 0. The calculation of the value of the quantitative standard is:1/n∑i=1nWi“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item.Online interactive information1.3.1Online advisoryStandards of this kind include two parts:Service functions valued 0.6 and service quality valued 0.4. The service functions has two levels: “Established” valued 1 and “to be established” valued 0. In terms of the value of service functions, researchers acting as users send consultation to designated e-mail address or phone number. According to the time period before the consultation is answered and the accuracy of the answers, the service function has four levels: Half a month and over, valued 0, in half a month, valued 0.34, in a week, valued 0.67, and in three days, valued 1. The calculation of the value of the quantitative standard is:0.6×W1+0.4×W2W1 is the value of the service functions and W2 is that of the service quality.1.3.2E-mail advisory1.3.3Text message advisory1.3.4Online medical serviceAccording to its functions, the online medical service has three levels:(1) researchers acting as users try the medical services provided on the hospital website to assign the value of the item. If the website does not provide online medical services, the value is 0(2) if the website provides online medical services but users cannot register and further access these services, the value is 0.5(3) if the website provides online medical services and these services are accessible for users, the value is 11.3.5BBSThe BBS item has four levels:(1) if the website does not provide the function of online forum, the value is 0(2) if the website provides this function and users can register and log in to use it, the value is 0.34(3) if the website has an online forum and users can register, log in and search for information by categories, but the number of posts is relatively small (less than 100), the value is 0.67(4) if the website has an online forum with various functions, users can register, log in and search for information by categories, and the number of posts is relatively large (more than 100), the value is 11.3.6Online message boardThis item has two levels: “Established” valued 1 and “to be established” valued 0.Digital media service information1.4.1Disease knowledgeAccording to the amount of its contents, the disease knowledge has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of knowledge items is no more than 50, the value is 0.34(3) if the website provides knowledge about diseases and categorizes these knowledge, and the number of knowledge items is between 50 and 100 (100 included), the value is 0.67(4) if the website provides knowledge about diseases and categorizes these knowledge, and the number of knowledge items is over 100, the value is 11.4.2Popular scienceAccording to the amount of its contents, the popular science has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of knowledge items is no more than 50, the value is 0.34(3) if the website provides knowledge about science and categorizes these knowledge, and the number of knowledge items is between 50 (50 included) and 100, the value is 0.67(4) if the website provides knowledge about science and categorizes these knowledge, and the number of knowledge items is over 100 (100 included), the value is 11.4.3Multimedia videoAccording to the amount of its contents, the multimedia video has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of videos is less than 10, the value is 0.34(3) if the website provides multimedia videos and the number of videos is between 10 (10 included) and 50, the value is 0.67(4) if the website provides multimedia videos and categorizes videos, and the number of videos is 50 and over, the value is 11.4.4Medical policyThe medical policy has two levels: “Established” valued 1 and “to be established” valued 0.1.4.5Medical educationAccording to the amount of its contents, the medical education has four levels:(1) if the website does not provide this function, the value is 0(2) if the website has this function and the number of resources for downloading is no more than 10 (10 included), the value is 0.34(3) if the website provides resources for downloading and the number is over 10, the value is 0.67(4) if the website provides resources for downloading and categorized these resources, and the number is over 50, the value is 11.4.6Drug usageThe drug usage has two levels: “Established” valued 1 and “to be established” valued 0.1.4.7Academic databaseThe academic database has three levels: An academic database with owned academic resources, an academic database and to be established, which valued, respectively, 1, 0.5 and 0.1.4.8Hospital E-journalAccording to its function and contents, the hospital E-journal has four levels:(1) if the website does not provide this function, the value is 0(2) if the website provides this function, and the number of e-journals is no more than 5 (5 included), the value is 0.34(3) if the website has this function, and the number of e-journals is between 5 and 10 (10 included), the value is 0.67(4) if the website has e-journals and provides the function of categorization and searching, and the number of the e-journals is over 10, the value is 1The resource quality of information service2.1.1ReadabilityAccording to whether the contents on the hospital website are easy to be understood by users, readability has four levels valued, respectively, 0, 0.34, 0.67 and 1.2.1.2AccuracyThe accuracy concerns with the accuracy of information published on the website, pronunciation and grammar. According to this accuracy, the item has four levels valued, respectively, 0, 0.34, 0.67 and 1.2.1.3CompletenessThe completeness is whether the information released by the website covers a sufficiently wide range of topics. According to this completeness, the item has four levels valued, respectively, 0, 0.34, 0.67 and 1.2.1.4Information sourceThe information source has five sub-items:(source of the article, reprint mark, reprint review, online reference links and reminding.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 3. The calculation of the value of the quantitative standard is:1/3min3,∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.The “min” function is used to find the smallest value in the given parameter list.Information service resources management2.2.1CopyrightThe copyright has two levels: “Established” valued 1 and “to be established” valued 0.2.2.2Qualification licenses for website operationThe qualification licenses for website operation includes ten sub-items:(internet drug information service license, MOH health information service network management review, internet medical and health information service license, internet education information service license, internet domain name accreditation, internet publishing license, internet broadcasting program license, internet payment license, value added telecommunication business license and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 5. The calculation of the value of the quantitative standard is:1/5min5,∑i=1nWi“n” is the number of the sub-items and equals 10.Wi is the specific value of the i sub-item.The “min” function is used to find the smallest value in the given parameter list.2.2.3Author’s identityThe Author’s identity includes six sub-items:(name, education, title, organization, contact and others.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 4. The calculation of the value of the quantitative standard is:1/4min4,∑i=1nWi“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item.The “min” function is used to find the smallest value in the given parameter list.2.2.4Title markingThe title marking item has four levels:(1) if the website does not mark any titles, the value is 0(2) if the homepage or a certain web page has a marked title, the value is 0.34(3) if the homepage and other pages all have marked titles, the value is 0.67(4) if the homepage and other pages have different title marks, the value is 1The level of the sub-item is figured out through the random examination of 20 page titles of the hospital’s website.2.2.5Accessibility of resourcesAccording to the number of the website’s invalid links, the accessibility of resources has four levels:(1) if the number of invalid links is no less than 10 (10 included), the value is 0(2) if the number of invalid links is between 5 and 10, the value is 0.34(3) if the number of invalid links is less than 5 (5 included), the value is 0.67(4) if the website has no invalid links, the value is 1The number of invalid links is figured out through the random examination of 20 internal links of the website.2.2.6Release dateThe release date has four levels:(1) if the publishing time or date is not marked, the value is 0(2) if the time or date is marked, the value is 0.5(3) if the time and date are both marked, the value is 1Information service technology2.3.1Information classificationThe information classification includes five sub-items:(1) the layout of pages on the website(2) the homepage has information classification(3) the information classification is reasonable(4) the information classification meets users’ demands(5) the names of classified information are easy to understandThe above five sub-items have four levels: Excellent, good, general and bad, valued, respectively, 0, 0.34, 0.67 and 1. The calculation of the value of this item is:0.2×W1+W2+W3+W4+W5W1,W2,W3,W4 AndW5 are, respectively, the values of the five sub-items.2.3.2Information stratificationAccording to the number of the grades of information classification, the item has four levels:(1) if the number of the grades is no less than 10, the value is 0(2) if the number of the grades is between 5 and 10, the value is 0.34(3) if the number of the grades is between 4 (4 included) and 5 (5 included), the value is 0.67(4) if the number of the grades is less than 4, the value is 12.3.3Navigation markThe navigation mark includes five items:(A back link to the last page, a back link to the homepage, a back link to the information classification page, a link to homepage prompt message and a navigation map for the website.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 3. The calculation of the value of the quantitative standard is:1/3min3,∑i=1nWi“n” is the number of the sub-items and equals 5.Wi is the specific value of the i sub-item.The level of the sub-item is figured out through the random examination of 20 page titles of the hospital’s website.The “min” function is used to find the smallest value in the given parameter list.2.3.4Format specificationThe format specification includes eight sub-items:(well-designed pages, user-friendly font size, uniform page layout, appropriate page margin, pagination on long pages, a horizontal scroll bar on large pages, zoom-in and zoom-out function, all browsers supported.) it has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 7. The calculation of the value of the quantitative standard is:14min4,∑i=1nwi“n” is the number of the sub-items and equals 8.Wi is the specific value of the i sub-item.The level of the sub-items is figured out through the random examination of 20 pages of the hospital’s website.The “min” function is used to find the smallest value in the given parameter list.2.3.5Specification of domain nameThe specification of domain name is whether the URL of the hospital website is composed of the hospital’s English name or Chinese pinyin initials, whether it has multiple corresponding domain names and whether users find it easy to remember and use. This item has three levels:(1) if the domain name is not composed of the hospital’s English name or Chinese pinyin initials, and it does not have multiple corresponding domain names, the value is 0(2) if the domain name is composed of the hospital’s English name or Chinese pinyin initials, while it does not have multiple corresponding domain names, the value is 0.5(3) if the domain name is composed of the hospital’s English name or Chinese pinyin initials, and it has multiple corresponding domain names formed by the hospital’s English name and Chinese pinyin initials, the value is 12.3.6LanguageIf the website only has simple Chinese version, the value is 0.5; if it has two or more language versions including Chinese, the value is 1.Information architecture2.4.1Time taken to open the homepageAccording to the time users need to open the hospital website’s homepage, the time taken to open the homepage (before flashes and videos are played) has four levels:(1) if the homepage open time exceeds 10 seconds, the value is 0(2) if the homepage open time is between 8 and 10 (10 included) seconds, the value is 0.34(3) if the homepage open time is between 4 and 8 (8 included) seconds, the value is 0.67(4) if the homepage open time is no more than 4 seconds, the value is 12.4.2Digital multimedia functionThe digital multimedia function refers to dynamic forms of information services provided by the hospital website, including pictures, sounds, videos, flashes, dynamic pages and 3D interaction programs. Each of the above six sub-items has two levels: “Established” valued 1 and “to be established” valued 0. The total score is 4. In case that advertisement appears in the forms of dialog boxes and float bars on the website, 1 point is deducted. The calculation of the value of the quantitative standard is:14min4,∑i=1nwi−R“n” is the number of the sub-items and equals 6.Wi is the specific value of the i sub-item. R is the case that incurs any point deduction.The level of the sub-items is figured out through the random examination of 20 pages of the hospital’s website.The “min” function is used to find the smallest value in the given parameter list.2.4.3Website PageviewThe website page view is the function to calculate the number of visitors to the hospital website. According to its function, the item has two levels: “Established” valued 1 and “to be established” valued 0.2.4.4Background dataThe background data refers to that the information service resources on the website are posted in the format and form of background data. It has four sub-items:(1) if the resources are not in the format and form of background data, the value is 0(2) if part of the contents on the website is in the format and form of background data, the value is 0.34(3) if half or more of the contents of the website are in the format and form of background data, the value is 0.67(4) if all the contents of the website are in the format and form of background data, the value is 1Source: the author.


## 3.4. Indicator Quantification of Evaluation System and Assignment Standard and Construction of Comprehensive Evaluation Model

By weighting the dimensions of the system and assigning values in a quantitative way, the author establishes a comprehensive evaluation model for the information service of the a Hospital Information Platform in China according to the weight of its information service and the quantitative value assignment standards. For the total weighted score of the comprehensive indicators, see Equation (4).(4)R=∑i=1m∑j=1niWijRij×100R representing the total score is in the range between 0 and 100, Rij is the value of the j indicator in the i dimension, and Wij is the combined weight of the j indicator in the i dimension. i is 1 to m, j is 1 to ni, ni is the number of indicators covered by the i dimension, m is the number of the dimensions and equals 8, and S is the number of indicators in the tertiary level and equals 54.The author first collects data by using the Hospital Website Information Service Evaluation Form, then processes the data, assigns values in a quantitative way according to the evaluation of indicators at each level, and in the end, uses the equation of the comprehensive evaluation model to calculate the comprehensive score of the information service of the a Hospital Information Platform in China.


## 4. Empirical Research Results

Since the website of a Hospital Information Platform in China is the only channel for the hospital’s information platform to deliver information services, the author sets the website of a Hospital Information Platform in China as the object of the empirical research. Established on June 19, 2013, the website of a Hospital Information Platform is redesigning its overall pages on June 19, 2017, as the empirical research goes on. Therefore, the author sets both the pre-revised website and the post-revised website as the object of the empirical research. Formulated on the basis of the Comprehensive Evaluation Model for the Information Service of a Hospital Information Platform Information Platform, the a Hospital Information Platform Website Information Service Evaluation Form is an online data collection form for the evaluation of hospitals’ website information service.In the empirical research, December, 2016 to January, 2020, 80 participants falling of Internet Explorer 11 as the uniform browser and logged in a Hospital Information Platform’s website in ten periods. Stratified random sampling is adopted to select participants, and in accordance with the sampling indicators, these participants are classified into four groups: out-patients, in -patients, hospital employees, and the public and professionals.TThrough the empirical research, we get the comprehensive evaluations of the information service of a Hospital Information Platform’s information platform. if participants give different scores for evaluations of these two items, a mean value is adopted as the final score. The total averages of Pre-revision are: 19.4 and 20.3875, and the total averages of Post-revision are: 73.5, 74.4, 77.7, 77.3, 77.5, 79.4, 81.7, 84.3.Data in show that after the overall revision, the website of a Hospital Information Platform gets clearly higher comprehensive evaluations for its information service. (for details, see Table3).Table 3
Comprehensive Evaluations of the Information Service of a Hospital Information Platform’s Information Platform.
No.PeriodDate1.11.21.31.42.12.22.32.4TotalTotal score1Pre-revision2016/12/200.0880.0000.0000.0030.0330.0250.0210.0250.19419.42Pre-revision2017/01/050.0880.0000.0000.0030.0420.0250.0210.0250.20420.43Post-revision2017/01/200.1510.2050.0860.0510.0960.0710.0330.0430.73573.54Post-revision2017/02/060.1510.2050.0890.0510.1010.0710.0330.0430.74474.45Post-revision2017/08/180.1570.2050.0890.0550.1130.0780.0370.0430.77777.76Post-revision2018/02/060.1570.2050.0890.0550.1130.0780.0370.0380.77377.37Post-revision2018/08/030.1570.2050.0890.0550.1130.0780.0370.0410.77577.58Post-revision2019/02/210.1570.2050.0900.0580.1160.0900.0370.0410.79479.49Post-revision2019/08/210.1610.2050.1010.0670.1160.0900.0370.0410.81781.710Post-revision2020/01/090.1660.2050.1170.0670.1160.0900.0380.0450.84384.3By means of the Bivariate Correlation in SPSS, the author carried out a correlation analysis of the comprehensive evaluations of the information service of a Hospital Information Platform’s information platform and the traffic data of a Hospital Information Platform website, including the total traffic, PV (page view) and UV (unique visitor). The total traffic is equal to PV plus UV. For details of the analysis results, the correlation coefficient among the three objects is 1, a significant correlation. It also suggests that the comprehensive evaluations of the information service of a Hospital Information Platform’s information platform and the traffic of a Hospital Information Platform’s website are positively correlated. That is to say, the traffic of a Hospital Information Platform’s website will vary to the changes in the comprehensive evaluations of the information service of a Hospital Information Platform’s information platform.


## 5. Conclusions

Based on the actual situation of Chinese hospitals, creates a theoretical research platform of medical information service quality based on the reality of a Hospital Information Platform, and sorts out the core of website information service of Chinese hospitals as well as the influencing factors and their correlations. Focusing on the function and quality of hospital information service, it has established a complete and scientific evaluation system of hospital information service that conforms to the actual situation of Chinese hospitals. Still, through the empirical research on a Hospital Information Platform website, it also validates the scientificity, rationality and practicability of the model proposed in this thesis. The model’s scores in various dimensions in empirical researchSee Figure4 for details.Figure 4
Line Chart of the Correlation Analysis of the Comprehensive Evaluations of The Secondary Indicators of The Information Service of a Hospital in China.For the first time in China, the author conducts comparison and correlation analysis of survey results on comprehensive evaluation of hospital website information service and traffic data through empirical research, in order to discuss the relations between the evaluation results and the traffic data. And through the above empirical research to prove the positive correlation between the two, see Figure5 for details.Figure 5
Line Chart of the Correlation Analysis of the Comprehensive Evaluations of the Information Service of a Hospital in China and the Traffic of Information Platform’s Website of a Hospital in China (Comprehensive Evaluations of the Information Service of a Hospital in China of value = value×100).


## 6. Suggestions

The results of the empirical research show Enriching the information service functions plays an important role for hospitals to improve the information service quality of their websites and their website usage. The weight of the functional quality attribute of website information service is 0.7, significantly higher than that of the supporting attribute. In addition, the second-level indicators of the functional quality attribute are the dimensional indicators for measuring the functions of hospital websites, while in the evaluation on January 9, 2020, the evaluation score of the functional quality attribute is 55.41, suggesting a improving.As the evaluation of the functional quality attribute of website information service shows a large room for improvement, perfecting the information service function of a Hospital Information Platform’s website is the key task that the hospital should do to enhance its information service. In addition, that after the information service function of a Hospital Information Platform’s website is improved or the evaluation of the functional quality attribute of website information service scores higher, the supporting attribute of website information service will be the next key task for the hospital in enhancing its information service quality. From the data in Figure6 and Table 3, we can see that the improvement ratio of Functional quality attribute of website information service and the supporting attribute of website information service between 2017/8/18 and 2020/1/9 tend to be the same. And even the improvement rate of the supporting attribute is sometimes higher than the improvement rate of Functional quality.Figure 6
Line Chart of the Functional quality attribute of website information service and Supporting attribute of website information service.All in all, between 2017/8/18 and 2020/1/9, the final score of the functional quality attribute of the website information service in 2020/1/9 is about 6 times that of 2017/8/18, and the support attribute of the website information service The final score in 2020/1/9 is about 3 times that of 2017/8/18,see Figure6 and Table 4 for details.Table 4
Evaluation score of the information services of a Hospital Information Platform’s website in China of Growth of rate in empirical research.
Date121.11.21.31.42.12.22.32.42016/12/2000000000002017/1/50.50001.077710011.292311.018312017/1/204.67902.10071.71590017.00002.28572.84001.55691.72002017/2/61.00881.0169111.035111.052111.015412017/8/181.03131.08431.03890.99881.00551.08191.12131.09901.12290.99422018/2/61.00130.9733111.00521110.99750.89582018/8/311.014711111111.05882019/2/211.01441.0449111.01031.04711.02621.1534112019/8/211.074411.025011.11401.158611112020/1/91.04731.03371.030511.15881111.02511.1099This study is the first one in China that applies both the Delphi method and composite grade method to construct the model of comprehensive evaluation system of hospital information service. For the first time in China, the author conducts comparison and correlation analysis of survey results on comprehensive evaluation of hospital website information service and traffic data through empirical research, in order to discuss the relations between the evaluation results and the traffic data. Therefore, it bears considerable reference value. This model is both of high theoretical value and practical value. But the development of new network information technology often goes beyond hospital managers imagination. Therefore, the information service evaluation system in this thesis will be enriched with the development of the times and information technology.



---

*Source: 2089024-2020-07-01.xml*