Online survey
Knowing what we should report could
help to improve the Quality of online survey

Department of International Cooperation for Medical Education

D1:Yuki Izumi, DPM

Online Surveys
Online survey is a data collection

method conducted over the internet

to gather information from a targetedgroup of respondents.

Advantage of online surveys
 Speed & Efficiency
 Geographic Reach Cost-effectiveness Convenience for participants Real-Time MonitoringDisadvantages of online surveys
 Sampling Bias
 Data Quality
 Security and Privacy concerns
 Informed Consent Challenges
 Response Bias Survey fatigue etc…

A well-designed research plancan lead to a good paper
GoodDESIGNPLANGoodPAPER

Knowing what should be included in agood paper helps to plan a research
GoodDESIGNPLANGoodPAPER

CHERRIESTheCHEcklists forReporting
Results ofInternet
E-Surveys
CHERRIES
Eysenbach G, 2004

CHERRIES

Item categories# of Check lists Item

1Design

1

2

IRB approval & Informed Consent Process33Development and Pre-testing

1

4

Recruitment process &Description of the sample having access to the questionnaires

35

Survey Administration

116

Response Rates

47Preventing Multiple Entries from the same individual

48Analysis

3

Eysenbach G, 2004

The total of30items

CHERRIES

1. Design□ 1-1. Describe survey design
Describe target population
 sample frame

Eysenbach G, 2004

CHERRIES

2. IRB approval &informed consent process□ 2-1. IRB approval□ 2-2. Informed Consent□ 2-3. Data protection
Eysenbach G, 2004

CHERRIES

3. Development and pre-testing□ 3-1. Development and testing
How the survey was developed
Has it been pretested?

-Reliability, validity-Usability-technical functionality
Eysenbach G, 2004

CHERRIES

4. Recruitment process & description of thesample having access to the questionnaire□ 4-1. Open survey vs closed survey□ 4-2. Contact mode
□ 4-3. Advertising the survey

Eysenbach G, 2004

CHERRIES

5. Survey Administration□ 5-1. web/E-mail□ 5-2. Context of the website□ 5-3. Mandatory/voluntary□ 5-4. Incentives□ 5-5. Time/Date□ 5-6. Randomization of items

Eysenbach G, 2004

CHERRIES

5. Survey Administration□ 5-7. Adaptive questioning□ 5-8. Number of Items□ 5-9. Number of Screens (pages)□ 5-10. Completeness check□ 5-11. Review step
Eysenbach G, 2004

CHERRIES

6. Response rates□ 6-1. Unique site visitor□ 6-2. View rate (of the first page of survey)□ 6-3. Participation rate (filled 1st page survey)□ 6-4. Completion rate (# of submitted)
Eysenbach G, 2004

CHERRIES

7. Preventing multiple entries
from the same individual□ 7-1. Cookies used
□ 7-2. IP address check□ 7-3. Log file analysis□ 7-4. Registration
Eysenbach G, 2004

CHERRIES

8. Analysis□ 8-1. Handling of incomplete questionnaires□ 8-2. Questionnaires submitted withan atypical timestamp□ 8-3. Statistical correction

Eysenbach G, 2004

CHERRIES

Item categories# of Check lists Item

1Design

12IRB approval & Informed Consent Process

33Development and Pre-testing

14Recruitment process &Description of the sample having access to the questionnaires

35Survey Administration

116Response Rates

47Preventing Multiple Entries from the same individual

48Analysis

3

Eysenbach G, 2004

The total of30

items

CHERRIESTheCHEcklists forReporting
Results ofInternet
E-Surveys
CHERRIES
Eysenbach G, 2004

Knowing what should be included in agood paper helps to plan a research
GoodDESIGNPLANGoodPAPERReference■ Eysenbach G. Improving the quality of Web surveys: theChecklist for Reporting Results of Internet E-Surveys(CHERRIES). J Med Internet Res. 2004 Sep 29;6(3):e34.
■ Huston P. Reporting on surveys: information for authors
and peer reviewers. CMAJ. 1996 Jun 1;154(11):1695-704.

Thank you for your attention!