☐ Yes ☐ No If multiple settings, were they appropriate for study design? ☐ Yes ☐ No ☐ NA Probability sampling (i.e. random) Non-probability (i.e. convenience) Sample size: based on statistical test used and power analysis – goal to generalize results other populations Purposeful or Theoretical sampling Sample size: based on judgment and experience often smaller than quantitative – goal to gain deeper understanding of concept Study Methods: Sample (Describe sampling strategy, inclusion/exclusion criteria, sample size, and characteristics of sample [i.e. people, places, events]) Was sample size sufficient based on study design and data analysis? ☐ Yes ☐ No *Was sample representative of population study? ☐ Yes ☐ No ☐ NA *If an intervention was used were sample characteristics equivalent between control and intervention groups? Data Collection Methods: Surveys (include response rate) Measurement instruments, tools, questionnaires) If intervention used, describe fidelity or how researcher made sure the intervention was consistently used with all subjects. Data Collection Methods and techniques: Interviews, focus groups, observations, documents, (audio and videotaping, field notes) Collection and Analysis often occur simultaneously Study Methods: Study Procedures (Describe *interventions, if tested, data collection methods, measurement instruments or data collection tools [including interview guides], timing/sequencing of data collection, human subjects protection) Was data collection method described clearly? ☐ Yes ☐ No Was data collection method a good fit with the study purpose and design? ☐ Yes ☐ No *For surveys, was response rate adequate (≥25% to 40%)? *Were measurement instruments validity and reliability discussed (psychometrically tested with adequate reliability (Chronbach alpha ≥0.70)? *If intervention used, was it described clearly? ☐ Yes ☐ No ☐ NA #Was discussed (credibility, transferability, dependability, confirmability) (see Appendix C Table 3) ☐ Yes ☐ No See Appendix C See Appendix B Study Methods: Data Analysis (Describe methods used to analyze data) Were the analysis methods appropriate? ☐ Yes ☐ No
Descriptive statistics Bivariate analysis Multivariate analysis Organizing data Reading & memoing Coding and themes Interpreting data Presenting data No differentiation between study types Results: (Summarize results) Are results presented clearly? ☐ Yes ☐ No Are charts, graphs, tables easy to understand? ☐ Yes ☐ No ☐ NA If used, was description consistent with information on them? ☐ Yes ☐ No #Were narratives used to support results? ☐ Yes ☐ No No differentiation between study types Limitations: (Summarize limitations) Were limitations identified and addressed? ☐ Yes ☐ No No differentiation between study types Clinical Significance: (Focus on implications that this study has for nursing practice) Does study contribute to nursing knowledge? ☐ Yes ☐ No Are the study results generalizable/transferable to our practice setting? ☐ Yes ☐ No Do the results warrant examining our current practice for changes? ☐ Yes ☐No
Choosing the Appropriate Statistical Test: Marge Funk, PhD, RN Bivariate Statistical Tests Test Name or Related Purpose Measurement IV DV Parametric Tests Independent t-test I Test the difference between 2 independent group means N I/R Paired t-test R Test the difference between 2 related group means N I/R 1-way analysis of variance (ANOVA) I Test the difference the means of 3+ independent groups N I/R Repeated measures ANOVA R Test the difference among the means of 3+ related groups or sets of scores N I/R Pearson correlation I, R Test the existence of a relationship between 2 variables I/R I/R Linear regression -- Predict of DV for given value of IV I/R I/R Nonparametric Mann-Whitney U-test I Test the difference in of scores of 2 independent groups N O Wilcoxon signed-rank test R Test the difference in ranks of scores of 2 related groups N O Kruskal-Wallis test I Test the difference in ranks of scores of 3+ independent groups N O Friedman test R Test the difference in ranks of scores of 3+ related groups N O Chi square test I Test the difference in proportions in 2+ independent groups N N McNemar test R Test the difference in proportions for 2 related groups (2x2) N N Cochran’s Q test R Test the difference in proportions for 3+ related groups N N Fisher’s test I Test the difference in proportions in 2 independent groups when N < 30, any expected cell frequency < 5, or cell with observed frequency of 0 N N Phi coefficient or odds ratio I Examine the magnitude of a relationship between 2 dichotomous variables N N Cramer’s V I Examine the magnitude of a relationship between 2 variables (not restricted to dichotomous) N N Spearman’s rho I, R Test the existence of relationship between 2 variables O O IV, Independent variable; DV, dependent variable; I, independent; R, related; N, nominal; O, ordinal or non-normally distributed interval/ratio; I/R, interval/ratio. Note: On some tests, the measurement level of the IV & DV can be switched. Multivariate/Multivariable & Advanced Statistical Tests