bluuebunny/crossref_metadata_2025 huggingface dataset:
Linguistic preference outcompetes alignment as a predictor for assessing others’ cooperativeness
Authors: Matzinger Theresa , Placiński Marek , Lewandowski Mariusz , Gutowski Adam , Zywiczynski Przemyslaw , Wacewicz Sławomir
Published: April 2023

An important quality to assess in others is their cooperativeness. Since linguistic communication requires a high degree of cooperation between interaction partners, we hypothesized that people use linguistic markers in their partners’ speech as a proxy of their cooperativeness in other tasks. Specifically, we predicted that participants would prefer syntactically similar conversation partners as cooperation partners in a monetary game. We found that, indeed, participants preferably selected syntactically similar conversation partners as cooperation partners, but only when the participants could communicate using their naturally preferred constructions. In contrast, when participants were forced to communicate using dispreferred constructions, they rather cooperated with those partners that matched their natural preference than with those that matched their overt linguistic use. This suggests that general linguistic alignedness, which is a potential indicator of group membership and may be associated with in-group cooperation benefits such as reputation, reciprocity and normative behavior, is a more important predictor of cooperation partner choice than dynamic alignment, which can be regarded as a first cognitive investment in the cooperation or a signal of out-groups showing the willingness to adapt. This has important implications for communication in intercultural settings where members of diverse linguistic groups negotiate cooperative actions.
Thinking Creatively Makes You Happier. Using Latent Semantic Distance To Investigate Happiness
Authors: Du Mark
Published: April 2023

The concept of semantic distance refers to the degree of relatedness between two or more concepts or ideas. Recent research suggests that individuals who write words with greater semantic distance can be happier (Axelrod, V., Rees, G., Lavidor, M., & Bar, M. 2015). The concept of longer semantic distance canindicate that the author is writing more creatively (Gray, K., Anderson, S., Chen, E. E., Kelly, J. M., Christian, M. S., Patrick, J., ... & Lewis, K. 2019). In this study we use Chat GPT-3.5 to calculate the semantic distance for us, collecting datas from internet forum that discussing emotions. The result shows that happy articles do have more semantic distances.
Utility of D-dimer and other biomarkers in COVID-19 patients - A prospective study in a tertiary care center
Authors: A Indira Priyadarshini , K Jayalaxmi Yadav , SH Shridevi , C Bharat
Published: April 2023

Background: Clinical status and concurrent comorbidities of COVID-19 patients largely determine the need for their admittance to ICUs, similarly, several laboratory parameters like D-dimer, LDH, serum ferritin, CRP, and IL-6 may facilitate the assessment of disease severity and rational triaging. Therefore, their role in the management of COVID-19 patients has to be assessed.
Materials and methods: Prospective study was done on patients who were tested positive for COVID-19 infection and admitted to various centers under the Vijayanagara Institute of Medical Sciences, India. Patients were divided into mild, moderate, and severe cases. Demographic data and serum levels of biomarkers like D-dimer, LDH, ferritin, CRP, and IL-6 were collected in these patients, and data were statistically analyzed.
Results: A total of 164 cases were included in this study, of which, 62 were mild, 47 moderate, and 55 were severely infected COVID-19 patients. There was male predominance in patients infected with COVID-19. The median age of presentation was 53, 60, and 57 years in mild, moderate, and severe cases respectively.  Median was also derived for D-dimer, LDH, serum ferritin, CRP, and IL-6 in mild, moderate, and severe cases. Changes in D-dimer, LDH, and serum ferritin levels in mild, moderate, and severe cases showed statistical significance(p<0.05).
Conclusions: D-dimer helps in the early identification of mild, moderate, and severe cases and can be used for the vigilant monitoring of patients. LDH and serum ferritin helps in the identification of oxygen-dependent and oxygen-independent patients. The role of CRP and IL-6 in the management of COVID-19 patients has to be further investigated.
Increment in hemoglobin and hematocrit levels after blood transfusion in a tertiary care hospital
Authors: Shah Prakriti , Shrestha Manisha , Rajbhandari Aasiya , Khadgi Rohit , Chand Prayash
Published: April 2023

Background: Blood transfusion is considered to be the first line of therapy for all types of anemia. One unit of blood transfusion is known to increase the hemoglobin level by 1g/dl and hematocrit by 3%. This study aims to analyze the mean increment in hemoglobin and hematocrit levels after 1-unit of blood transfusion in a tertiary care hospital.
Materials and Methods: A retrospective study was done. 133 patients with 1-unit of blood transfusion (whole blood or packed red blood cells)having pre and post-transfusion hemoglobin and hematocrit values were enrolled in the study.
Results: Patients of all diagnoses, who received blood transfusion were enrolled, with the highest proportion (27.1%) in the age group 18-35 years. Male predominance was seen (57.1%) and a majority of the patients were on hemodialysis (57.9%). The most common blood group was B positive (30%) and 90.9% were Rh positive. 48 patients were transfused with whole blood and 85 were transfused with packed red blood cells. The mean increment in hemoglobin and hematocrit levels were 0.75 ± 2.21 and 2.47 ± 6.84 respectively. A significant increment in post-transfusion parameters was seen compared with pre-transfusion parameters (p <0.001).
Conclusions: A mean increment in hemoglobin and hematocrit level was seen in patients after transfusion. However, the value of the increment is low in our study as compared to the literature. This may be due to varied reasons, ranging from a history of chronic disease, acute bleeding, the volume of other fluids administered, and the characteristics of the donor.
Performance Analysis of Students in Nawalparasi Based on SEE Results in 2078 BS
Authors: Adhikari Basanta Pd , Kafle Sarad Chandra
Published: April 2023

The primary objective of this study was to examine students' gender-wise performance in different subjects of SEE results, the average grade point of each subject, and the total grade points of all subjects in the SEE exam in 2078 in Nawalparasi district. The data for this study was obtained from the 2078 BS SEE exam results using secondary data collection methods. The data analysis technique of this study was descriptive statistics where correlation analysis, arithmetic mean, Mann-Whitney U test and Chi-square test of independence were used for data analysis. The study included the exam results of 13139 students from both private and public schools in Nawalpur district. There were 6654 male students (50.6%) and 6485 female students (49.4%) in the sample. The results indicated that the majority of the SEE participants students (97.9%) were between 13 to 21, and 34.7% were 16 years which is the maximum observed percentage of students. In 2078 BS, only 1.1% of students over the age of 21 participated in the SEE exam, according to the results.

The results importantly show a significant association between the gender of students in Grade Point Average (GPA) of the SEE results in 2078 BS. The majority of the students had poor results in the SEE-2078 exam, as 56.3% of students secured less than 2.39 GPA, whereas no one obtained 4 GPA out of 4. Finally, the results indicate that the total grade point (TGP) of girls (2.53) is higher than boys in compulsory Nepali compared to male (2.59) students in the SEE results of 2078 BS in Nawalparasi district. The implication of this study would be beneficial to the Education Department of Secondary Education Examination (SEE), educators, researchers, policymakers, and parents to improve the overall GPA in SEE results.
The Impact of Dimensions of E-learning on the Successful Implementation and Development of Digital Pedagogy in Nepalese Higher-level Educational Institutions
Authors: Adhikari Basanta Pd
Published: April 2023

The dimensions of E-learning are technology, governance, awareness of E-learning, attitude toward e-learning, and e-content development, which are supported by seventeen subfactors of the vital measurements of E-learning pedagogy. The primary objective of this study was to examine the impact of the dimensions of E-learning on the successful implementation and development factors of digital pedagogy in higher education in Nepal. The quantitative research method and the survey study were applied to collect this study's data. The results indicate a significant association between social media for E-learning, the benefits of E-learning, using E-learning applications and technology, and the effective tools for teaching and the impact of E-learning dimensions for the successful implementation and development factors of digital pedagogy (p < 0.05).

But the results indicate no association between the E-content and open educational resources, the effectiveness and challenges of E-Learning, E-contents and open educational resources, and the benefits of E-learning for students, E-learning practice, roles of E-learning in capacity building, effective E-learning methods, E-learning methodologies and good practices, sources of E-learning, and optimization of learner efficiency and productivity, and the impact of the dimensions of E-learning for the successful implementation and development of digital pedagogy ( p > 0.05). The implication of this study would be beneficial to policymakers, researchers, academicians, educators, and college leaders in such a way to provide first-hand information about the areas to be focused on for successful implementation and development factors on E-learning pedagogy in the Nepalese higher education sector.
Impact of Shear Wall Location on the Response of RC Framed Building
Authors: Shrestha Ashish , Kandel Bikal , Shrestha Mandip , Adhikari Basanta , Poudel Ashish
Published: April 2023

The objective of this study was to understand the impact of storey walls on the Response of RC Framed Building. The shear wall provides huge stiffness against lateral load, making the structure less vulnerable during the Earthquake. The location of the shear wall plays a vital load defending seismic force on the building. The research method was experimental research. In this paper, the most favorable position of the shear wall was determined by creating different alternates ALT-1, ALT-2, ALT-3 and ALT-4. The results of storey drift, lateral sway and base share were computed with the base model. Finite element software ETABS was used for the linear dynamic analysis and design of 11 storey building. The results show that Lateral sway and storey drift declined with the introduction of a shear wall with a central location exhibiting the most desirable result. The implication of this study would be beneficial to the Engineering Department of OCEM, students, researchers, and scholars to know the impact of Shear Wall Location on the Response of RC Framed Buildings.
A Review of an Article Based on the Mixed Methods Approach in Educational Sciences Regarding Teacher Retention Intention in the Asian Context
Authors: Adhikari Basanta Pd , Adhikari Ramesh
Published: April 2023

The primary objective of this study was to evaluate the different models of the mixed methods approach along with research problems, questions, and data analysis techniques and to review its overall methodology applied to collect data in a selected educational article. A mixed methods approach is a newly emerged research design of this 21st century where both quantitative and qualitative data can be collected one at a time. This study was based on the review of different articles, books, cases, magazines, and newspapers connecting with the mixed methods approach. The key focus of this study was to introduce the mixed methods approach, quantitative and qualitative approaches, evaluate the theoretical strengths and weaknesses of the mixed methods approach, and explicit meaning of both qualitative and quantitative design and its applications in the different fields of research studies.

The results indicate that the study has covered different aspects of the mixed methods approach along with the theoretical weaknesses of the mixed methods approach. The results have also focused on both quantitative and qualitative research approaches along with the mixed methods approach and different designs of the mixed methods approach. The results further indicate that the core designs of the mixed methods approach are contemporary development and expansion designs, the validity and reliability of the mixed methods approach, the generalization of research outcomes, and statistical generalization. It was indicated that the key findings and discussions were also focused on while reviewing different journals and online documents. The results suggest that factors affecting teacher retention and attrition intention were based on the high workload and unsupportive colleagues and administration, which are similar within China, Nepal, India, and Sri Lanka. The results show that approximately 42% of the teachers reported being highly stressed in China; the same scenario has also occurred in the Nepalese context. The implications of this study would be beneficial to young researchers, students, college teachers and master-level students to foreground the knowledge in the mixed methods approach.
Will Evaluation Prosper in the Future?
Authors: McDavid James C. , Huse Irene
Published: April 2023

Abstract: The main thesis of this article is that program evaluation and program evaluators have largely missed out on the movement, now into its second decade, to make performance measurement the centrepiece of public sector management and accountability. If these developments are not strategically faced by evaluators, program evaluation runs the risk of becoming less and less relevant to public sector and nonprofit organizations. Evaluators, divided by epistemological and methodological differences, have collectively not been willing to embrace professionalization as a way to reclaim territory lost to the audit and management consulting professions. It is essential that evaluators develop and implement strategies that are intended to create a professional practice space that includes designing and implementing performance measurement systems. Evaluators are well-positioned to do so, if they act collectively.
Informing Evaluation Capacity Building Through Profiling Organizational Capacity for Evaluation: An Empirical Examination of four Canadian Federal Government Organizations
Authors: Bourgeois Isabelle , Cousins J. Bradley
Published: April 2023

Abstract: According to the literature published on the topic, the development of an organization’s capacity to do and use evaluation typically follows four stages: traditional evaluation, characterized by externally mandated evaluation activities; awareness and experimentation, during which organizational members learn about evaluation and its benefits by participating in a number of evaluation-related activities; evaluation implementation, the stage at which the role of evaluation is more clearly defined in the organization; and evaluation adoption, which occurs when evaluative inquiry becomes a regular and ongoing activity within the organization through the allocation of continued financial and human resources. In this article we argue that this perspective is oversimplified and that it is essential to understand the complexity of an organization’s evaluation capacity in order to better understand how it might proceed with evaluation capacity building (ECB). We present an analysis of four Canadian federal government organizations’ self-assessment of their organizational evaluation capacity using a profile conceptual framework developed as part of our larger study. We then integrate the resulting multidimensional profiles of observed levels of organizational evaluation capacity with the aforementioned stages of ECB to provide added value in thinking about the direction of organizational ECB.
Monitoring Tobacco Control Outcomes: The Unintended Consequences of Target Selection
Authors: O’Connor Shawn , Philipneri Anne
Published: April 2023

Abstract: We explore key lessons arising out of target-setting agendas in tobacco control. Two real-world examples are described that illustrate the pitfalls of choosing an omnibus target for a comprehensive strategy: (a) a target to reduce wholesale cigarette sales in Ontario and (b) a First Ministers’ target to reduce current smoking. Changing contexts brought about by shifts in illicit tobacco sales made it problematic to interpret success in both cases. The discussion draws attention to key considerations in setting targets, including unintended consequences, data quality, ideal number, and the importance of context such as stakeholder roles in target selection and reporting.
Chronique d’une évaluation ratée
Authors: Paillard Denis
Published: April 2023

Abstract: The evaluation presented in this article combines a number of the problems outlined in a textbook example: confusion between “control” and “evaluation,” insufficient resources, overly ambitious goals, and tension between stakeholders, a situation that led to disregard for all the principles enumerated in the French evaluation society charter: pluralism, distance, competency, respect for individuals, transparency, responsibility, and opportunity. The lessons learned described in this article highlight the need to follow those principles, both on the part of the agency commissioning the evaluation and the evaluator, the importance of ethical issues, and the fragile balance that allows evaluations to be implemented. Finally, the author questions the usefulness of recourse to arbitration proceedings.
L’évaluation des interventions complexes : quelle peut être la contribution des approches configurationnelles?
Authors: Touati Nassera , Suárez-Herrera Jose Carlos
Published: April 2023

Abstract: This article shows the added value brought by configurational approaches in the field of evaluation of complex interventions. First, we analyze the work in the scientific literature that has addressed this issue to identify epistemological considerations. The first part shows our finding that the evaluation of complex interventions needs to go further in terms of theorization. We then explain how productive the configurational approach is in the theorization of evaluation. Third, we discuss methodological issues and the operationalization of this approach.
M&E Competencies in Support of the AIDS Response: A Sector-Specific Example
Authors: Fletcher Gillian , Peersman Greet , Bertrand William , Rugg Deborah
Published: April 2023

Abstract: The Joint United Nations Programme on HIV/AIDS (UNAIDS) led a consultative process to develop a self-assessment tool for HIV monitoring and evaluation (M&E) leadership competencies. The tool seemed fit-for-purpose in M&E staff recruitment and professional development. The willingness to use the self-assessment was related to the pragmatic and reality-based nature of the tool. A competency-based approach to M&E training was well accepted by professionals working at national and service-delivery levels. However, there is a need to update the HIV M&E competencies to adapt to specific M&E challenges in the broader context of aid effectiveness and to reflect a maturing evaluation profession.
A Good Start, but We Can Do Better
Authors: Rowe Andy
Published: April 2023

Abstract: This special issue of the Canadian Journal of Program Evaluation provides a valuable overview of competencies and introduces some of the evaluation competency efforts around the globe. Competency efforts and this issue are unquestionably good things. This brief comment reflects on how future efforts could be improved by articulating the program logic and mechanisms of how the use of credentials will contribute to improved evaluation, thus ensuring that national variation in evaluation is integrated into competencies, that the reach of competencies is expanded to anticipate emerging opportunities and needs, and that important traits and characteristics beyond what can be gained from training and experience are included in competencies.
‘Qualitative’ Evaluation as Symbolic Policy Making: Evaluating Work Training Programs for Quebec Welfare Recipients
Authors: Cabatoff Kenneth
Published: April 2023

Abstract: “Qualitative” program evaluation usually insists on the need for “impartial” representation of stakeholder views, whereas “symbolic policy making” favors program evaluation conclusions that support existing programs. These contradictory pressures can lead to evaluations that favor some stakeholder views at the expense of others. An example of a qualitative evaluation where this occurred is the Quebec government program Mésures de relance, aimed at helping welfare recipients re-enter the labour force. Several stakeholder groups were involved in the program, but only one group—program participants—was thoroughly consulted. It can be argued that employers, whose cooperation in providing work assignments was vital to the program’s success, could have provided useful input into the evaluation. However, their inclusion might have impaired the evaluation’s ability to arrive at the desired symbolic conclusions: that if certain improvements were made the program could be successful. This example suggests that qualitative evaluation is only useful to the extent that it actually does provide impartial representation of stakeholder groups, and especially of those that are important to the success of the program. The article is followed by a brief critique by Dale H. Poel, who argues that evaluators, rather than the qualitative method itself, are the source of political bias. The author appends a brief rejoinder.
Individual Choice and Sources of Error: Idiographic Evaluation of Psychosocial Rehabilitation
Authors: Dalrymple Andrew J.
Published: April 2023

Abstract: This article briefly examines experimental approaches and sources of error in the evaluation of psychiatric or psychosocial rehabilitation programs: pre-post quasi-experimental designs, the selection of groups that are extreme on criterion measures, the problem of self-selection and differential attrition, the absence of no-treatment controls and nonblind assessment, and individual variation in response to poorly defined treatments. These factors become more problematic in evaluating ecologically based treatment that involves measuring individual progress to self-identified goals in individually selected environments. The psychosocial rehabilitation focus on individuals functioning in their natural environments has not yet met with an equally ecologically valid research methodology. This article describes an idiographic evaluation approach that characterizes individual responses to treatment and that combines small group methodology using the group as its own control to provide a practically attainable assessment of treatment effectiveness in applied rehabilitation settings.
Program Design Can Make Outcome Evaluation Impossible: A Review of Four Studies of Community Economic Development Programs
Authors: Watson Kenneth
Published: April 2023

Abstract: Between 1981 and 1990 Employment and Immigration Canada evaluated three community economic development programs: the Community Employment Strategy, the Local Employment Assistance and Development, and the Community Futures program. In retrospect, one can see that these evaluations were hindered by two problems of program design: there was no replicable treatment, and the broad, shallow interventions were unlikely to have measurable effects in an environment “noisy” with uncontrolled factors. This article reviews the evaluation studies of these three programs, the lessons learned from each study, how subsequent programs reflected those lessons, and how the methodological limitations of the studies constrained what was learned.
Prevalent Department of Social Services’ Client Satisfaction: A Research and Practice Note
Authors: Gorey Kevin M. , Chandler Robert G. , Osmun David
Published: April 2023

Abstract: This successive cross-sectional or panel study evaluated the City of Windsor’s Department of Social Services, specifically, the Special Services and Children’s Services Branches from 1990 to 1994. Their programs were assessed with quantitative (consumer satisfaction questionnaire, CSQ-8, score range = 8 to 32 [Larsen, Attkisson, Hargreaves, & Nguyen, 1979]) and qualitative (e.g., open-coded queries about what they liked most and least about the social services they received) measures of client satisfaction.
Ensuring Quality for Evaluation: Lessons from Auditors
Authors: Mayne John
Published: April 2023

Abstract: This article addresses ways to enhance the quality of evaluations with weak designs through a variety of quality assurance practices. Many types of evaluations are restricted in the types of designs they can use. Evaluations of development programs with widely dispersed projects in different countries are often a case in point, where the design uses visits to a number of dispersed sites, interviews with staff and stakeholders, and reviews of documentation to draw conclusions. These interview-based evaluations are quite similar in methodological approach to many performance audits. National audit offices devote considerable resources to their quality assurance practices, and, for the most part, the quality of their performance audits is not questioned. It is argued that evaluations, and not only interview-based ones, could usefully adopt many of the quality assurance practices used by national audit offices to ensure the quality of their products.
The Sustainable Economic Product: A Way to Measure and Compare National Sustainable Development
Authors: McCormack Lee
Published: April 2023

Abstract: Recently, evaluators and policy makers have turned their attention to societal indicators. In Canada the federal government’s annual report, Canada’s Performance, measures societal outcomes in the environment, the economy, and other areas. Other jurisdictions produce similar reports, and many international bodies collect supporting data. One area of continued attention is the measurement of sustainable development — the integration of economic, social, and environmental factors. Although considerable international effort has been paid to the measurement of sustainable development, little consensus has emerged. This article advances a new approach to the measurement of sustainable development and calls for an informed debate.
Audit and Evaluation in Public Management: Challenges, Reforms, and Different Roles
Authors: Mayne John
Published: April 2023

Abstract: Audit and evaluation play important roles in public management. There can be confusion and debate, however, over what each of these functions cover and indeed what roles they should play. This article reviews and compares each in relation to public management and the key challenges each face in today’s public sector. Audit and evaluation should play different roles in public management and provide different information on the performance of public sector organizations, each playing to its own strengths.
Making Cost-Benefit Analysis a Practical Tool for Evaluation
Authors: Watson Kenneth
Published: April 2023

Abstract: A cost-benefit evaluation requires precise data on program outcomes. However, such data are unavailable when the analysis is prospective, and expensive and time-consuming to collect when the analysis is retrospective. This problem of uncertain data is partly solved by the revised version of the Treasury Board Benefit-Cost Analysis Guide (Watson & Mallory, 1997), which allows probabilistic estimates of program results to be used in the analysis. There are not yet many examples of this technique in practice. One is Transport Canada’s evaluation of alternative requirements for small commercial vessels to carry emergency signaling equipment. This article describes that evaluation and assesses how well the methodology worked.
Discours qui résistent à l’objectivation : que peut-on en tirer pour l’évaluation?
Authors: Brousselle Astrid
Published: April 2023

Abstract: When using interviews as a data-collection method, the evaluator must pay attention to the distortions that may be created. Evaluation is a political exercise and, in a political context, may favour the emergence of statements that represent resistance to objectifying their meaning. Based on the interviews conducted during the evaluation of the implementation of the UNAIDS Drug Access Initiative in Chile, the article illustrates different tactics participants use that may win the evaluator’s sympathy or block access to information, and it presents a method of analysis the evaluator can use to give meaning to such statements.
Comparaison de trois stratégies de travail en réseau afin de favoriser l’application des connaissances issues de la recherche
Authors: Daigle Marc , Chagnon François , Saint-Laurent Danielle , Houle Janie
Published: April 2023

Abstract: In research as in practice, establishing strong teams is a recognized necessity and teams are increasingly large and dispersed. In the field of health care, the need for pluridisciplinarity is a further constraint in the organization of such teams or at least communication within them. Despite these difficulties, networking has emerged among groups of practitioners who share common objectives and try to fulfill their mission more effectively by developing, sharing, and applying knowledge targeted based on their fields of interest. This article is a critical analysis of three different networking experiences that all shared the common objective of application of knowledge through networking among practitioners: the suicide prevention practice community (CoP) of the Centre for Research and Intervention on Suicide and Euthanasia (CRISE), the task force on suicide in prisons of the International Association for Suicide Prevention (IASP), and the international Francophone network for safety promotion and trauma prevention.
L’évaluation des programmes de développement en Afghanistan. étude de cas : une évaluation participative du Programme de Solidarité Nationale
Authors: Piou Elsa
Published: April 2023

Abstract: This case study focuses on the evaluation and monitoring process implemented for a development program in Afghanistan, the National Solidarity Program (NSP), and a pilot methodology for participative evaluation at the local level. Given the weaknesses of the current evaluation system, which can produce contradictory results, the proposed participative evaluation methodology is based on gift-giving and exchange anthropology theory and attempts to study program impacts through experience and analysis shared by the partners. This methodology raises many operational issues and issues involving the link between evaluation and program processes. The tool presented may be considered a lever for social change through the evolution in perception among various participants.
Development of a Classification System for Patients Referred to a Rehabilitation Program for Visual Impairment: A Method for Analysis and Budgetary Control
Authors: Coulmont Michel , Roy Chantale , Fougeyrollas Patrick
Published: April 2023

Abstract: Program evaluation makes assessments from various perspectives. In health care areas, evaluation generally focuses on the relationship between the care process and the clinical results. Our study is of particular interest because it adds a cost dimension to that relationship, thus introducing a method for evaluating visual impairment rehabilitation programs that integrates full operating costs. Starting from the functional level of patients on admission to a clinical program, an experimental approach was used to divide them into five homogeneous groups according to their consumption of financial resources during the care process. This method could be used in measuring and evaluating the financial performance of all rehabilitation programs and help improve budgetary control. With the added dimension of costs per client profile, it could provide a framework for other areas requiring program evaluations.
L’évaluateur éthiquement engagé: sur le sens et la pertinence d’un nouveau référentiel
Authors: Peter Émilie
Published: April 2023

Abstract: The concept of an evaluator’s “commitment,” also referred to as “advocacy” in the English literature and “plaidoyer” in the French literature, remains a subject of debate within the evaluation community. As evaluators, should we ban all forms of personal commitment to preserve the “neutrality” of our evaluations? Instead, should we commit ourselves to increasing the quality of evaluations, or to promoting certain values? What forms of commitment should then be recommended? Through a literature review, we attempt to clarify the different understandings underlying the use of this concept, and we examine how recent epistemological and moral changes in the field of evaluation have greatly amplified its meaning and its implications for the practice. We suggest that an “ethical commitment” may have a methodological and/or moral purpose, and that, ethical or not, the evaluator’s commitment is inevitably present throughout the evaluation process.
Capturing the Complexity of Evaluations of Health Promotion Interventions: A Scoping Review
Authors: Kania Ania , Patel Alka B. , Roy Amrita , Yelland Gregory S. , Nguyen Duyen Thi Kim , Verhoef Marja J.
Published: April 2023

Abstract: Evaluation designs that can capture the complexity of health promotion (HP) interventions are needed. Our objective was to assess if such evaluations use a Complex Adaptive Systems (CAS) perspective, by using a scoping review of evaluations of HP interventions concerning alcohol and tobacco use in the peer-reviewed (PR) and grey literature (GL). We developed indicator questions to assess CAS aspects. Our study revealed that none of the 45 PR and 9 GL evaluations that we reviewed explicitly used a CAS perspective; however, most indirectly assessed complexity aspects. Our indicator questions are a step toward addressing the challenges of the practical application of a CAS perspective.
The Usefulness of a Standardized Form for the Process Analysis Stage: A Case Study
Authors: Ferris Lorraine E. , Rosenstein Susan
Published: April 2023

Abstract: Process analysis is useful in determining how, why, and under what conditions a program succeeds or fails in creating certain outcomes. Process analysis is conceptually appealing because the results can be used for program replication, improvement and pruning. As well, process analysis aids in the identification of confounding variables operating in a program that may effect outcomes. Unfortunately, amajor practice obstacle in conducting process analysis is determining measures and methods for collecting process data. This article describes the Standardized Tracking Form (STF) used to record information useful for process analysis. A case study of how the STF is used by a health unit is presented and discussed.
Estimating the Percentage of Workforce Health Programs in Ontario from Results of a Mail Survey at Different Follow-Up Stages
Authors: Macdonald Scott , Dooley Steve
Published: April 2023

Abstract: Selection bias due to nonrespondents is a common concern in mail surveys. The authors developed a procedure to estimate characteristics of nonrespondents based on when subjects respond, using data from a survey of personnel managers from large Ontario companies. The study was designed to assess the nature and extent of employee assistance programs (EAPs) and health promotion initiatives. Results indicated that personnel managers who responded quickly were significantly more likely to have an EAP than those who responded later. Estimates of the proportion of nonrespondents with EAPs were made by extrapolation, based on when people responded. The estimated proportion of nonresponders with EAPs was nearly identical to the actual proportion as determined by follow-up telephone interviews. Analyses also showed that companies with EAPs were significantly more likely to have health promotion programs. Extrapolation procedures were therefore used to estimate the proportion of companies with these other health promotion initiatives.
Why All This Evaluation? Theoretical Notes and Empirical Observations on the Functions and Growth of Evaluation, with Denmark as an Illustrative Case
Authors: Albæk Erik
Published: April 2023

Abstract: This article demonstrates that theoretical debates and developments in the area of organizational analysis can be a fruitful source of inspiration for evaluation utilization research. The article considers two sets of questions. One concerns the societal function of evaluation, the other its historical development. Three sets of well-established lenses, ground by competing views of organizations and organizational behavior, are used to address these concerns. The theories in question see organizations as rational systems, political systems, or cultural systems. The utilization of policy evaluation in Danish political-administrative practice is used as an illustrative empirical case. The article further demonstrates that inspiration from organizational analysis will bring us no closer to a unified understanding of what evaluation utilization is. On the contrary, it shows that debates on and controversies over evaluation utilization belong to the order of things, and that this order entails multiple realities depending on one’s theoretical point of departure.
Service User Input: Fact or Fiction? The Evaluation of the Trauma Program, Department of Rehabilitation, Sault Ste. Marie, Ontario
Authors: Holosko Michael J.
Published: April 2023

Abstract: This study explores the current trend of incorporating service user data into program evaluations. Using a case study approach and citing three years of evaluation data of the Trauma Program at Sault Ste. Marie General Hospital, northern Ontario, the author challenges the traditional assumptions that promote service user data in program evaluations. The main conclusion is that although service user data is touted as being important, its political importance far outweighs its evaluation value and utility, in particular with hard-to-access samples. Implications are directed toward evaluators, administrators, and policy makers.
Community Health Centers: Evaluation Issues and Approaches
Authors: Johnston Corrine W.
Published: April 2023

Abstract: Community health centers present a challenge for evaluators because of their multiple and overlapping programs, variable client base, culturally diverse clientele, and nontraditional approach to health and wellness. This article provides an overview of the evaluation strategy adopted by a rural southwestern Ontario community health center to overcome these challenges. The purpose of the evaluation was to obtain a broad picture of the center’s internal dynamics, processes, and efficacy following its first two years of operation.
Using a Logic Model to Focus Health Services on Population Health Goals
Authors: McEwan Kimberley L. , Bigelow Douglas A.
Published: April 2023

Abstract: This article describes an application of program logic models to help regional health authorities focus attention and efforts on health outcome goals in British Columbia. The article emphasizes the value of graphic modeling techniques such as logic models in identifying the presumed contribution to regional health status of health services and other health determinants. It argues that logic models facilitate overall governance of health care services by creating performance-monitoring frameworks for both short-term and long-term outcome objectives.
Evaluability Assessment of a Survivors of Torture Program: Lessons Learned
Authors: Thurston Wilfreda E. , Ramaliu Anila
Published: April 2023

Abstract: An evaluability assessment (EA) framework was used to assess a survivors of torture program for which one of the authors had been coordinator. Staff and other stakeholders were interviewed and documents reviewed. Program logic models were developed and discussed. The results of the EA and the process are discussed in terms of the barriers to EA identified by Smith (2005). The article suggests that an EA can be done with limited resources and still be valuable in developing real knowledge of the program, ownership, management for success, and pathways to accountability.
Evaluator Competencies and Performance Development
Authors: McGuire Martha , Zorzi Rochelle
Published: April 2023

Abstract: Supporting professional development in evaluators can be challenging because evaluators come from varied backgrounds and conduct many different types of evaluations. Evaluation competencies are a means of determining the developmental needs of individual evaluators, and can be used as the foundation for a comprehensive performance development system within organizations that do evaluations. This article defines professional development in the context of strategic human resource development and outlines the elements of a human resource development system, showing how evaluation competencies can be used as a basis for the system. The article gives an example of the system’s application, provides samples of tools that can be used for self-reflection and assessment, and outlines the benefits of a human resource development system.
Understanding Cultural Competence Through the Evaluation of “Breaking the Silence: A Project to Generate Critical Knowledge About Family Violence within Immigrant Communities”
Authors: Anderson-Draper Michelle H.
Published: April 2023

Abstract: This article examines the topical concept of cultural competence for evaluators by presenting reflections on the evaluation of “Breaking the silence: A project to generate critical knowledge about family violence within immigrant communities” as a case example. Experiences of the internal evaluator in relation to cultural competency are explored and implications for practice are presented. Including sufficient time to build relationships, facilitating a learning process, and developing evaluator competencies are among the salient themes presented.
Using Community-Based Participatory Research for an Online Dementia Care Program
Authors: MacDonald Colla J. , Stodel Emma J. , Casimiro Lynn , Weaver Lynda
Published: April 2023

Abstract: In this article we describe our experiences using a Community-Based Participatory Research orientation (CBPR; Minkler & Wallerstein, 2003) with a group of community professionals in healthcare institutions. The purpose of the project was to design, develop, deliver, and evaluate an online dementia care program for registered and non-registered healthcare workers in long-term care homes who work with residents with dementia. The Demand-Driven Learning Model (DDLM; MacDonald, Stodel, Farres, Breithaupt, & Gabriel, 2001) was used to guide this process. The CBPR approach allowed multiple views, attitudes, and experiences to strengthen the content, delivery, and evaluation of the program. By addressing some of the issues involved in the process, we hope that our experiences documented in this article will help others develop research partnerships with community professionals, as well as plan, implement, and evaluate collaborative online healthcare training programs.
Developing a Special Education Accountability Framework Using Program Evaluation
Authors: Ali A. Sidiq , Favaro Paul
Published: April 2023

Abstract: Accountability has been at the forefront of standards-based educational reform. Yet, as new-age accountability is upon us, driven in the vehicle of large-scale assessment by policy decisions, research indicates that within these accountability systems are organizational and technical barriers to educational improvement. What is presented in this article is a local-level accountability framework focused on special education programs in the context of a large, predominantly urban school district in Southern Ontario. Involving principles of participatory program evaluation, this framework looks at building organizational capacity for bureaucratic and professional accountability in efforts to overcome barriers to educational improvement through accountability.
Building an Evaluative Culture: The Key to Effective Evaluation and Results Management
Authors: Mayne John
Published: April 2023

Abstract: As many reviews of results-based performance systems have noted, a weak evaluative culture in an organization undermines attempts at building an effective evaluation and/or results management regime. This article sets out what constitutes a strong evaluative culture where information on performance results is deliberately sought in order to learn how to better manage and deliver programs and services. Such an organization values empirical evidence on the results it is seeking to achieve. The article outlines and discusses practical actions that an organization can take to build and support an evaluative culture.
An Illustration of a Methodology to Maximize Mail Survey Response Rates in a Provincial School-Based Physical Activity Needs Assessment
Authors: Dwyer John J. M. , Allison Kenneth R. , Lysy Daria C. , LeMoine Karen N. , Adlaf Edward M. , Faulkner Guy E. J. , Goodman Jack
Published: April 2023

Abstract: Two mail surveys were conducted as a province-wide needs assessment to examine the opportunities for, barriers to, and participation in physical activity in Ontario elementary and secondary schools. Dillman’s Tailored Design Method (TDM) was used to maximize the quality of responses and the response rate. Both surveys entailed five mailings to key informants from randomly selected schools. The response rate among the 599 elementary and 600 secondary schools was 85% and 79%, respectively. This article discusses how the TDM strategies (i.e., strategies to establish trust, increase perceived rewards, and decrease perceived costs among key informants) were used to yield high response rates, examines the response rates after each mailing, and shares some lessons learned, which will be useful to researchers who are considering using the TDM in surveys designed to develop and evaluate programs.
Current Evaluation Practices Involving Resource Allocation Processes in Canadian Healthcare Organizations: A Survey of Senior Managers
Authors: Smith Neale , Mitton Craig , Donaldson Cam , Bryan Stirling , Peacock Stuart
Published: April 2023

Abstract: Resource allocation is a key function of senior leadership teams within healthcare organizations. Academic support of this function has traditionally focused on constructing tools to make decisions more formalized, and much less attention has been paid to understanding resource allocation as a management process. In particular, evaluation has been a missing aspect. The authors conducted a pan-Canadian survey of senior managers within the healthcare system. This survey included questions related to formal evaluation of their resource allocation processes and outcomes. We use these data to shed some light upon the state of priority-setting practice in Canada at the present time.
Assessing the Value for Money of Active Labour Market Programming for Persons with Disabilities
Authors: Mason Greg , Buchel Andrew , Haddad Tony , UnRuh Dwane
Published: April 2023

Abstract: Treasury Board of Canada’s new policy on evaluation and its accompanying directive have placed increased pressure on those conducting federal evaluations to not only quantify the impacts of programming but also make measurable assessments of their value. However, making accurate statements about the value for money of programming can be difficult during evaluations. A number of technical and practical challenges can make common approaches infeasible. This article discusses a recent assessment of the value for money undertaken during the evaluation of the Canada-Manitoba Labour Market Agreement for Persons with Disabilities. It demonstrates a number of approaches that can be used to overcome some of the most common barriers to the assessment of value for money in evaluations.