bluuebunny/crossref_metadata_2025 huggingface dataset:
Using Impact Evaluation Tools to Unpack the Black Box and Learn What Works
Authors: Peck Laura R
Published: April 2023

Researchers and policy makers are increasingly dissatisfied with the “average treatment effect.” Not only are they interested in learning about the overall causal effects of policy interventions, but they want to know what specifically it is about the intervention that is responsible for any observed effects. This discusses Peck's (2003) approach to creating symmetrically-predicted subgroups for analyzing endogenous features of experimentally evaluated interventions and then it identifies several possible extensions that might help evaluators better understand complex interventions. It aims to enrich evaluation methodologists’ toolbox, to improve our ability to analyze “what works” in addressing important questions for policy and program practice.
Who Needs Goals? A Case Study of a Goal-Free Evaluation
Authors: Youker Brandon W. , Zielinski Alayna , Hunter Ouen , Bayer Nicholas
Published: April 2023

Background: Goal-free evaluation (GFE) is any evaluation in which the evaluator conducts the evaluation without knowledge of or reference to predetermined goals and objectives whereas the goal-based evaluator determines merit according to the evaluand’s goal achievement. Purpose: To examine a GFE in actual practice focusing on its operationalization as well as paying particular attention to the evaluation users’ perspective of its utility. Setting: The evaluand was a day long training of summer camp counselors on occupational therapy (OT) related skills such as feeding, dressing, and bathing.  Intervention: GFE was the intervention however for comparison purposes an independent and simultaneous goal-based evaluation (GBE) also evaluated the evaluand. Research Design: Case study. Data Collection and Analysis: After the evaluation users read both the GBE and GFE reports, data collection consisted of a semantic differential questionnaires followed by a focus group. Additionally, the research team analyzed both GBE and GFE reports for relevant themes. Findings: The evaluation users reported a slightly more positive attitude toward the GFE report on the semantic differential yet many focus group respondents stated that they found the GBE report more useful or perceived no difference between the two. Evaluation users reported the benefits of GFE to include its potential for developing or aligning goals, expanding the pool of potential outcomes, and supplementing GBE strategies.
Predicting Research Productivity in International Evaluation Journals across Countries
Authors: Mueller Christoph E. , Gaus Hansjoerg , Konradt Ingo
Published: April 2023

Background: Progress in evaluation research depends on the continuous generation of scholarly knowledge and its dissemination in the community. One way of disseminating findings is to publish in scientific journals and researchers, institutions, and even whole countries are assessed by their output in these journals. Particularly with regard to countries, there is an uneven distribution of research productivity in evaluation journals. A viable model for predicting countries’ research output in international evaluation journals, however, has not yet been developed. Purpose: The purpose of this study was to develop and test a model for the prediction of countries’ research output in international evaluation journals by predictors from the research, economic, and social/political system. Setting: NA Intervention: NA Research Design: A cross-sectional design was used for predicting research output in evaluation journals across countries. Data Collection and Analysis: Our sample consists of 65 countries that made contributions to ten international peer-reviewed evaluation journals. We collected data for the period from 2009 to 2013 and predicted the number of authorships across countries by using boosted regression trees, a machine learning procedure. Findings: Our model provided accurate predictions of countries’ research output. Research productivity in the social sciences had the strongest effect, followed by economic prosperity, control of corruption, and age of evaluation society. The model was generalizable to another period of time with only marginal loss in predictive accuracy.
Translating Project Achievements into Strategic Plans: A Case Study in Utilization-Focused Evaluation
Authors: Ramírez Ricardo , Kora Galin , Brodhead Dal
Published: April 2023

Background: Utilization-focused evaluation (UFE) is a decision-making framework intended to design and implement evaluations that get utilized. In this case study, the UFE approach was applied to the evaluation of a youth training and employment program in Kenya.
Purpose: Analyze a case study based on empirical experience with the lens of evaluation use and influence.
Setting: Nairobi and other urban and peri-urban settings, Kenya.
Intervention: The evaluation of a youth training and employment program that provided direct training for marginalized youth as well as capacity building for employment and adapted a Basic Employability Skills Training (BEST) model from India.
Research design: Analysis of a case study to describe: how the evaluation approach provided enabling factors for funders and grantees to turn evaluation into a learning intervention; the benefit of clarifying a project’s theory of change; and learning how to combine summative and developmental evaluation.
Data collection and analysis: A case study based on an evaluation consultancy. The evaluation included site visits, extensive documentation review, qualitative and quantitative data collection.
Findings: The ‘facilitation of use’ (a step in UFE) provided a bridge between a summative and a developmental evaluation. The evaluators and program partners developed a learning relationship wherein the evidence influenced the subsequent project design and strategy.
Using Visual Data in Qualitative Research
Authors: Silpe Shane
Published: April 2023

A review of the book Using Visual Data in Qualitative Research by Marcus Banks, published in 2008 by Sage.
The Impact of the Safe and Successful Youth Initiative (SSYI) on City-Level Youth Crime Victimization Rates
Authors: Petrosino Anthony , Turner Herbert , Hanson Thomas , Fronius Trevor , Campie Patricia , Cooke Cailean
Published: April 2023

Background: The physical, emotional, and financial costs resulting from youth violence are well documented.
Purpose: This article summarizes the results of a quasi-experimental evaluation study to test a youth violence intervention program in eleven cities in Massachusetts.
Setting: In 2011, Massachusetts initiated the Safe and Successful Youth Initiative (SSYI), which provides a comprehensive public health approach for young men believed to be at “proven risk” for being involved with firearms.
Intervention: The SSYI program components include: (1) Specific identification of young men, ages 14-24, at highest risk for being involved in firearms violence; (2) Use of street outreach workers to find these young men, assess their needs, and act as brokers for services; (3) The provision of a continuum of comprehensive services including education, employment, and intensive supervision. Eleven cities with the highest count of violent offenses reported to the police in 2010 were selected for SSYI funding in 2011 and began implementing the program.
Research Design:  Short-interrupted time series design with a comparison group. The observed and predicted trends in monthly violent victimization rates for the 11 SSYI cities were compared to the next 23 cities (as they ranked in reported violent crime in 2010).
Data Collection and Analysis: Using police incident data, researchers examined SSYI's impact on monthly city level violent crime, aggravated assault and homicide rates for persons ages 14-24.
Findings: Results indicated that SSYI had a statistically significant and positive impact on reducing the number of victims of violent crimes, aggravated assaults, and homicides per month that were reported to the police.  A city with SSYI has approximately 60 fewer victims of violence each year, ages 14-24, per 100,000 citizens over the post-intervention period.
Measuring Agency-Level Results: Lessons Learned from Catholic Relief Services’ Beneficiary and Service Delivery Indicators Initiative
Authors: Carr Harry , Scott Kelly M.
Published: April 2023

Background: Many NGOs have less success documenting their results at the agency level than at the program or project level. Little has been published on the challenges NGOs face in developing and measuring agency-level results. To address this issue, InterAction, an alliance of NGOs, commissioned a comparative study that drew on the existing grey literature, and a sample of 17 InterAction member organizations through case studies and interviews.
Purpose: This paper builds on that InterAction study by presenting one of the first published case studies of a successful agency-level measurement (ALM) system – Catholic Relief Services’ (CRS’) Beneficiary and Service Delivery Indicators (BSDI) initiative.
Setting: A faith-based multi-national relief and development NGO.
Intervention: N/A
Research Design:  A case study approach was used to describe and document the development of the CRS ALM.
Data Collection and Analysis: The information in this study is derived primarily from CRS files and documents. Data reflecting ALM practices in other NGOs were derived from the 17 InterAction member NGOs. Data reflecting the ALM practices developed by specific NGOs and presented in tabular form in the paper were derived from official documents published by those NGOs.
Findings: The authors discuss key lessons for other large and small organizations to consider when developing their own ALM systems.
Considerations for Evaluating Evolving Organizations and Initiatives
Authors: Palen Lori
Published: April 2023

Background: Evaluators are often called to be flexible in response to changing programmatic and contextual circumstances. However, the field offers little guidance around issues to consider before modifying an in-progress evaluation.
Purpose: This article describes the evaluation of an organization that underwent significant mid-evaluation changes, with a focus on factors that went into the evaluator’s recommendations about whether to modify evaluation design and instrumentation.
Setting: Community collaborative in Wake County, North Carolina
Intervention: NA
Research Design: NA
Data Collection and Analysis: The evaluator noted factors that went in to decisions about modifying evaluation design and instrumentation.
Findings: Issues around validity and sustainability push evaluators to update our evaluation designs to keep pace with changes, whereas issues around continuity and accountability pull us to back to the current course.
Standards of Excellence from a Leader of Excellence: Honoring Our Professional Heritage and Remembering Daniel L. Stufflebeam
Authors: Patton Michael Q.
Published: April 2023

Pays tribute to Stufflebeam's leadership in developing evaluation standards and their impact on professionalizing the evaluation field.
Methods for Collecting Data Based Upon an Eastern Paradigm of Evaluation
Authors: Russon Craig
Published: April 2023

To be added later.
Supplement to Theories of Change: Making Value Explicit
Authors: Powell Steve
Published: April 2023

Not applicable
What, How, and Why? A Comparative Analysis of 12 Goal-Free Evaluations
Authors: Youker Brandon W.
Published: April 2023

Background: Goal-free evaluation (GFE) is any evaluation in which the evaluator conducts the evaluation without reference to predetermined goals or objectives.  

 

Purpose: The purpose of this study is to examine GFE in actual practice focusing on what GFE is, how it is conducted, and why the evaluators use it.

 

Setting: Not applicable.

 

Intervention: Not applicable.

 

Research Design:  Document analysis.

Data Collection and Analysis: The researcher collected data from a non-random sample of 12 cases of GFE found in published and non-published papers, reports, and guidebooks. The researcher analyzed the documents using quantitative and qualitative content analysis.

 

Findings: The findings suggest that goal-free evaluators consider GFE an outcome evaluation that supplements GBE. These goal-free evaluators typically used an ex post facto evaluation design, non-random sampling of stakeholders, and semi-structured interviewing to collect data. The evaluators described using GFE to improve the evaluand, to find side-effects, and to evaluate highly complex evaluands.
Children’s Opinion of Retrospective Pre-Post ‘Then-Test’ Survey Validity
Authors: Kelly Leanne M.
Published: April 2023

Background: Over the past forty years there have been a number of studies conducted to compare traditional pre-post surveys (pretest-posttests; administered in two stages before and after an intervention) with retrospective pre-posts (thentests or pre-then-post-tests; administered after intervention only, with participants asked to reflect back to complete the ‘pre’ retrospectively). These previous studies have been with adult respondents and overwhelmingly quantitative.  

 

Purpose: This paper examines children’s perspectives regarding traditional and retrospective pre-post self-report subjective surveys.

 

Setting: A school-based program run by a community services organisation in southeastern Melbourne.

 

Intervention: Both pre-post survey types were administered to sixty children attending a pro-social skills group run by a community services organisation in southeast suburban Melbourne.

 

Research Design:  Twenty children participated in eight small focus groups after completing the surveys. Each focus group was guided by three semi-structured questions, ran for 10-15 minutes, and had 2-3 participants. This research included an observation component as the researcher was present at the final session when the post surveys were completed. The research also utilised the quantitative findings from the surveys to check alignment with findings from the extant literature.

 

Data Collection and Analysis: Focus groups & qualitative analysis

 

Findings: The traditional and retrospective surveys confirm that the commonly recorded phenomenon of response shift in adults also occurs with children. Children comment that they prefer the retrospective test, identifying concerns that support theories discussed in the extant literature such as experience limitation, impression management, implicit theory of change, and memory recall.
A Review of the DAC Evaluation Criteria: Upgrading Efficiency
Authors: De la Concha Joaquin
Published: April 2023

Background: Efficiency has remained for long time the Cinderella of evaluation practice. According to several meta-evaluations only a small number of evaluations include robust and meaningful assessments in this field.

Purpose: Following the review of the Development Assistance Committee’s (DAC) evaluation criteria this article reviews the main causes of efficiency remaining in a secondary role in evaluation practices and proposes: 1) upgrading it through broadening the current economic definition of efficiency, and 2) proposing a set of four evaluation dimensions revolving around the principle of sound financial management, social perceived value, result-based budgeting and interconnectedness with other criteria.

Setting: Not applicable.

Intervention: Not applicable.

Research design: Literature review and empirical pilot testing of proposed evaluation methodology.

Data collection & analysis: Qualitative analysis.

Findings: This paper calls for a shift in focus from efficiency to a broader enriched principle of sound financial management including a strong partner-based focus and highlighting management as a pre- condition “sine qua non” for an intervention to be efficient. Efficiency assessments would then be twofold: managerial (procedures, policies and practices that lay out the requirements for efficiency to take place) and substantial (context, circumstances and reasoning for the existing budget balance between results and target groups). The key aspects of the proposal involve four proposed dimensions to be analysed under this renewed criteria that imply audits and evaluations come much closer and look at each other.

Keywords: DAC evaluation criteria; efficiency; economy; equity; sound financial management; performance audit.
Opportunities and Challenges to Increase Inter- and Transdisciplinarity: A Qualitative Study of the FloodRISE Project
Authors: Forbat Julien
Published: April 2023

Background: The FloodRISE project, which started in 2013 in Southern California, aimed at better understanding how to promote resilience to coastal flooding. It was based on a cross-disciplinary approach, involving several research teams and local communities.

Purpose: We conducted a qualitative study of the first phase of the project (2013-2015) in order to analyze its inter- and transdisciplinary aspects.

Setting: We conducted this evaluation as a visiting postdoctoral researcher at UCI, not participating in the FloodRISE project.

Intervention: Not applicable.

Research design: We conducted 18 semi-structured interviews with members of the three project teams - modeling, social ecology and integration & impact - at UCI in 2015. Data were analyzed and interpreted to identify key aspects of the collaboration within and between project teams, as well as their relationship to local stakeholders.

Findings: The analysis showed that an intensive dialogue-based method of interaction and the presence of boundary researchers played a fundamental role in bridging the conceptual and methodological gaps between social and engineering sciences. These results thus exemplify several possibilities for developing more efficient interactions between researchers in a cross-disciplinary project. However, any cross-disciplinary project should: carefully evaluate potential for participants to become boundary researchers, since participants with multiple disciplinary expertise may be underemployed; improve researchers’ level of readiness, in order to facilitate further interaction and increase time efficiency; and clearly address remoteness issues to avoid lower collaboration between central and peripheral locations.

Keywords: interdisciplinarity; transdisciplinarity; qualitative study; project evaluation; flood risk
Complexity-Aware Monitoring and Evaluation
Authors: Hertz Tilman , Brattander Eva , Rose Loretta
Published: April 2023

Background: Addressing today’s sustainability challenges requires adopting a systemic approach where social and ecological systems are treated as integrated social-ecological systems. Such systems are complex, and the international development sector increasingly recognises the need to account for the complexity of the systems that they seek to transform.

Purpose: This paper sketches out the elements of a complexity-aware monitoring and evaluation (M&E) system for international development programmes in the area of sustainable development. 

Setting: Not applicable.

Data Collection and Analysis: The authors draw on existing literature on complexity and evaluation and on their own experience from working in the field of M&E.

Findings: An M&E system should not be seen simply as a tool to track compliance against a pre-determined theory of change. Instead, it is most useful as a real-time approach, constantly defining and re-defining narratives for change that help push systems along trajectories of interest. Dealing with complexity involves embracing uncertainty; and this challenges established notions of accountability—something which funders and implementers must begin to redefine together.

Keywords: monitoring; evaluation; complexity; social-ecological systems; international development programmes; narratives for change; theory of change
Evaluating the Content of Palestinian Curricula in Light of the Sustainable Development Goals 2030
Authors: Elyan Rabiha , Al-Doulat Adnan
Published: April 2023

Background: Curriculum evaluation is a dynamic and indispensable process necessary to develop the curriculum, and to support decision-makers with evidences to guide the curriculum towards the intended goals. The Sustainable Development Goals (SDGs) are the most important universal goals to be taken into consideration by curriculum. SDGs represent a call to end poverty, protect the planet and ensure that all people enjoy peace and prosperity by 2030. Because education, through curriculum, is the nations’ key to accelerate the achievement of sustainable development, this study evaluates the content of the Palestinian curriculum and assesses the degree to which SDGs are included in the curriculum.

Purpose: The study aimed to evaluate the Palestinian school curricula, through using national standards for each SDG, to examine the degree to which the SDGs are incorporated in the curricula, and to know whether there is variation in this incorporation among the different curricular subjects.

Setting: The study evaluates the content of Palestinian curricula of the main subjects based on national curriculum standards developed and published in light of the SDGs. These subjects are: Arabic Language for grades 1-12, Science for grades 1-12, Mathematics for grades 1-12, Social Studies for grades 1-12, Technology for grades 5-12, Agricultural Sciences for grades 11-12, Renewable Energy for grades 11-12, Entrepreneurship and Business for grades 11-12, Management and Economy for grades 11-12, and Smart Buildings for grades 11-12. In addition, timeframe delimit is the academic year 2018-2019.

Data Collection and Analysis: In order to evaluate content of the Palestinian curricula, descriptive-analytical methodology was used by utilizing content analysis of the guideline document for each curricular subject.

Findings: The results showed variation in the inclusion of the SDGs, and absence of essential aspects. The fourth SDG (Quality Education) obtained the highest inclusion percentage with 28.5%. While the fourteenth SDG (Life below Water) obtained the lowest inclusion percentage with 0.8%. In light of the results, the study highlighted variation of the curriculum from SDGs and recommended for the development and enrichment of the Palestinian curriculum to ensure the inclusion of SDGs, with its all dimensions, considering that education in Palestine defined as the main gateway towards progressing achievement of the SDGs.

Keywords: the 2030 agenda for sustainable development; content analysis; evaluation; SDGs; standards
Quality as praxis
Authors: Jersild Amy , Harnar Michael A.
Published: April 2023

Summative meta-evaluation is known to be more commonly practiced than formative meta-evaluation. While evaluation theorists speak to the importance of formative meta-evaluation, examples of how to do this are rarely specified in the evaluation literature. This paper aims to (1) further explore formative meta-evaluation as a means for quality assurance, with implications for both developing the capacity of evaluators and for advancing evaluation as a field of practice; and (2) to present a model with the intent to move toward a more deliberate formative quality evaluation practice. Discussion focuses on the relationship between evaluator and commissioner and how the development and use of a deliberate approach to formative meta-evaluation, through examination of the proposed model, can lead to a more egalitarian and inclusive approach to defining and promoting evaluation quality. Lastly, formative meta-evaluation is discussed as an important tool for evaluators in exercising professional judgment and for taking an active role in advancing the evaluation field.
Mission for the Journal of MultiDisciplinary Evaluation
Authors: Scriven Michael
Published: April 2023

The need for an open-access, evaluation-specific journal is outlined. Opportunities for utilizing the Journal of MultiDisciplinary Evaluation to its fullest extent are posited.
Journal of Evaluation and Program Planning
Authors: Schinker Regina S.
Published: April 2023

An exploration of the purpose and intent of the Journal of Evaluation and Program Planning, including a description of the types of articles published. Two articles from the August 2004 issue are discussed.
Education and Personnel Evaluation: A Review of Leading Journals for the Period 2003-2004
Authors: Persaud Nadini
Published: April 2023

This article provides a review of the research literature on teacher evaluation topics, including interviews, summative issues, international comparisons, screening, and teacher reactions. The research articles were published in 2003 and 2004 in a range of academic journals, such as the Journal of Personnel Evaluation in Education, Journal of Human Resources, Journal of Teacher Education, NASSP Bulletin, and Education Administration Quarterly.
The "Baggaging" of Theory-Based Evaluation
Authors: Davidson E. Jane
Published: April 2023

Program theory and its use in evaluation seems to be an argument that just won’t go away—depending on which part of the world one is in. What is it about theory-based evaluation (or the different understandings of it) that polarizes some but brings others together? A little digging shows that there are some serious misconceptions among both the program theory evangelists and the “theoro-skeptics,” while some of the best innovations are coming from those who understand program theory’s potential and limitations and are just getting on with using it to move our discipline forward.
Evaluation in Taiwan: An Overview
Authors: Huang Shu-tung
Published: April 2023

There are two tremendous influences on evaluation-related topics in Chinese society: external examination and Confucianism. Using oral and written tests to select individuals for positions in the civil service and the military generally used competitive group examinations and could be tracked back to the Western Zhou Dynasty (1027-711 BC) (Kellaghan & Madaus, 2003). Such public examination systems have deeply affected what standards to use in assessing the individual’s performance, and how to do it, in Chinese society. Also, Confucianism (circa 551-479 BC), the most important ancient religious underpinning for the social values, institutions, and transcendent ideals of traditional Chinese society, has influenced the educated Chinese approach to self-reference and correction of the flaws of his/her conduct. In one of Confucius’ famous analects; Zeng Zi, one of Confucius’ students, said: “I examine myself three times a day about whether I help my peers with all my efforts, whether I am honest and faithful to my friends, and whether I practice what is imparted.” The way of self-reflection has been rooted in how to improve one’s morality, behavior, and problem-solving skills.
Review of Evaluation and Program Planning, volume 28(4)
Authors: Watts Brad R.
Published: April 2023

The latest issue of Evaluation and Program Planning (Volume 28, Issue 4, November 2005) features seven articles, which, like our own Journal of Multidisciplinary Evaluation, cover a wide diversity of subjects that stretch the boundaries of the evaluation field. These range from the practical, to the technical, and even to the atypical—such as the subject of evaluating the public policy of beer keg registration laws. Also featured are reviews of three recently published evaluation books.
Review of The Evaluation Exchange, Volume XI(1), XI(2), and XI(3)
Authors: Youker Brandon W.
Published: April 2023

The Evaluation Exchange is a free, online evaluation periodical (http://www.gse.harvard.edu/hfrp/eval.html) published by the Harvard Family Research Project (HFRP) three or four times annually. It is aimed at addressing issues that program evaluators frequently encounter. The journal emphasizes innovative methods and approaches to evaluation, emerging trends in practice, and practical applications of evaluation theory. It is designed to serve as a medium for evaluators, program practitioners, funders, and policymakers. The journal is divided into five sections; (i) Theory & Practice; (ii) Promising Practices; (iii) Spotlight; (iv) Evaluations to Watch, and (v) Beyond Basic Training. The submissions are typically very brief (2-4 pages) and succinct. Each issue has an overarching theme or topic. The three most recent issues included Complementary Learning (spring 2005), Evaluation Methodology (summer 2005), and Democratic Evaluation (fall 2005).
A Review of the History and the Current Practice of Aid Evaluation
Authors: Sasaki Ryoh
Published: April 2023

The study discussed here examined the aid evaluation systems. More than fifty aid agencies were reviewed, under the headings of their major characteristics, criteria, types, volumes, and histories of aid evaluation. Based on preliminary results from this analysis, a meta-evaluation was done to identify best practices (if any) and to propose further study topics.
Review of American Journal of Evaluation, 27(2)
Authors: Persaud Nadini
Published: April 2023

American Journal of Evaluation (Volume 27, Issue 2) includes eight articles and five book reviews. The undermentioned is a synopsis of the articles and book reviews in the order in which they appear.
Planning and Evaluation: Two Sides of the Same Coin
Authors: Eggers Hellmut W.
Published: April 2023

This article outlines the principles, tools, and practices of Project Cycle Management (PCM), a methodological approach integrating planning, implementation, monitoring, and evaluation. PCM is aimed at improving the success of development projects by creating sustainable benefits for target groups.
Evaluation in Australasia: An Overview of Recent Developments
Authors: Martz Wes
Published: April 2023

Evaluation activities continue to develop throughout Australasia as evidenced by the Australasia Evaluation Society (AES) expanding its circle of influence and reaching out to its neighbors in Vietnam and China. Government officials and private sector personnel from these Asian neighbors visited Australia in October 2006 in an effort to learn more about evaluation in Australia.
Review of Volume 10(3) of the Journal of Studies in International Education
Authors: Jankowski Natasha
Published: April 2023

The following is a summary of Volume 10(3) of the Journal of Studies in International Education (2006). This volume celebrates the 10th anniversary of the Journal, as well the 10th anniversary of the Center for International Higher Education based in Boston College. The Journal of Studies in International Education has been received international awards from the Association of International Education Administrators and recognition from the Association of International Educators.
An Eastern Paradigm of Evaluation
Authors: Russon Craig
Published: April 2023

I recently taught a module on the philosophies of evaluation as part of a pilot introductory course of a new diploma programme jointly sponsored by the United Nations (UN) Evaluation Group and the United Nations Staff College (Russon, 2007, November). In the session, I compared and contrasted the “rationalistic” paradigm with the “naturalistic” paradigm on the basis of ontology, epistemology, and methodology.
Feminist Evaluation and Gender Approaches: There's a Difference?
Authors: Podems Donna R.
Published: April 2023

Background: Feminist evaluation and gender approaches offer evaluators distinct ways of thinking and applying evaluations. A Namibian case narrative demonstrates how feminist evaluation and gender approaches, among others, resulted in a useful and used evaluation.
Purpose: The purpose of this article is to provide readers with a historical overview and description of feminist evaluation and gender approaches and is intended for those who are interested in understanding these approaches to evaluation.
Setting: Southern Africa.
Intervention: A nonprofit that advocates for sex workers safety and the decriminalization of sex work.
Research Design: A comparative framework is used to describe feminist evaluation and gender approaches. The evaluation employs qualitative methods that explored the reality of sex work and sex workers through both semi-structured and exploratory questionnaires. The approach was guided by feminist evaluation, gender approaches, and to a lesser extent drew on several other evaluation approaches.
Data Collection and Analysis:  Interviews and document reviews were used to collect data and content and thematic analyses were used to analyze data.
Findings: Feminist evaluation and gender approaches should be viewed as distinct approaches. Their use should be of interest both to evaluation scholars and to those who design, implement and/or use evaluations.
A Basis for Determining the Adequacy of Evaluation Designs
Authors: Sanders James R. , Nafziger Dean N.
Published: April 2023

Originally published as Paper #7, Occasional Paper Series, April, 1976
* This paper was prepared under contract support from the Alaska Department of Education to the Northwest Regional Educational Laboratory.
Evaluation Bias and its Control*
Authors: Scriven Michael
Published: April 2023

Originally published as Paper #4, Occasional Paper Series, June, 1975
*A paper originally written in conjunction with The Evaluation Center’s Grant # GW-7903 from the National Science Foundation.
Needed: Instruments as Good as Our Eyes*
Authors: Brickell Henry M.
Published: April 2023

Originally published as Paper #7, Occasional Paper Series, July, 1976* This paper was originally published in the Journal of Career Education, Winter 1976, 2(3), 56-66.
Standards and Criteria*
Authors: Glass Gene V.
Published: April 2023

Originally published as Paper #10, Occasional Paper Series, December, 1977
* This monograph was prepared under a grant from the Carnegie Corporation. Mary Lee Smith contributed at every stage of the preparation of this monograph; reading the literature, developing the ideas, outlining and editing the final product. Nancy W. Burton helped in developing the topic. Laura A. Driscoll and Gregory C. Camilli deserve thanks for assistance in literature search and data analysis. Conversation among Glass, Smith, Burton, and Robert Glaser on a day in June 1976 got things started; we are much indebted to Glaser for helping set things off in a direction that now pleases us.
Content Specialization and Educational Evaluation: A Necessary Marriage
Authors: Worthern Blaine R. , Sanders James R.
Published: April 2023

Originally published as Paper #14, Occasional Paper Series, September, 1984
The Faster Forward Fund
Authors: Scriven Michael
Published: April 2023

Description and explanation of the soon-to-be-created "Faster Forward Fund," which will be founded by Michael Scriven and will aim at supporting three approaches in the evaluation field:
1. To develop ideas that show promise for significantly accelerating the field of evaluation.
2. To give particular support to efforts that are outside the natural development of well-accepted paradigms or models.
3. To support those whose development shows significant signs of benefitting people or peoples with serious unmet needs (whether physical, social, economic, or political in other ways).
Using Objective Stylometric Techniques to Evaluate New Testament Authorship
Authors: Royal Kenneth
Published: April 2023

Background: Bible scholars often debate the authorship of certain books appearing in the New Testament.   Purpose: The purpose of the present study was to evaluate New Testament authorship by using stylometric analytical techniques   Setting: This research focuses on texts appearing in the New Testament.   Intervention: This was an exploratory research on evaluation study with no intervention.   Research Design: A powerful, state-of-the-art psychometric model was applied to Biblical text in an effort to identify correlations among word usage and writing style among each of the New Testament books. Data Collection and Analysis: Strong’s Concordance was used to provide original Greek text. Computer programming was necessary to create a worksheet that contained a list of New Testament books, each Greek word appearing in the New Testament, and a count of each word’s appearance relative to each book. Rasch-based Principal Components Analysis of standardized residual correlations was used to map stylistic similarities and differences.   Findings: With regard to substantive findings, the gospels (Matthew, Luke, Mark, and John) and the narrative book of Acts were closely correlated. Other texts presented a mix of expected and unexpected findings. With regard to other findings, the technique presented in this study offers a great deal of promise to various research and evaluation practices.
Auditoria tributaria preventiva y los riesgos tributarios en las empresas industriales de Puente Piedra – Lima 2020
Authors: Sobrado Huaquino Verónica Nery
Published: April 2023

Determinar en qué medida la auditoría tributaria preventiva reduce los riesgos tributarios en las empresas industriales de Puente Piedra 2020. El tipo de investigación fue cuantitativa. Se trabajó con la empresa Investments Good pack SAC 2020. Se aplicó la técnica de encuestas por cuestionario en Google forms, entrevista al área administrativa de la empresa. La auditoría tributaria preventiva en la empresa Investments Good Pack SAC. disminuyó en un 64.30% los riesgos tributarios en el año 2020. La auditoría tributaria preventiva aplicada a la empresa Investments Good pack SAC disminuyó los riesgos tributarios en el año 2020 luego de haberse aplicado la implementación del procedimiento de control interno.
Percepción de las competencias informacionales por estudiantes de la carrera de gestión de la información gerencial en la Universidad Laica Eloy Alfaro De Manabí
Authors: Andrade Alvarado Sonia Patricia , Zambrano Vera María Fernanda , Luna Caicedo Mercedes Mónica , Peñaherrera Vélez Cindy del Carmen , Ponce Ocaña Karen Romina
Published: April 2023

Esta investigación tiene como finalidad conocer la percepción de los estudiantes sobre el nivel de dominio de las competencias informacionales de los alumnos de la carrera de Gestión de la Información Gerencial, con el propósito de plantear un programa de capacitación, en función de los resultados del estudio. Se trabajó con 339 estudiantes de la carrera de Gestión de la Información Gerencial, Ecuador. Se utilizó una metodología cuantitativa, mediante una encuesta de percepción con 4 dimensiones: Búsqueda, evaluación, procesamiento y comunicación de la información, con 60 preguntas. Como resultado se obtuvo las carencias de habilidades principalmente las vinculadas en procesamiento y comunicación de la información, determinando que los estudiantes se encuentran por debajo de la media en cuanto a dominio de competencias informacionales. Al obtener los resultados se propone ejecutar un Programa de alfabetización informacional en los estudiantes de la carrera de Gestión de Información Gerencial.
CHEMINEMENT ET SELECTION D'UNE SOURCE D'INFORMATION EN MEDECINE DE PREMIER RECOURS : PROPOSITION D'UN MODELE EXPLICATIF PAR THEORISATION ANCREE
Authors: THOMAZO M , SOULIE B
Published: April 2023

Introduction. Des décisions thérapeutiques sont prises lors de chaque consultation, et ce processus décisionnel est aujourd’hui bien étudié dans la littérature psychologique. Ces décisions sont censées se fonder sur le concept d’evidence-based medicine associant à la fois les données actualisées de la science, l’expertise empirique du praticien et les préférences du patient. Lorsqu’un choix doit être fait dans la prise en compte d’une source d’information, plusieurs profils décisionnaires existent. Objectif. Proposer un modèle théorique expliquant le cheminement d’une source d’information dans une prise de décision. Méthode. Étude qualitative inspirée de la théorisation ancrée avec échantillonnage théorique et processus d’itération en comparaison constante. Résultats. Les médecins généralistes déléguaient une partie de la critique des sources d’information à différents intermédiaires. L’accessibilité de ces informations formait un premier filtre : langue native, technologie, fatigue, investissement nécessaire et éloignement géographique des interlocuteurs. Les préférences comme l’indépendance, l’empirisme ou la formation universitaire étaient un second filtre. La confirmation par les pairs venait potentialiser certaines informations via la convivialité, les liens affectifs et la réputation. Une vigilance et une adaptation au contexte étaient les derniers filtres. Conclusion. L’origine des décisions est multifactorielle, et l’enseignement de ces facteurs pourrait permettre aux futurs médecins généralistes de mieux reconnaître certains biais cognitifs.
LA PRECARITE SOCIALE EST-ELLE UN FACTEUR DE RISQUE DE PRESCRIPTION INAPPROPRIEE D'ANTIBIOTIQUES ? REVUE SYSTEMATIQUE DE LA LITTERATURE
Authors: BIREBENT J , DEGUILLARD M , COUET G , DRIOT D , DUPOUY J
Published: April 2023

Contexte. Les inégalités sociales de santé sont définies comme les écarts d’état de santé socialement stratifiés. Le médecin de premier recours est l’interlocuteur privilégié de cette population. En Belgique, il est le principal prescripteur d’antibiotiques et celui dont la prescription est en augmentation constante. Objectif. L’objectif principal était de rechercher un lien entre précarité sociale et prescription inappropriée d’antibiotiques. Méthodes. Une revue systématique de la littérature a été réalisée selon les recommandations internationales Preferred reporting items for systematic reviews and meta-analyses (PRISMA), sur la période du 1er janvier 2000 au 27 novembre 2018. Les recherches ont été effectuées sur trois bases de données : PubMed, Web of Science, Pascal et Francis, utilisant une équation de recherche spécifique à chaque revue, ainsi que par une recherche manuelle. Résultats. Onze articles ont été inclus sur 4 505 articles relevés. La prescription inappropriée d’antibiotiques (surprescription ou antibiotiques de deuxième ligne d’emblée) était plus importante quel que soit l’indicateur de précarité retenu : niveau d’éducation, revenu, origine géographique, couverture maladie déficiente, chômage et famille monoparentale. Conclusion. Le mésusage des antibiotiques est favorisé par la précarité sociale, et ce quel que soit le paramètre de fragilité retenu. Des études plus précises sur les raisons de ce mésusage dans ces populations seraient nécessaires.
Tips for Planning a Successful Author Visit
Authors: Watson Tiffany , Maxwell Nicole , Hartsfield Danielle
Published: April 2023

Author visits are an exciting way to generate students’ interest in reading and writing. They offer the opportunity for students to hear directly from an author about the process and value of various texts. However, successful author visits require careful planning and collaboration. This teaching tip article explains how author visits can support learning outcomes, describes the steps involved in planning a visit, and identifies possibilities to fund a school or campus visit.
Private equity in ophthalmology and optometry: a time series analysis from 2012 to 2021
Authors: Patil Sachi A. , Vail Daniel G. , Cox Jacob T. , Chen Evan M. , Mruthyunjaya Prithvi , Tsai James C. , Parikh Ravi
Published: April 2023

PurposeTo identify temporal and geographic trends in private equity (PE)–backed acquisitions of ophthalmology and optometry practices in the United States from 2012 to 2021. MethodsIn this cross-sectional time series, acquisition data from 10/21/2019 to 9/1/2021 and previously published data from 1/1/2012 to 10/20/2019 were analyzed. Acquisition data were compiled from 6 financial databases, 5 industry news outlets, and publicly available press releases. Linear regression models were used to compare rates of acquisition. Outcomes included number of total acquisitions, practice type, locations, provider details, and geographic footprint.ResultsA total of 245 practices associated with 614 clinical locations and 948 ophthalmologists or optometrists were acquired by 30 PE-backed platform companies between 10/21/2019 and 9/1/2021. Of 30 platform companies, 18 were new vis-à-vis our prior study. Of these acquisitions, 127 were comprehensive practices, 29 were retina practices, and 89 were optometry practices. From 2012 to 2021, monthly acquisitions increased by 0.947 acquisitions per year (P < 0.001*). Texas, Florida, Michigan, and New Jersey were the states with the greatest number of PE acquisitions, with 55, 48, 29, and 28 clinic acquisitions, respectively. Average monthly PE acquisitions were 5.71 per month from 1/1/2019 to 2/29/2020 (pre-COVID), 5.30 per month from 3/1/2020 to 12/31/2020 (COVID pre-vaccine [P = 0.81]), and 8.78 per month from 1/1/2021 to 9/1/2021 (COVID post-vaccine [P = 0.20]).ConclusionsPE acquisitions increased during the period 2012-2021 as companies continue to utilize both regionally focused.
The Australian Child Maltreatment Study (ACMS), a national survey of the prevalence of child maltreatment and its correlates: methodology
Authors: Haslam Divna M , Lawrence David M , Mathews Ben , Higgins Daryl J , Hunt Anna , Scott James G , Dunne Michael P , Erskine Holly E , Thomas Hannah J , Finkelhor David , Pacella Rosana , Meinck Franziska , Malacova Eva
Published: April 2023

Objectives

To describe the aims, design, methodology, and respondent sample representativeness of the Australian Child Maltreatment Study (ACMS).

Design, setting

Cross‐sectional, retrospective survey; computer‐assisted mobile telephone interviewing using random digit dialling (computer‐generated), Australia, 9 April – 11 October 2021.

Participants

People aged 16 years or more. The target sample size was 8500 respondents: 3500 people aged 16–24 years and 1000 respondents each from five further age groups (25–34, 35–44, 45–54, 55–64, 65 years or more).

Main outcome measures

Primary outcomes: Emotional abuse, neglect, physical abuse, sexual abuse, exposure to domestic violence during childhood, assessed with the Juvenile Victimization Questionnaire‐R2 Adapted Version (Australian Child Maltreatment Study). Secondary outcomes: selected mental disorder diagnoses (Mini International Neuropsychiatric Interview, MINI), selected physical health conditions, health risk behaviours, health service use.

Results

The demographic characteristics of the ACMS sample were similar to those of the Australian population in 2016 with respect to gender, Indigenous status, region and remoteness category of residence, and marital status, but larger proportions of participants were born in Australia, lived in areas of higher socio‐economic status, had tertiary qualifications, and had income greater than $1250 per week. Population weights were derived to adjust for these differences. Associations between the number of calls required to recruit participants and maltreatment rates and health outcomes were not statistically significant.

Conclusions

The ACMS provides the first reliable estimates of the prevalence of each type of child maltreatment in Australia. These estimates, and those of associated mental health and health risk behaviours reported in this supplement can inform policy and practice initiatives for reducing the prevalence of child maltreatment and its consequences. Our benchmark study also provides baseline data for repeated waves of the ACMS that will assess the effectiveness of these initiatives.