bluuebunny/crossref_metadata_2025 huggingface dataset:
AN ANALYSIS OF TEACHER’S FEEDBACK ON STUDENTS’ WRITING TASK
Authors: Darmanto D , Utari Fetty Yulia , Rahim Abdul
Published: April 2023

The use of feedback is strongly crucial in learning of English as a second or foreign language. It is crucial because it can motivate and support the students in learning English. This study focused on analyzing and describing the teacher’s feedbacks used on students’ writing tasks and students’ perspective about it. In this research, case study was applied as research method. The subject of this research was the tenth graders of MAN 2 Sumbawa in school year 2021-2022. In collecting the data, the researchers used several instruments such as the students’ writing tasks, semi structure interview guide and observation sheet to gain the data from the respondents. All of the data were analyzed to know the type of teacher’s feedbacks and students’ responses on it. The findings of this research showed that there were two types of feedback given by the teacher, namely written and oral feedback. Both of those feedbacks were implemented in the students’ writing task. The finding also showed the use of feedback in English as foreign language (EFL) context was great significance to stimulate the students to make good writing. EFL students who involved in this study had expressed their strong belief in its importance and applicability. They gave positive responses to the use of written and oral feedback. Most of the students stated that the teacher’s feedback was a good motivation in learning and believed that the teacher’s feedback helped them in improving their writing proficiency.
ANALISIS KINERJA KEUANGAN PEMERINTAH DAERAH KABUPATEN BIMA TAHUN ANGGARAN 2017- 2021
Authors: Digdowiseiso Kumba , Alfian Muh
Published: April 2023

The purpose of this study was to determine the regional financial management performance of the Bima Regency Government. This type of research is descriptive research with a quantitative approach. The data analysis technique used is to calculate the ratio of effectiveness, the ratio of regional financial independence, the ratio of the degree of decentralization and the ratio of activity (Direct and Indirect Expenditures). The Effectiveness Ratio of Regional Original Income (PAD) for Bima Regency shows that the implementation of dominant regional taxes and fees is at a low level (below 100%) or ineffective. Based on the calculation of the Regional Financial Independence Ratio for Bima Regency from 2017 to 2021, the relationship pattern from 2017 to 2021 is entirely instructive with very low finances. The Activity Ratio shows that the ratio of indirect spending to total spending is still greater than the ratio of direct spending to total spending. The conclusion from the financial performance analysis of the Bima Regency Government for 2017-2021 has not run optimally as expected.
PERENCANAAN PEMBERDAYAAN MASYARAKAT MELALUI PEMBENTUKAN RELAWAN PEMADAM KEBAKARAN DI KABUPATEN SUBANG: SEBUAH TINJAUAN
Authors: Sutangsa Sutangsa , Suryana Endang
Published: April 2023

The progress of development in the Subang Regency area demands the readiness of the local government to further improve services in various aspects/sectors including health, education, economy, as well as improving security services, community welfare, and community protection including fire affairs in accordance with existing laws and regulations. apply. With the condition of a fairly large area, the amount of infrastructure owned and the existing human resources, the responsibility for preventing and overcoming fire hazards is the responsibility of all of us, in this case the government, the community and themselves. For this reason, community empowerment through the formation of volunteer firefighters is needed in order to create self-reliance and help firefighters achieve a level of response time. The theory used in this research is planning theory and community empowerment theory. The meaning contained in planning is the basis for achieving the goals of better and orderly social change. While the theory of community empowerment explains the existence of power and the ability to give to other parties. This theory reveals that people involved in the empowerment process must have the awareness to participate actively and have the ability to increase their capacity. This research was conducted using qualitative research methods. The use of this method is intended to understand in depth the phenomenon of the community empowerment program planning process through the Formation of Volunteer Firefighters. The location of this research is the Civil Service Police Unit and the Subang Regency Fire Department. The focus of this research lies in the stages of the planning process for the empowerment program which makes the subject groups of government-assisted empowerment.
PENGARUH FASILITASI PROMOSI DAN PEMASARAN TERHADAP KINERJA USAHA MIKRO, KECIL DAN MENENGAH
Authors: Rizaldi Tito Luthfi Novianto , Djamaluddin Sartika
Published: April 2023

This study aims to investigate the effect of promotion and marketing facilitation on the performance of MSMEs as measured by revenue streams for a year. Promotion and marketing facilitation of MSMEs is carried out through SMESCO, which is a work unit under the Ministry of Cooperatives and SMEs which aims to expand MSME market access both nationally and globally. Promotion and marketing facilitation activities consists of intensive promotion and marketing through offline and online media, implementation of promotional events, marketing partnership cooperation and is supported by increasing the capacity of MSMEs human resources and financing loan facilities. Previous studies have shown that there is a positive and significant influence between promotion, use of online media and partnerships with increasing MSMEs revenue. Through the panel data regression analysis method using the fixed effect estimation model, results can be obtained which state that there is a positive and significant influence between promotion intensity both offline and online, the implementation of promotional events and the implementation of marketing partnership cooperation carried out by SMESCO on the performance of MSMEs as measured by revenue streams. In addition, increasing the capacity of human resources, financing loans and the number of other agencies that also provide guidance to MSMEs as a control variable also has a positive and significant influence on MSMEs revenue. However, the Large-Scale Social Restrictions (PSBB) policy during the COVID-19 pandemic had a negative and significant impact on MSMEs revenue.
ANALISIS KINERJA KEUANGAN UNIT PENGELOLA KEUANGAN (UPK) DESA MONTONG ARE DITINJAU DARI RASIO PROFITABILITAS TAHUN 2015-2020
Authors: Pahmi Saepul
Published: April 2023

This study aims to determine the financial performance of the Montong Are Village Financial Management Unit (UPK) using the profitability ratio measurement tool. This research is expected to provide an overview of the ability of the Montong Are Village UPK to manage resources to generate good profits. This research was conducted at the Montong Are Village Financial Management Unit (UPK) which is engaged in the distribution of revolving loan funds. The research method used in this study is a descriptive method, namely by describing the profitability ratios and then comparing them with the standard financial ratios. The results of this study indicate that for five years from 2015-2020 the results of the calculation of financial ratios show fluctuating values, both ROA, ROE, NPM, and GPM ratios. The ROA ratio shows the lowest figure of 4% and the highest of 11%. Likewise with ROE where the lowest ratio figure is 5% and the highest is 12%. Meanwhile, the lowest GPM and NPM ratios are 15% and 6% respectively and the highest is 28% and 15%.
EFEKTIVITAS PERAN AUDIT INTERNAL DI MASA PANDEMI COVID 19
Authors: Oktavian Aria , Cahya Yulida Army Nur
Published: April 2023

Pandemi covid- 19 yang sedang terjadi saat ini sangat mempengaruhi kegiatan kerja serta proses pengecekan internal audit yang sudah ditetapkan lebih dahulu dikarenakan pemberlakukan PSBB serta larangan aktivitas tatap muka sehingga berakibat kepada perolehan fakta audit dari pembatasan akses perjalanan ke titik pengecekan di sebagian wilayah. Metode yang digunakan untuk riset ini merupakan metode deskriptif kualitatif dengan memakai kajian literatur. Ada pula sumber informasi yang digunakan dalam riset ini merupakan sumber informasi sekunder yang diperoleh lewat riset kepustakaan dari harian serta postingan ilmiah yang berkaitan dengan efektivitas peran audit jarak jauh di masa pandemi Covid- 19.        Pada penelitian ini mendapat temuan bahwa peran internal audit juga dapat diterapkan pada evaluasi pengendalian internal dan manajemen risiko sehingga dapat memberikan rekomendasi, masukan dan arahan agar bisa meminimalisir terjadinya tindakan kecurangan. Internal audit diharapkan dapat selalu menjaga independensi dan integritas serta selalu meningkatkan kompetensinya secara berkesinambungan.
GAMBARAN KARAKTERISTIK PERAWAT DALAM KEPATUHAN PENGGUNAAN ALAT PELINDUNG DIRI (APD) SESUAI STANDARD OPERATING PROCEDURE (SOP) DI RS PRISCILLA MEDICALCENTER
Authors: Khasanah Anisa Uswatun , Kurniawan Wasis Eko , Ulfah Mariah
Published: April 2023

Risiko infeksi nosokomial (HAIs) merupakan masalah besar yang dihadapi oleh rumah sakit saat ini dan kejadian ini terus meningkat. Strategi kontrol infeksi yang diterapkan oleh tenaga kesehatan yaitu dengan menekankan pada penggunaan Alat Pelindung Diri (APD). Angka capaian kepatuhan penggunaan APD di rumah sakit masih belum maksimal. Penelitian ini bertujuan untuk mengetahui kepatuhan perawat dalam penggunaan APD sesuai Standard Operating Procedure (SOP). Jenis penelitian ini adalah deskriptif kuantitatif. Populasi penelitian ini adalah perawat pelaksana yang bertugas di 5 ruang rawat inap RS Priscilla Medical Center sejumlah 36 responden. Penelitian ini dilakukan pada bulan Juni 2022 hingga Januari 2023. Teknik pengambilan sampel yaitu menggunakan teknik Accidental sampling, dalam hal ini perawat diamati kesesuaian penggunaan APD dengan SOP yang ada di rumah sakit menggunakan lembar observasi. Data di analisis secara univariat dan disajikan dalam bentuk distribusi frekuensi. Hasil penelitian menunjukkan bahwa berdasarkan karakteristik responden, sebagian besar dalam rentang usia 20-30 tahun sebesar 91,7%, jenis kelamin didominasi oleh perempuan sebesar 88,9%, tingkat pendidikan didominasi oleh DIII Keperawatan sebesar 86,1%, dan menurut masa kerja paling banyaj dengan masa kerja 1tahun sebesar 94,4%. Menurut kepatuhan penggunaan APD sesuai SOP sebanyak 33 responden (91,7%) patuh menggunakan APD sesuai SOP. Diharapkan manajemen melakukan penyuluhan, menyediakan kelengkapan APD, mengintensifkan pengawasan APD dan memberikan reward kepada petugas yang patuh dalam penggunaan APD.
PERAN SOSIAL MEDIA ATAS PERILAKU KONSUMTIF BELANJA BAGI IBU RUMAH TANGGA DI DESA LEBAKSARI KEC.PARAKANSALAK
Authors: Hamidah Neng Siti , Hakim Reihana Jannati
Published: April 2023

Belanja , wanita mana yang tak menyukai jenis kegitan ini hampir atau bahkan semua wanita pasti menyukai kegiatan satu ini. Seiring berjalan nya waktu berbelanja kini tak mesti harus pergi kepasar , panas – panasan , berdesak – desakan dengan cara berdiam diri sekalipun sudah bisa melakukan kegiatan belanja . Ditambah dengan social media yang memudahkan para wanita khususnya ibu rumah tangga memiliki keinginan berbelanja yang semakin tinggi . Penelitian ini bertujuan untuk mengetahui apakah ibu rumah tangga yang berada di Desa Lebaksari Kec.Parakansalak ini menjadi perilaku konsumtif karena adanya social media . Dalam penelitian kualitatif – deskriptif ini melibatkan lima ibu rumah tangga. Hasil dari penelitian ini bahwa hanya satu dari lima  ibu rumah tangga yang melakukan kegiatan berbelanja yang betul –betul membeli apa yang mereka butuhkan sedangkan empat dari ibu rumah tangga tersebut mengakui mereka berlanja hanya karena semata – mata atas dasar keinginan dan akhirnya berperilaku konsumtif.
HUBUNGAN JARAK KEHAMILAN, DUKUNGAN SUAMI DAN DUKUNGAN TENAGA KESEHATAN TERHADAP PERILAKU PEMILIHAN METODE KONTRASEPSI JANGKA PANJANG DI PUSKESMAS KECAMATAN CILANDAK JAKARTA SELATAN TAHUN 2022
Authors: Meilani Eka , Rini Ageng Septa , Diana Aida
Published: April 2023

Metode Kontrasepsi Jangka Panjang (MKJP) adalah kontrasepsi yang dapat dipakai dalam jangka waktu lebih dari dua tahun, efektif dan efisien untuk tujuan pemakaian menjarangkan kelahiran lebih dari tiga tahun atau mengakhiri kehamilan atau sudah tidak ingin menambah anak lagi. Pada data tersebut yang paling banyak diminati oleh pasangan usia subur (PUS) adalah Non MKJP dan untuk penggunaan MKJP masih cukup rendah. Tujuan Penelitian ini adalah mengetahui hubungan jarak kehamilan, dukungan suami dan dukungan tenaga kesehatan Terhadap Perilaku pemilihan metode kontrasepsi jangka panjang (MKJP).Rancangan penelitian Cross Sectional, dengan menggunakan data primer, sampel dalam penelitian ini berjumlah 85 akseptor KB aktif di Puskesmas Kecamatan Cilandak Jakarta Selatan Tahun 2022. Analisis dilakukan secara univariate, bivariate menggunakan chi square. Hasil penelitian didapatkan Variabel yang berhubungan terhadap perilaku pemilihan kontrasepsi MKJP adalah jarak kehamilan (0,004), dukungan suami (0,000) dan dukungan tenaga kesehatan (0,001). Kesimpulan dari penelitian ini jarak kehamilan, dukungan suami dan dukungan tenaga kesehatan berhubungan dengan perilaku pemilihan kontrasepsi MKJP
SOSIALISASI MANFAAT DAN PRODUK TANAMAN TERATAI (NYMPHAEA PUBESCENS WILLD) PERAIRAN RAWA DI SUMATERA SELATAN MENJADI PRODUK BIBUTE
Authors: Miksusanti Miksusanti , Basir Dasril , Kholiq Azhar , Rohendi Dedi , Desnelli Desnelli
Published: April 2023

Tanaman teratai mempunyai kemampuan yang baik tumbuh di daerah rawa Sumatera Selatan. Berdasarkan hasil riset secara invitro maupun invivo, tanaman ini sangat baik bagi kesehatan, baik untuk pangan fungsional maupun farmasetika lainnya. Daun teratai, bunga teratai, biji teratai serta akar nya mempunyai sifat antioksidan yang setara dengan vitamin C dalam meredam radikal bebas. Biji teratai mempunyai sifat prebiotik yang baik. Dalam kegiatan ini tim pengabdian melakukan sosialisasi manfaat tanaman teratai kepada kaum remaja dan dewasa yang berada di desa Pulo Kerto Gandus Sumatera Selatan. Sosialisasi dilakukan menggunakan metoda virtual lewat zoom sebanyak 8 kali dan 4 kali kunjungan penyuluhan ke lapangan, dan 4 kali evaluasi setelah kegiatan perkulaiahan selesai, mengingat Indonesia masih belum benar benar bebas dari wabah virus. Kegiatan diiikuti 54 remaja putri dan laki-laki. Kegiatan juga melibatkan mahasiswa Universitas Sriwijaya. Kegiatan virtual dilakukan dalam rangka memberi materi ilmu sains dan bukti empiris, untuk memperkenalkan tanaman teratai serta manfaatnya kepada remaja sederajat SMA, yang merupakan calon-calon pekerja dan wirausaha dimasa depan. Sosialisasi meliputi data hasil penelitian yang dipublikasi di jurnal bereputasi, data empiris, buku, video tutorial pengolahan biji teratai dan informasi lainnya. Produk-produk dari tanaman teratai dalam kegiatan pengabdian ini dinamakan produk Bibute.
STUDY REGARDING GERMINATION OF INDIAN MUSTARD (BRASSICA JUNCEA L.) FOR APPLICATION IN PHYTOREMEDIATION OF STERILE DUMPS POLLUTED WITH HEAVY METALS
Authors: Petrean Ioana Andreea , Micle Valer
Published: April 2023

Nutrient-poor, sandy, sterile material from the post-mining sterile dumps such as those in the Maramures region (Romania) presents a challenge for plants. Sterile dumps are considered extreme environments for plants due to their unfavorable physicochemical properties. Phytoremediation has great potential to remove heavy metals from sterile dumps, and Indian mustard (Brassica juncea) seems to be a possible candidate species for this purpose. The potential of Brassica juncea seeds to germinate in a medium contaminated with high concentrations of Cu, Pb and Cd was assessed using germination tests on Indian mustard seeds in the presence of various liquid mixtures made from fertilizer and sterile material collected from three different mining sterile dumps in Maramures county, Romania. The experiment results showed that adding fertilizers did not enhance the germination process of Brassica juncea seeds and that the optimal pH for Brassica juncea to sprout extremely well is 5.5. The results suggest that Brassica juncea could be used in efficient phytoremediation of the sterile dumps. This paper's objective consists of observing the germination of Indian mustard (Brassica juncea L.) in the presence of high concentrations of heavy metals from sterile mining dumps with the purpose of the phytoremediation of the studied polluted areas from Maramures county (Romania).
EFFECT OF SHARED ELECTRIC SCOOTERS ON URBAN GREEN HOUSE GAS EMISSIONS: CASE OF RIGA
Authors: Rubenis Aivars , Laizans Aigars , Zvirbule Andra
Published: April 2023

Because of the electric propulsion, electric scooters could be a potential way how to decrease greenhouse gas (GHG) emissions in urban transportation sector; however, recent research has cast doubt on that. This article focuses on the effect the electric scooter use has on CO2 emissions by examining the electric scooter trip data obtained during 2021 scooter season in Riga city. As shared scooters routinely replace already existing modes of transportation, the article analyses the effect which this replacement has on net CO2 emissions in the city. We argue that not all replacement modes will bring actual decrease of CO2 emissions. The results indicate that most of the shared e-scooter trips in Riga fall into the 1-2 km distance category, where it replaces not just cars, but also public transportation, walking and cycling, and actually increases CO2 emissions. The article examines the factors contributing to the CO2 emissions and relative impact of each. The results demonstrate that the largest impact comes from the scooter and battery manufacturing, thus scooter lifetime has decisive impact on the overall net CO2 emissions. In addition, this research found fundamental differences between expected scooter lifetime data claimed by shared scooter operators (5 years) and the average reallife data (156 days). It results in shared e-scooters creating additional 239.9 tonnes CO2 in Riga, and minimum scooter lifetime should be at least 5 years, for shared scooters to become CO2 neutral. This study aims to contribute to transportation literature by demonstrating net CO2 emission calculation methodology as well as empirical evidence on e-scooter trips in North-Eastern Europe region and to help local authorities to make decisions on reaching environmental targets in transportation sector.
Schools reality captured in words teachers narrative perspective
Authors: Klimczyk Piotr
Published: April 2023

Introduction: Aim of the article is to present a conducted study that bases its theory on the narrative approach in psychology. Participants of this study were working teachers who varied in job seniority. The aim of the study was to describe how teachers perceive the reality of schools work if and how it changed between the first days of work and present times, what critical events influenced view of schools reality, and how they perceive modern pupils. The conclusions of this study show a negative image of work in school, burnout symptoms in teachersthat took part in the study, and upholding feeling of vivid, unfavourable, social image of teachers. Method: To answer the question regarding how active teacher constructs their narratives about schools reality data, collected by using an online constructed questionnaire, was analysed using guidelines from a method of interpretative-phenomenological analysis. Results: Results show a negative view of work in school, symptoms of burnout, and awareness of a negative social view on teachers. Conclusions: Narratives regarding the schools reality, described by active teachers, have a pessimistic tone. In these stories a common theme is that of a negative view on work in school, some of them contain content about career burnout and an unsympathetic point of view regarding teachers in society. Qualitative studies of teachers narratives can be a way of better understanding the psychological states of teachers which could lead to implementing some sorts of changes in the work environment regarding, for example, career burnout.
Comparison of ultrasonic and other atomization methods in metal powder production
Authors: Bałasz B. , Bielecki M. , Gulbiński W. , Słoboda Ł.
Published: April 2023

The results showed that the UA powder has a finer average particle size with a narrower statistical distribution of particles than those made by the GA method. Because the UA powder has a higher sphericity and lower porosity, Generally, UA offers better-quality powders in terms of properties such as higher tap density, better flowability and low oxygen content.Ultrasonic atomization (UA) with melting raw material by an electric arc. Characterisation of the powders: particle size distribution (PSD), density, and flowability were carried out. Other parameters, such as microstructure, deviation in the chemical composition and powder surface morphology, were also investigated.The results showed that the UA powder has a finer average particle size with a narrower statistical distribution of particles than those made by the GA method. Because the UA powder has a higher sphericity and lower porosity, Generally, UA offers better-quality powders in terms of properties such as higher tap density, better flowability and low oxygen content.As an example of semi-industrial scale application of the UA system, the Ti6Al4V and TiAl powders were produced after remelting the wire. The UA system is commercially available for processing any metallic material.The test campaign results showed that the Ti6Al4V powder produced by the ultrasonic atomisation has a similar or better quality as those available from large-scale gas atomisation plants.The new method of UA powder production was analysed in terms of key powder parameters. The properties of the titanium-based powder produced this way were analysed with a view to future applications.
Safe operation of buildings during the winter period
Authors: Obolewicz J. , Baryłka A. , Szota M.
Published: April 2023

The article presents legal regulations and principles for the safe operation of buildings in winter and proposes a procedure for clearing snow from flat roofs.The Construction Law regulates the activities involving building design, construction, maintenance, and demolition and defines the operation principles of public administration bodies in these areas.The safety of buildings in the winter requires specialist knowledge and special care on the part of managers, employers, persons managing employees, and employees performing work related to their safe operation.The safe removal of snow from flat roofs requires adequate legal knowledge, skills, training, and experience on the part of employers, managers, and workers.The employer's most important obligations to employees in the case of snow clearance work on flat roofs (tantamount to work at height) include providing them with protective equipment appropriate to their position and tasks, with collective protective equipment. The employer is obliged to ensure that persons who carry out work at height are assisted by other employees who do not carry out such work directly. The employer should also ensure that workers receive instruction, taking into account, in particular, the personal division of work, the sequence of tasks to be performed, and the health and safety rules necessary for the various activities. It is also necessary to establish supervision of work at height.Employees carrying out snow clearing should have a current height examination and hold a valid (current) medical certificate of no contraindication to work at height. The employee must also receive health and safety training prior to working at height, as well as an introduction to the specifics of the job, know the potential hazards and risks, and learn to use the personal protective equipment required for the job properly.
CROSS Safety Report: Toughened glass failures
Authors:   Collaborative Reporting for Safer Structures
Published: April 2023

This month's CROSS report concerns a report that the glass produced by some processors has not been properly heat-soaked and is therefore much more likely to shatter in use.
Evaluability Assessment: Clarifying Organizational Support and Data Availability
Authors: Hare Joseph , Guetterman Timothy
Published: April 2023

Evaluability assessment (EA) emerged in the 1970s as a way to ensure a program was ready for summative evaluation.  The primary purpose was assessing the presence of measureable program objectives (Trevisan, 2007), yet evaluators conducting EA encountered difficulty with unclear, ambiguous methods (Smith, 2005).  To address this concern, the purpose of this study was to clarify two aspects of EA, organizational support and data availability.  In practice, organizational stakeholders must support the evaluation project to ensure it is pursued to completion.  In addition, the availability of operational data facilitates analysis of the evaluand effect.  This qualitative study consisted of interviews with evaluators, organizational stakeholders, and technology personnel followed by thematic analysis.  The findings indicate the importance of specific organizational and data related considerations that affect evaluability. The researchers recommend considerations that elaborate upon the existing EA framework.  The recommended evaluability considerations assist evaluators in identifying ill-advised evaluations and enhancing the likelihood of success in ongoing studies.
Institutionalization and Use of Evaluations in the Public Sector in Nepal
Authors: Dhakal Teertha Raj
Published: April 2023

This paper reviews the institutionalization process and use of evaluation evidences in the planning processes in Nepal. It reviews evaluation reports of 29 projects or programmes of various sectors conducted engaging independent evaluators during 1995-2012. It concludes that reform to effectively institutionalize and promote use of evaluations need to be implemented as a part of overall performance management and accountability reform and  the uses of evaluations increase if the evaluation system is designed as a consistent and integrated feature of the development planning process aiming to correct the entire planning cycle. Promotion of evaluation culture at various levels, securing a higher level policy commitment and addressing capacity gaps in managing evaluations are key attributes to promote utilization of evaluations. Key words: evaluation, use, performance management, Nepal
Hirschman’s Ideas as Evaluation Tools
Authors: Picciotto Robert
Published: April 2023

Background: Albert O. Hirschman, one of the most distinguished social scientist of the past half century, is not widely known within the evaluation community. Yet he practiced the art of evaluation without acknowledging it and the influential concepts that he generated are extremely valuable as evaluation tools.Purpose: The purpose of this article is to demonstrate by dint of example of example that Hirschman’s ideas illuminate the development experience; inform evaluation methods and have potential as guides to evaluation practice. Setting: Hirschman’s unique intellectual contributions to our understanding of society have recently been recognized in a flurry of publications that followed his death in 2012.Intervention: This article did not require an intervention.Research Design: Three popular Hirschman concepts are dissected and used to explore a variety of evaluation policy issues.Data Collection and Analysis: Not applicable.Findings: Hirschman’s mental constructs are interconnected; throw new light on evaluation criteria and can be used to get the most out of the evaluation function in diverse authorizing environments.
Evaluating Diversity Metrics: A Critique of the Equity Index Method
Authors: Royal Kenneth D. , Flammer Keven
Published: April 2023

Background: Evaluating diversity, inclusivity, and equity remains both a prevalent topic in education and a difficult challenge for most evaluators. Traditional metrics used to evaluate these constructs include questionnaires, focus groups, and anonymous comment solicitations. While each of these approaches offer value, they also possess a number of limitations (e.g., self-reported nature, holistic perspective, social desirability bias, varying degrees of respondent sensitivity, representative responses, etc.). Researchers at the University of Southern California have successfully utilized the Equity Index Method (EIM) as a potential approach for measuring diversity and reporting diversity-related outcomes. Purpose: Provide a critique of the EIM and discusses how the EIM could be improved and extended to other evaluation contexts and settings. Setting: Not Applicable. Intervention: Not Applicable. Research Design: Not Applicable. Data Collection and Analysis: Not Applicable. Findings: Despite the potential for problems with interpretations based on small samples and subgroups and some concerns about semantics involving the term “equity”, we believe the EIM possesses a number of strengths that many evaluators will find useful. We encourage other evaluators to consider this method and explore its utility in a variety of contexts. Keywords: equity; equity index method; applications.
The "Usability" of Evaluation Reports: A Precursor to Evaluation Use in Government Organizations
Authors: Bourgeois Isabelle , Naré Clémence
Published: April 2023

Background: According to the Treasury Board of Canada’s Policy on Evaluation (2009), evaluations produced by federal government departments must contribute to decision-making at an organizational level (mainly summative) as well as a program level (mainly formative). Previous research shows that although the formative objectives of evaluation are generally reached, the use of evaluation for broader, budgetary management is limited. However, little research has been conducted thus far on this issue. Purpose: This study investigates the extent to which program evaluation is used in the Canadian federal government for budgetary management purposes. Setting: This paper outlines the results obtained following the first component of a two-pronged research strategy focusing on evaluation use in Canadian federal government organizations. Intervention: N/A Research Design: Two federal agencies were recruited to participate in organizational case studies aiming to identify the factors that facilitate the use of evaluation for budgetary reallocation exercises. Data Collection and Analysis: This report presents the findings from a detailed analysis of evaluation reports published by both agencies between 2010-2013. The data were collected from public evaluation reports and analyzed using NVivo. Findings: The preliminary findings of the study show that instrumental use has occurred or can be expected to occur, based on the types of recommendations outlined in the reports reviewed and on the responses to the evaluations produced by program managers. Keywords: evaluation use; organizational evaluation capacity; instrumental use; evaluation reports; Canadian federal government; document review; organizational decision-making.
Mindful Evaluation: Cultivating Our Ability to Be Reflexive and Self-Aware
Authors: Cullen Puente Anne , Bender April
Published: April 2023

Background: Mindfulness, giving our full attention to what we are doing in the present moment, is perhaps best understood as training for the brain. When we are mindful, we are actively engaged with our thoughts, feelings, and sensations. Purpose: The purpose of this article is to introduce the concept of “mindful evaluation” as a way to cultivate our reflexivity and self-awareness to improve our evaluation practice. Mindful evaluation is an invitation to be more intentional and reflexive about our ontological, epistemological, and methodological assumptions in general as well as for each evaluation we undertake. Setting: Mindfulness has been gaining popularity both with the general public and a variety of professional disciplines thanks in large part to the growing body of research on its efficacy. As disciplines such as healthcare, economics, and education are incorporating the benefits of mindfulness in their work, we explore how we too might use the principles of mindfulness in evaluation and evaluation practice. Intervention: This article did not require an intervention. Research Design: Not applicable Data Collection and Analysis: Not applicable Findings: We present simple steps for incorporating the principles of mindfulness to how we approach evaluation. Keywords: mindfulness; reflective practice; evaluator competence.
Enhancing the Strategic Management Process Through the Use of Professional Evaluation Methods and the Logic of Evaluation
Authors: Persaud Nadini , Woodhouse Michelle , Scriven Michael
Published: April 2023

Background: The evaluation discipline has the potential to enhance other disciplines by integrating evaluation specific methodologies and logic into processes within other disciplines and improving/strengthening the manner in which evaluation of processes, programs and policies are carried out. Purpose: This paper will highlight the evaluative nature of one of the most popular strategic management models (SMM) in corporate America, namely, Fred David’s (2013) SMM, and examine how professional evaluation logic and methodology can be used to improve David's SMM. Setting: NA Intervention: NA Research Design: The paper will make a comparative analysis between Michael Scriven's Key Evaluation Checklist (KEC) and David's SMM and highlight similarities and differences between the two models. Data Collection and Analysis: NA Findings: The paper will conclude by providing several suggestions to enhance and strengthen David's SMM to make it more robust, valuable, and useful in the business environment.
The World of Evaluation: Challenges Faced by Student Evaluators
Authors: Billings Meghan
Published: April 2023

Background: Performing a high profile evaluation in a world-class organization is a daunting experience for any professional program evaluator. As a student evaluator, it is more than just formidable it has distinctive challenges. Fortunately, professional undertakings provide student evaluators with the experience and tools to overcome these early tests with continuing practice.
Purpose: This paper discusses the challenges that student evaluators face in performing their first program evaluation project. It will draw from the experience of one student’s first major evaluation project and current, but limited, research on the subject.
Setting: N/A
Intervention: NA
Research Design:  This paper will examine the broad-spectrum of challenges that student evaluators experience in their first assignment referencing as a case study an actual evaluation of a hospital risk-assessment program implementation.
Data Collection and Analysis: Literature review and documented evaluator experiences.
Findings: This paper will conclude with a discussion of possible mitigation strategies to overcome these student evaluator challenges.
Communicating About Evaluation: A Conceptual Model and Case Example
Authors: Montrosse-Moorhead Bianca , Bellara Aarti P. , Gambino Anthony J.
Published: April 2023

Background: Despite consensus within the evaluation community about what is distinctive about evaluation, confusion among stakeholders and other professions abounds. The evaluation literature describes how those in the social sciences continue to view evaluation as applied social science and part of what they already know how to do, with the implication that no additional training beyond the traditional social sciences is needed. Given the lack of broader understanding of the specialized role of evaluation, the field struggles with how best to communicate about evaluation to stakeholders and other professions.
Purpose: This paper addresses the need to clearly communicate what is distinctive about evaluation to stakeholders and other professions by offering a conceptual tool that can be used in dialogue with others. Specifically, we adapt a personnel evaluation framework to map out what is distinctive about what evaluators know and can do. We then compare this map with the knowledge and skill needed in a related profession (i.e., assessment) in order to reveal how the professions differ. 
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: We argue that using a conceptual tool such as the one presented in this paper with comparative case examples would clarify for outsiders the distinct work of evaluators. Additionally, we explain how this conceptual tool is flexible and could be extended by evaluation practitioners in a myriad of ways.
Raising Aid Efficiency with International Development Aid Monitoring and Evaluation Systems
Authors: Boehmer Hans Martin , Zaytsev Yury K.
Published: April 2023

Background: Since the adoption of the Millennium Development Goals (MDGs), or more specifically perhaps the Monterrey Consensus, there has been a distinct shift in the conversation around assessing the development effectiveness of international aid programs.  Initially, the focus had been on establishing monitoring and evaluation systems that served the needs to bilateral and multilateral donors to demonstrate the effectiveness of their assistance vis-à-vis their own constituencies. Today, there is an increasing recognition that recipient countries should be equally concerned with the effectiveness of donor resources as they are with the use of national resources devoted to development programs. 

 

Purpose: This article reveals the current efforts of the sovereign new and traditional donors in establishing and operationalizing the international development assistance (IDA) monitoring and evaluation (M&E) systems to raise the efficiency of IDA programs.

 

Setting: N/A

 

Intervention: N/A

 

Research Design: A review of previous studies and international practicies of IDA M&E.

 

Data Collection and Analysis: Employing game theory the authors identify the choice of particular IDA M&E system by traditional and new donors and analyze key elements and factors affecting M&E systems operationalization. They elaborate a set of policy recommendations on how to use M&E systems both in donor and recipient countries to raise aid effectiveness.

 

Findings: The authors conclude that in spite of donor and recipient countries having different purposes and approaches in implementing IDA projects, the use of the M&E is usually helpful to bridge their interests and to increase aid effectiveness.
Big Shoes to Fill: An Evaluation Journey in the Footsteps of Daniel L. Stufflebeam
Authors: Camilli Sherrie-Ann
Published: April 2023

Background: Evaluation has evolved remarkably since the early 1960s, largely due to the innovative contributions of Daniel Stufflebeam and his colleagues. As a pioneer of evaluation methods, some of the notable achievements arising from Stufflebeam’s work include the context-input-process-product (CIPP) model, evaluation standards, and evaluation checklists.  

 

Purpose: The purpose of this paper is to explore Daniel Stufflebeam’s journey beginning with the early days of evaluation through to his retirement and unfortunate passing at 80 years old in 2017. Key features of the CIPP model are considered within a context of other popular models for comparison with the goal of finding relevance for use of CIPP evaluation in education settings.

 

Setting: Not applicable.

 

Intervention: Not applicable.

 

Research Design: Literature review.

 

Data Collection and Analysis: Not applicable.

 

Findings: Stufflebeam’s CIPP model and evaluation standards remain prominent in evaluation practices and his legacy will lay the foundation for future evaluators through continued professional development.
Equity Implications in Evaluating Development Aid: The Italian Case
Authors: Forestieri Marina
Published: April 2023

Background: In the field of development aid, social equity is an emerging issue that concerns the evaluation community in its theoretical and practical dimensions.

Purpose: A widely held belief is that evaluators do not apply theory. In this paper, we intend to verify this statement about equity in the field of cooperation projects.

Setting: Not applicable.

Intervention: Not applicable.

Research Design: We considered equity-focused approaches and found three common factors: stakeholder participation, attention to context, and focus on marginalized groups. These elements operate as screening criteria in identifying equity issues in a case study.

Data Collection and Analysis: The paper examines a practical experience of Italian cooperation. This involved a review of evaluations reports completed between 2013 and 2014. The reports are analyzed according to the three screening criteria.

Findings: The use of the three criteria has proved its worth in grasping the issues of equity neglected and often not recognized in reports. Once again a gap emerges between theory and practice. The availability of theoretical approaches is not sufficient. The paper, therefore, proposes a reflection on the responsibility of evaluation towards social justice.

Keywords: social equity; development aid; theory and practice gap.
Monitoring and Cost-Effectiveness in Development Management
Authors: Clements Paul
Published: April 2023

I would like to argue that the tasks undertaken by the large multilateral and bilateral donor agencies require a particularly high analytic standard, but several incentives that influence development practice—political incentives for donor and recipient governments, organizational incentives for development agencies, and personal incentives for managers—have led to positive bias and analytic compromise.
The central challenge in the management of development assistance is to maintain this kind of consciousness—this analytic perspective—among the corps of professional staff. Some might like to think that development can be achieved by getting governments to liberalize markets or by getting local participation in project management, and these may well be important tactics. Intuition suggests and experience teaches, however, that there can be no formula for successful development. Each investment presents a unique design and management challenge. There are two problems in maintaining the will and the capacity toaddress this challenge: an incentive problem and one we can call intellectual or cognitive. The key to solving both problems, or so I will argue, is strong evaluation.
Taking Evaluation Contexts Seriously: A Cross-Cultural Evaluation in Extreme Unpredictability
Authors: Laperrière Hélène N.
Published: April 2023

The following paper details the evaluation of a public health education project in the state of Maine. Evaluation of education projects presents a challenge, in that the effects of the intervention are not easy to trace and outside influences difficult to impossible to control. This study approached this difficult issue at the start by focusing on one variable for which data are readily available (namely blood lead testing rates). The evaluation was further enhanced by use of a model called "RE- AIM", which measures the reach, efficacy, adoption, implementation and maintenance of educational projects (Glasgow, et.al. 1999). Measurements centered on data tracked through newly created databases and focused on elements directly attributable to the project (i.e. behavior of medical personnel trained through project activities). Finally, small focus groups and interactions with families served by the program were used to derive qualitative data that provided a broader perspective on the success of activities. As the program ultimately seeks to entirely eliminate childhood lead poisoning, this paper concludes with a discussion of areas that continue to need attention for future education projects.
The Transdisciplinary Model of Evaluation
Authors: Coryn Chris L. S. , Hattie John A.
Published: April 2023

The transdisciplinary view, or model, of evaluation requires an understanding of how and why evaluation developed from a practice to a highly skilled, professional practice to a field-specific discipline, and finally to an autonomous discipline and transdiscipline, much like ethics, statistics, and measurement (Scriven, 2003). This understanding becomes known from the transdisciplinary model’s three primary characteristics that make it a transdiscipline, which are: epistemological;political; and disciplinary (Scriven, 1993).
Are National-Level Research Evaluation Models Valid, Credible, Useful, Cost-Effective, and Ethical?
Authors: Coryn Chris L. S. , Scriven Michael
Published: April 2023

The evaluation of government-financed research has become increasingly important in the last few decades in terms of increasing the quality of, and payoff from, the research that is done, reducing the cost of doing it, and lending public credibility to the manner in which research is funded. But there are very large differences throughout the world in the extent to which systems used promote these results. This paper briefly presents the dimensional results of a study designed to comparatively evaluate the national-level research evaluation models in sixteen countries on five merit-defining dimensions.
Responsibility of Educational Institutions for Strategic Change
Authors: Rebolloso Enrique , Fernández-Ramírez Baltasar , Cantón Pilar
Published: April 2023

The Spanish university is well into its nth reform process, this time for the purpose of improving its legibility for members of the European Union under the extended Bologna Process. The reform involves a structural change in plans of study, as well as a cultural change to the Europeanist discourse, which mixes mercantilist values and defence of a fuzzy social orientation as public service in a difficult balance. Goals such as professionalization of degrees, meeting social demands and requirements, and widening the student base to include professionals who wish to continue their education are being pursued in different ways and with different intensities by national systems and centres of higher education. Evaluation, as a decision-making instrument, plays a key role in innovation and improvement and determining the direction of the changes (the goals) and the rhythm of change (process control). Evaluation is inserted in a model of strategic thought or of directed strategic change, which requires discussion by system stakeholders to define the future of higher education institutions. Some results of a recent metaevaluation of the institutional evaluation system employed in Spanish Andalusian universities show the difficulties in strategic change, assuming instead a legitimist model, in which our approximation to the models of other European university systems is pursued with a pronounced isomorphic character.
Understanding Opportunity Costs and the Economist’s View: A Response to Scriven's "The Economist's Fallacy"
Authors: Watts Brad R.
Published: April 2023

Of course, the concept of opportunity costs has generally remained in the domain of economists and its understanding and acceptance are not universal in other fields, including evaluation. Indeed, in the last issue of the Journal of Multidisciplinary Evaluation (JMDE), Michael Scriven spoke out against the use of opportunity costs in evaluation. Unfortunately, what may appear to Scriven to be flaws of logic and utility in the economists’ concept of cost are the result of some common misunderstandings about what a “cost” is—at least in terms of how economists use the term. However, I believe that the points raised by Scriven can be either corrected or clarified in a way that will illustrate why opportunity costs are a useful and important concept for evaluators.