Reviewerly/exHarmony huggingface dataset:
Pengembangan Aplikasi Audit Satuan Pengawasan Internal UIN Sunan Kalijaga Yogyakarta

In carrying out internal supervision duties, SPI UIN Sunan Kalijaga Yogyakarta innovates by carrying out digital document-based supervision using the Google Drive service. SPI auditors often felt problems in using Google Drive, namely having to check the completeness of financial accountability documents manually one by one by opening a file on Google Drive. One of the goals of developing this application is to facilitate SPI auditors in checking the completeness of financial accountability report documents. The problems can be solved by creating an audit application. The audit application has been developed using the FAST method. Central admin, SPI admin, operator, superior operator, auditor, team leader, technical controller, and Head of SPI are user access rights in this application. The developed application has met the minimum requirements of SPI UIN Sunan Kalijaga Yogyakarta. Other universities can adopt this application.
The Relationship between Course Evaluation and Academic Achievement of University Students Using Latent Profile Analysis

This study was conducted with the purpose of deriving a heterogeneous potential profile through the results of university lecture evaluation, which is students' perception of class and the product of professor-student interaction in the classroom, and identified the factors that affect it. In addition, the degree of learning flow for each potential profile was investigated and the difference was verified. For the analysis, 83,069 cases were used because of the university A course evaluation organized in the second semester of 2020, and a total of 12,919 subjects were studied. As a result of analyzing the aspects of course evaluation through class plan, content delivery, communication, response, and evaluation system, that were the sub-factors of course evaluation, the miscellaneous material profiles were classified in four. It was named as the upper group. As factors determining the latent profile using physiological data analysis. It was discovered that significant differences existed between student features (grade, major field), professor features (position), and lecture variables (category of accomplishment, lecture size). Students with lesser grades have a greater chance of succeeding quickly in the top group than do those in the humanities and social sciences, science, or engineering professions. The likelihood of being in the upper group in a course assessment as well as the likelihood of being in the upper group with higher course evaluation outcomes for general education lectures as opposed to major lectures and smaller lecture sizes increases with decreasing professor status. The level of academic obligation was then examined by potential profile based on the course evaluation outline, and the results revealed that the greater the course evaluation result, the greater the level of educational obligation. This is a significant study because it examines the variables that affect the outcomes of the university's course evaluations, which are done at the end of every semester, as well as the relationship between the outcomes of the course evaluations and academic commitment. This study established a scientific basis for colleges to prepare measures to improve the quality of education through lecture evaluation and emphasized the importance of preparing concrete measures to improve students' learning outcomes in college education.
GAMBARAN KONDISI SANITASI SALURAN AIR LIMBAH DAN JAMBAN DI PASAR SEGIRI KOTA SAMARINDA

Traditional markets in Indonesia still have many problems both in terms of market management to market sanitation. Every activity in the market is mostly bound to produce wastewater, usually the most wastewater comes from meat and fish stalls because it uses a lot of water for washing, then wastewater also comes from MCK activities. The state of the market in samarinda city is still concerning in terms of sanitation, especially in terms of wastewater management and latrines. The purpose of this study is to find out an overview of the sanitary condition of wastewater drains and an overview of the sanitary condition of latrines in the Segiri Market, Samarinda City. The method used is to use descriptive qualitative. The results of the study based on the results of data collection carried out on wastewater channels in 15 los in Segiri Market, using observation sheets obtained the results of 8 qualified drainages and 7 unqualified drainages, based on the results of data collection carried out on latrines in 15 los in Segiri Market, using observation sheets obtained the results of 13 latrines qualified and 2 latrines were not qualified. The conclusion on the sewerage is that there are still many unqualified channels while for latrines it is quite good and many are qualified.
Text Analysis of Poem " Ibu" by D. Zamawi Imron in Indonesian Language High School’s Textbooks

This research aims to analyze one of the poems by D. Zamawi Imron to identify the relationship between readings and aspects that lie outside the readings. He told me about the creation of this poem. When he asked permission from his mother to go abroad to seek knowledge. The theory used is Critical Discourse Analysis modeled on Teun A. Van Dijk which has 3 dimensions: Reading Analysis, Social Cognition, and Social Analysis. There are also procedures used which are qualitative research procedures, with a critical paradigm. The object of this research was reading the poem "Ibu". Research information was obtained from an Indonesian language textbook for class X according to the 2013 curriculum. The research results included 3 AWK measures according to the van Dijk model: Reading analysis which has 3 aspects in it. On the macro structure, the poem has the theme of mother's love and sacrifice for her child and the child who wants to serve her mother. Superstructure, arrangement of stanza by stanza that alternates. Micro structure, which has detailed elements, intention, lexicon, metaphor, sentence form, and pronouns. Social cognition which deals with the poet's individual condition overrides his judgment of a child who shows love and affection to his mother. Evaluate Zamawi Imron's position, as well as how to control the events around him. Lastly is Social Analysis, where the bond between child and mother, the child realizes how much he misses his mother, how much love and sacrifice his mother gave him and the will of the child who wants to share the best service for his mother.
PENINGKATAN HASIL BELAJAR BAHASA INDONESIA MENGGUNAKAN MODEL PBL BERBANTUAN BOOKLET PADA SISWA KELAS 1 SDN PURWANTORO 2

The low learning outcomes of Indonesian students are due to the fact that the learning that is implemented still applies teacher-centered learning. Student involvement in learning Indonesian is still minimal, so a form of learning is needed that is able to make students more active in participating in learning activities and can improve the learning outcomes of the Indonesian language. This classroom action research aims to improve Indonesian language learning outcomes through a booklet-assisted problem based learning (PBL) learning model for grade 1 students at SDN Purwantoro 2, Blimbing District, Malang City. This research was conducted in two cycles, each cycle consisting of four stages, namely planning, implementing, observing, and reflecting. The research subjects were class 1B students at SDN Purwantoro 2 which consisted of 23 students. Data collection in this study was carried out using the test method, with the type of test being an essay. The study experienced an increase in achievement in each aspect of the indicators from cycle one to cycle two. The results showed that the application of the booklet-assisted PBL model in the second cycle was able to significantly improve students' Indonesian learning outcomes. This can be seen from the comparison before and after the action is taken. In the early stages, cycle I showed 15 students or 65% who successfully completed learning. But in cycle II, the number of students who passed increased to 21 students or 91%. In addition, the results of class observations showed that students were more involved, motivated, and active in the learning process during the booklet-assisted PBL activities. Overall, this study also emphasizes the importance of integrating problem-solving activities and collaborative learning in the classroom to improve student learning outcomes.
On the Generalization of Diffusion Model

The diffusion probabilistic generative models are widely used to generate high-quality data. Though they can synthetic data that does not exist in the training set, the rationale behind such generalization is still unexplored. In this paper, we formally define the generalization of the generative model, which is measured by the mutual information between the generated data and the training set. The definition originates from the intuition that the model which generates data with less correlation to the training set exhibits better generalization ability. Meanwhile, we show that for the empirical optimal diffusion model, the data generated by a deterministic sampler are all highly related to the training set, thus poor generalization. This result contradicts the observation of the trained diffusion model's (approximating empirical optima) extrapolation ability (generating unseen data). To understand this contradiction, we empirically verify the difference between the sufficiently trained diffusion model and the empirical optima. We found, though obtained through sufficient training, there still exists a slight difference between them, which is critical to making the diffusion model generalizable. Moreover, we propose another training objective whose empirical optimal solution has no potential generalization problem. We empirically show that the proposed training objective returns a similar model to the original one, which further verifies the generalization ability of the trained diffusion model.
ECHo: A Visio-Linguistic Dataset for Event Causality Inference via Human-Centric Reasoning

We introduce ECHo (Event Causality Inference via Human-Centric Reasoning), a diagnostic dataset of event causality inference grounded in visio-linguistic social scenarios. ECHo employs real-world human-centric deductive information building on a television crime drama. ECHo requires the Theory-of-Mind (ToM) ability to understand and reason about social interactions based on multimodal information. Using ECHo, we propose a unified Chain-of-Thought (CoT) framework to assess the reasoning capability of current AI systems. Our ToM-enhanced CoT pipeline accommodates various large foundation models in both zero-shot and few-shot visio-linguistic reasoning. We use this framework to scrutinize recent large foundation models such as InstructGPT and MiniGPT-4 on three diagnostic human-centric tasks. Further analysis demonstrates ECHo as a challenging dataset to expose imperfections and inconsistencies in reasoning. Our data and code are publicly available at https://github.com/YuxiXie/ECHo.
EgoVSR: Towards High-Quality Egocentric Video Super-Resolution

Due to the limitations of capture devices and scenarios, egocentric videos frequently have low visual quality, mainly caused by high compression and severe motion blur. With the increasing application of egocentric videos, there is an urgent need to enhance the quality of these videos through super-resolution. However, existing Video Super-Resolution (VSR) works, focusing on third-person view videos, are actually unsuitable for handling blurring artifacts caused by rapid ego-motion and object motion in egocentric videos. To this end, we propose EgoVSR, a VSR framework specifically designed for egocentric videos. We explicitly tackle motion blurs in egocentric videos using a Dual Branch Deblur Network (DB$^2$Net) in the VSR framework. Meanwhile, a blurring mask is introduced to guide the DB$^2$Net learning, and can be used to localize blurred areas in video frames. We also design a MaskNet to predict the mask, as well as a mask loss to optimize the mask estimation. Additionally, an online motion blur synthesis model for common VSR training data is proposed to simulate motion blurs as in egocentric videos. In order to validate the effectiveness of our proposed method, we introduce an EgoVSR dataset containing a large amount of fast-motion egocentric video sequences. Extensive experiments demonstrate that our EgoVSR model can efficiently super-resolve low-quality egocentric videos and outperform strong comparison baselines. Our code, pre-trained models and data can be found at https://github.com/chiyich/EGOVSR/.
Confidential Truth Finding with Multi-Party Computation (Extended Version)

Federated knowledge discovery and data mining are challenged to assess the trustworthiness of data originating from autonomous sources while protecting confidentiality and privacy. Truth-finding algorithms help corroborate data from disagreeing sources. For each query it receives, a truth-finding algorithm predicts a truth value of the answer, possibly updating the trustworthiness factor of each source. Few works, however, address the issues of confidentiality and privacy. We devise and present a secure secret-sharing-based multi-party computation protocol for pseudo-equality tests that are used in truth-finding algorithms to compute additions depending on a condition. The protocol guarantees confidentiality of the data and privacy of the sources. We also present variants of truth-finding algorithms that would make the computation faster when executed using secure multi-party computation. We empirically evaluate the performance of the proposed protocol on two state-of-the-art truth-finding algorithms, Cosine, and 3-Estimates, and compare them with that of the baseline plain algorithms. The results confirm that the secret-sharing-based secure multi-party algorithms are as accurate as the corresponding baselines but for proposed numerical approximations that significantly reduce the efficiency loss incurred.
Getting MoRE out of Mixture of Language Model Reasoning Experts

While recent large language models (LLMs) improve on various question answering (QA) datasets, it remains difficult for a single model to generalize across question types that require distinct reasoning abilities. We provide empirical evidence that state-of-the-art LLMs suffer from poor generalizability on reasoning types beyond those seen in the prompt. To remedy this, we propose a Mixture-of-Reasoning-Experts (MoRE) framework that ensembles diverse specialized language models. We specialize the backbone language model with prompts optimized for different reasoning categories, including factual, multihop, mathematical, and commonsense reasoning. Our key insight is to leverage agreement among the specialized experts to select the best answer for each question, or to abstain from answering. This gives MoRE higher accuracy than any single specialized model on a collection of 12 QA datasets from four reasoning types. Beyond generalizability, the interpretable design of MoRE improves selective question answering results compared to baselines without incorporating inter-expert agreement. This framework is also more interpretable and useful to human consumers of QA outputs. Our human study confirms that presenting expert predictions and the answer selection process helps annotators more accurately calibrate when to trust the system's output. We release all code and data to facilitate future work.
BinaryViT: Towards Efficient and Accurate Binary Vision Transformers

Vision Transformers (ViTs) have emerged as the fundamental architecture for most computer vision fields, but the considerable memory and computation costs hinders their application on resource-limited devices. As one of the most powerful compression methods, binarization reduces the computation of the neural network by quantizing the weights and activation values as $\pm$1. Although existing binarization methods have demonstrated excellent performance on Convolutional Neural Networks (CNNs), the full binarization of ViTs is still under-studied and suffering a significant performance drop. In this paper, we first argue empirically that the severe performance degradation is mainly caused by the weight oscillation in the binarization training and the information distortion in the activation of ViTs. Based on these analyses, we propose $\textbf{BinaryViT}$, an accurate full binarization scheme for ViTs, which pushes the quantization of ViTs to the limit. Specifically, we propose a novel gradient regularization scheme (GRS) for driving a bimodal distribution of the weights to reduce oscillation in binarization training. Moreover, we design an activation shift module (ASM) to adaptively tune the activation distribution to reduce the information distortion caused by binarization. Extensive experiments on ImageNet dataset show that our BinaryViT consistently surpasses the strong baseline by 2.05% and improve the accuracy of fully binarized ViTs to a usable level. Furthermore, our method achieves impressive savings of 16.2$\times$ and 17.7$\times$ in model size and OPs compared to the full-precision DeiT-S.
Mastering the ABCDs of Complex Questions: Answer-Based Claim Decomposition for Fine-grained Self-Evaluation

When answering complex questions, large language models (LLMs) may produce answers that do not satisfy all criteria of the question. While existing self-evaluation techniques aim to detect if such answers are correct, these techniques are unable to determine which criteria of the question are satisfied by the generated answers. To address this issue, we propose answer-based claim decomposition (ABCD), a prompting strategy that decomposes questions into a series of true/false claims that can be used to verify which criteria of the input question an answer satisfies. Using the decomposed ABCD claims, we perform fine-grained self-evaluation. Through preliminary experiments on three datasets, including a newly-collected challenge dataset ObscureQA, we find that GPT-3.5 has some ability to determine to what extent its answer satisfies the criteria of the input question, and can give insights into the errors and knowledge gaps of the model.
Using Natural Language Explanations to Rescale Human Judgments

The rise of large language models (LLMs) has brought a critical need for high-quality human-labeled data, particularly for processes like human feedback and evaluation. A common practice is to label data via consensus annotation over crowdworker judgments. However, annotators' judgments for subjective tasks can differ in many ways: they may have different qualitative judgments about an example, and they may map those to a labeling scheme in different ways. We show that these nuances can be captured by natural language explanations, and propose a method to rescale ordinal annotations and explanations using LLMs. Specifically, we feed annotators' Likert ratings and corresponding explanations into an LLM and prompt it to produce a numeric score anchored in a scoring rubric. These scores should reflect the annotators' underlying assessments of the example. The rubric can be designed or modified after annotation, and include distinctions that may not have been known when the original error taxonomy was devised. We explore our technique in the context of rating system outputs for a document-grounded question answering task, where LLMs achieve near-human performance. Our method rescales the raw judgments without impacting agreement and brings the scores closer to human judgments grounded in the same scoring rubric.
IBCL: Zero-shot Model Generation for Task Trade-offs in Continual Learning

Like generic multi-task learning, continual learning has the nature of multi-objective optimization, and therefore faces a trade-off between the performance of different tasks. That is, to optimize for the current task distribution, it may need to compromise performance on some previous tasks. This means that there exist multiple models that are Pareto-optimal at different times, each addressing a distinct task performance trade-off. Researchers have discussed how to train particular models to address specific trade-off preferences. However, existing algorithms require training overheads proportional to the number of preferences -- a large burden when there are multiple, possibly infinitely many, preferences. As a response, we propose Imprecise Bayesian Continual Learning (IBCL). Upon a new task, IBCL (1) updates a knowledge base in the form of a convex hull of model parameter distributions and (2) obtains particular models to address task trade-off preferences with zero-shot. That is, IBCL does not require any additional training overhead to generate preference-addressing models from its knowledge base. We show that models obtained by IBCL have guarantees in identifying the Pareto optimal parameters. Moreover, experiments on standard image classification and NLP tasks support this guarantee. Statistically, IBCL improves average per-task accuracy by at most 23% and peak per-task accuracy by at most 15% with respect to the baseline methods, with steadily near-zero or positive backward transfer. Most importantly, IBCL significantly reduces the training overhead from training 1 model per preference to at most 3 models for all preferences.
PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts

Perceiving multi-modal information and fulfilling dialogues with humans is a long-term goal of artificial intelligence. Pre-training is commonly regarded as an effective approach for multi-modal dialogue. However, due to the limited availability of multi-modal dialogue data, there is still scarce research on multi-modal dialogue pre-training. Yet another intriguing challenge emerges from the encompassing nature of multi-modal dialogue, which involves various modalities and tasks. Moreover, new forms of tasks may arise at unpredictable points in the future. Hence, it is essential for designed multi-modal dialogue models to possess sufficient flexibility to adapt to such scenarios. This paper proposes \textbf{PaCE}, a unified, structured, compositional multi-modal dialogue pre-training framework. It utilizes a combination of several fundamental experts to accommodate multiple dialogue-related tasks and can be pre-trained using limited dialogue and extensive non-dialogue multi-modal data. Furthermore, we propose a progressive training method where old experts from the past can assist new experts, facilitating the expansion of their capabilities. Experimental results demonstrate that PaCE achieves state-of-the-art results on eight multi-modal dialog benchmarks.
SWAMP: Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning

Given the ever-increasing size of modern neural networks, the significance of sparse architectures has surged due to their accelerated inference speeds and minimal memory demands. When it comes to global pruning techniques, Iterative Magnitude Pruning (IMP) still stands as a state-of-the-art algorithm despite its simple nature, particularly in extremely sparse regimes. In light of the recent finding that the two successive matching IMP solutions are linearly connected without a loss barrier, we propose Sparse Weight Averaging with Multiple Particles (SWAMP), a straightforward modification of IMP that achieves performance comparable to an ensemble of two IMP solutions. For every iteration, we concurrently train multiple sparse models, referred to as particles, using different batch orders yet the same matching ticket, and then weight average such models to produce a single mask. We demonstrate that our method consistently outperforms existing baselines across different sparsities through extensive experiments on various data and neural network structures.