Reviewerly/exHarmony huggingface dataset:
Efficient Equivariant Transfer Learning from Pretrained Models

Efficient transfer learning algorithms are key to the success of foundation models on diverse downstream tasks even with limited data. Recent works of Basu et al. (2023) and Kaba et al. (2022) propose group averaging (equitune) and optimization-based methods, respectively, over features from group-transformed inputs to obtain equivariant outputs from non-equivariant neural networks. While Kaba et al. (2022) are only concerned with training from scratch, we find that equitune performs poorly on equivariant zero-shot tasks despite good finetuning results. We hypothesize that this is because pretrained models provide better quality features for certain transformations than others and simply averaging them is deleterious. Hence, we propose {\lambda}-equitune that averages the features using importance weights, {\lambda}s. These weights are learned directly from the data using a small neural network, leading to excellent zero-shot and finetuned results that outperform equitune. Further, we prove that {\lambda}-equitune is equivariant and a universal approximator of equivariant functions. Additionally, we show that the method of Kaba et al. (2022) used with appropriate loss functions, which we call equizero, also gives excellent zero-shot and finetuned performance. Both equitune and equizero are special cases of {\lambda}-equitune. To show the simplicity and generality of our method, we validate on a wide range of diverse applications and models such as 1) image classification using CLIP, 2) deep Q-learning, 3) fairness in natural language generation (NLG), 4) compositional generalization in languages, and 5) image classification using pretrained CNNs such as Resnet and Alexnet.
Efficient Modeling of Quasi-Periodic Data with Seasonal Gaussian Process

Quasi-periodicity refers to a pattern in a function where it appears periodic but has evolving amplitudes over time. This is often the case in practical settings such as the modeling of case counts of infectious disease or the carbon dioxide (CO2) concentration over time. In this paper, we introduce a class of Gaussian processes, called seasonal Gaussian Processes (sGP), for model-based inference of such quasi-periodic behavior. We illustrate that the exact sGP can be efficiently fit within $O(n)$ time using its state space representation for equally spaced locations. However, for large datasets with irregular spacing, the exact approach becomes computationally inefficient and unstable. To address this, we develop a continuous finite dimensional approximation for sGP using the seasonal B-spline (sB-spline) basis constructed by damping B-splines with sinusoidal functions. We prove that the proposed approximation converges in distribution to the true sGP as the number of basis functions increases, and show its superior approximation quality through numerical studies. We also provide a unified and interpretable way to define priors for the sGP, based on the notion of predictive standard deviation (PSD). Finally, we implement the proposed inference method on several real data examples to illustrate its practical usage.
Mitigating Group Bias in Federated Learning: Beyond Local Fairness

The issue of group fairness in machine learning models, where certain sub-populations or groups are favored over others, has been recognized for some time. While many mitigation strategies have been proposed in centralized learning, many of these methods are not directly applicable in federated learning, where data is privately stored on multiple clients. To address this, many proposals try to mitigate bias at the level of clients before aggregation, which we call locally fair training. However, the effectiveness of these approaches is not well understood. In this work, we investigate the theoretical foundation of locally fair training by studying the relationship between global model fairness and local model fairness. Additionally, we prove that for a broad class of fairness metrics, the global model's fairness can be obtained using only summary statistics from local clients. Based on that, we propose a globally fair training algorithm that directly minimizes the penalized empirical loss. Real-data experiments demonstrate the promising performance of our proposed approach for enhancing fairness while retaining high accuracy compared to locally fair training methods.
Model-based Validation as Probabilistic Inference

Estimating the distribution over failures is a key step in validating autonomous systems. Existing approaches focus on finding failures for a small range of initial conditions or make restrictive assumptions about the properties of the system under test. We frame estimating the distribution over failure trajectories for sequential systems as Bayesian inference. Our model-based approach represents the distribution over failure trajectories using rollouts of system dynamics and computes trajectory gradients using automatic differentiation. Our approach is demonstrated in an inverted pendulum control system, an autonomous vehicle driving scenario, and a partially observable lunar lander. Sampling is performed using an off-the-shelf implementation of Hamiltonian Monte Carlo with multiple chains to capture multimodality and gradient smoothing for safe trajectories. In all experiments, we observed improvements in sample efficiency and parameter space coverage compared to black-box baseline approaches. This work is open sourced.
Influence of Work Culture on Organizational Performance in Rwanda: A Case of Economic Policy Research Network

Work culture has long been regarded as a significant component of a wide range of organizational processes, personnel, and performance. It has also served as a vital connection to bind diverse corporate cultures in the corporate group structure. This descriptive assessed the influence of work culture on organizational performance, data collected were cross-sectional. The total population was 302 and the sample size was 177 calculated using Yamane formula. Both stratified and purposive sampling techniques were employed. Statistical Package for Social Science (SPSS) was used to analyze quantitative data while qualitative data were analyzed using content analysis. With respect to the specific objective of the study, after collecting data, cleaning, and interpreting, the findings indicated that regarding to the influence of ethics-driven work culture on organizational performance. The majority 115 out of 177 or 65% concurred that having certain values as a work-driven culture in an organization influences organizational performance. Respondents supported the findings by saying organizations with values that become a work-driven culture motivate their employees to always take the right decisions. Likewise, 77 out of 177 and represented by 43.5% asserted that setting norms in an organization influences organizational performance. Regarding to the influence of technology-driven work culture on organizational performance. The findings showed about 117 (66.1%), and 113 (63.8%) respectively strongly agreed that automating organizational services and fostering organizational services online significantly contribute to organizational performance. Concerning to the influence of M&amp;E on organizational performance, 53.7% strongly agree that acknowledging the feedback of organization stakeholders influences organizational performance. Above all, the findings demonstrated that a combination of ethics-driven work culture, technology-driven work culture, and M&amp;E-driven work culture contributes up to 72% to organizational performance. Moreover, correlation analysis showed that there is positive relationship between ethics, technology, and M&amp;E-driven work culture with organizational performance. However, technology-driven work culture and M&amp;E-driven work culture are more highly correlated with organizational performance than ethics-driven work culture. The study recommended that ethics-driven work culture, technology-driven work culture, and M&amp;E-driven work culture should be enhanced in organizations since it’s a key factors with regard to performance. &nbsp; Keywords: Work Culture, Organizational Performance, Economic Policy Research Network Rwanda. &nbsp
Automated ICF Coding of Rehabilitation Notes for Low-Resource Languages via Continual Training of Language Models

The coding of medical documents and in particular of rehabilitation notes using the International Classification of Functioning, Disability and Health (ICF) is a difficult task showing low agreement among experts. Such difficulty is mainly caused by the specific terminology that needs to be used for the task. In this paper, we address the task developing a model based on a large language model, BERT. By leveraging continual training of such a model using ICF textual descriptions, we are able to effectively encode rehabilitation notes expressed in Italian, an under-resourced language.
Telemedicine Based on Human Activity Recognition in Elderly Healthcare

Nowadays, telemedicine can provide remote clinical services for the elderly, using smart devices like embedded sensors, via real-time communication with the healthcare provider. In particular, inertial measurement sensors such as accelerometers embedded in smartphones can provide sensory data fusion for human activities. Thus, the technology of Human Activity Recognition can be applied to handle such data. In recent studies, the three-dimensional axis has been used to detect human activities. Since most changes in individual activities occur in the x- and y-axis, the label of each activity is determined using a new two-dimensional Hidden Markov Mode based on these two axes. To evaluate the proposed method, we use the WISDM dataset which is based on an accelerometer. The proposed strategy is compared to General Model and User-Adaptive Model. The results indicate that the proposed model is more accurate than the others.
Challenges of Estimating Global Feature Importance in Real-World Health Care Data

Feature importance is often used to explain clinical prediction models. In this work, we examine three challenges using experiments with electronic health record data: computational feasibility, choosing between methods, and interpretation of the resulting explanation. This work aims to create awareness of the disagreement between feature importance methods and underscores the need for guidance to practitioners how to deal with these discrepancies.
Ontological Modeling of Clinical Study Forms

The use of eCRFs is now commonplace in clinical research studies. We propose here an ontological model of these forms allowing to describe them, to express their granularity and to link them to the relevant entities of the study in which they are used. It has been developed in a psychiatry project but its generality may allow a wider application.
The DELPHI Library: Improving Model Validation, Transparency and Dissemination Through a Centralised Library of Prediction Models

The Deposit, Evaluate and Lookup Predictive Healthcare Information (DELPHI) library provides a centralised location for the depositing, exploring and analysing of patient-level prediction models that are compatible with data mapped to the observational medical outcomes partnership common data model.
Mapping Korean National Health Insurance Claim Codes for Laboratory Test to SNOMED CT

The aim of this study was to map Korean national health insurance claims codes for laboratory tests to SNOMED CT. The mapping source codes were 4,111 claims codes for laboratory test and mapping target codes were the International Edition of SNOMED CT released on July 31, 2020. We used rule-based automated and manual mapping methods. The mapping results were validated by two experts. Out of 4,111 codes, 90.5% were mapped to the concepts of procedure hierarchy in SNOMED CT. Of them, 51.4% of the codes were exactly mapped to SNOMED CT concepts, and 34.8% of the codes were mapped to SNOMED CT concepts as one-to-one mapping.
Announcement of the German Medical Text Corpus Project (GeMTeX)

The largest publicly funded project to generate a German-language medical text corpus will start in mid-2023. GeMTeX comprises clinical texts from information systems of six university hospitals, which will be made accessible for NLP by annotation of entities and relations, which will be enhanced with additional meta-information. A strong governance provides a stable legal framework for the use of the corpus. State-of-the art NLP methods are used to build, pre-annotate and annotate the corpus and train language models. A community will be built around GeMTeX to ensure its sustainable maintenance, use, and dissemination.
HEIDA: Software Examples for Rapid Introduction of Homomorphic Encryption for Privacy Preservation of Health Data

Adequate privacy protection is crucial for implementing modern AI algorithms in medicine. With Fully Homomorphic Encryption (FHE), a party without access to the secret key can perform calculations and advanced analytics on encrypted data without taking part of either the input data or the results. FHE can therefore work as an enabler for situations where computations are carried out by parties that are denied plain text access to sensitive data. It is a scenario often found with digital services that process personal health-related data or medical data originating from a healthcare provider, for example, when the service is delivered by a third-party service provider located in the cloud. There are practical challenges to be aware of when working with FHE. The current work aims to improve accessibility and reduce barriers to entry by providing code examples and recommendations to aid developers working with health data in developing FHE-based applications. HEIDA is available on the GitHub repository: https://github.com/rickardbrannvall/HEIDA.
Exploring New Possibilities for Research Data Exploration Using the Example of the German Core Data Set

The German Medical Informatics Initiative (MII) aims to increase the interoperability and reuse of clinical routine data for research purposes. One important result of the MII work is a German-wide common core data set (CDS), which is to be provided by over 31 data integration centers (DIZ) following a strict specification. One standard format for data sharing is HL7/FHIR. Locally, classical data warehouses are often in use for data storage and retrieval. We are interested to investigate the advantages of a graph database in this setting. After having transferred the MII CDS into a graph, storing it in a graph database and subsequently enriching it with accompanying meta-information, we see a great potential for more sophisticated data exploration and analysis. Here we describe the extract-transform-load process which we set up as a proof of concept to achieve the transformation and to make the common set of core data accessible as a graph.
Towards Safe Conversational Agents in Healthcare

Conversational agents (CA) are becoming very popular to deliver digital health interventions. These dialog-based systems are interacting with patients using natural language which might lead to misunderstandings and misinterpretations. To avoid patient harm, safety of health CA has to be ensured. This paper raises awareness on safety when developing and distributing health CA. For this purpose, we identify and describe facets of safety and make recommendations for ensuring safety in health CA. We distinguish three facets of safety: 1) system safety, 2) patient safety, and 3) perceived safety. System safety comprises data security and privacy which has to be considered when selecting technologies and developing the health CA. Patient safety is related to risk monitoring and risk management, to adverse events and content accuracy. Perceived safety concerns a user's perception of the level of danger and user's level of comfort during the use. The latter can be supported when data security is guaranteed and relevant information on the system and its capabilities are provided.
Harvesting the Low Hanging Fruits From the FAIRtree

Extensive workflows have been designed to FAIRify data from various domains. These tend to be cumbersome and overwhelming. This work summarises our own experiences with FAIRification in health data management and provides simple steps that can be implemented to achieve a relatively low but improved level of FAIRness. The steps lead the data steward to register the data in a repository and then annotate it with the metadata recommended by that repository. It further leads the data steward to provide the data in a machine-readable format using an established and accessible language, establish a well-defined framework to describe and structure the (meta)data as well as publish the (meta)data. We hope that following the simple roadmap described in this work helps to demystify the FAIR data principles in the health domain.
Domain Knowledge-Driven Generation of Synthetic Healthcare Data

Healthcare longitudinal data collected around patients' life cycles, today offer a multitude of opportunities for healthcare transformation utilizing artificial intelligence algorithms. However, access to "real" healthcare data is a big challenge due to ethical and legal reasons. There is also a need to deal with challenges around electronic health records (EHRs) including biased, heterogeneity, imbalanced data, and small sample sizes. In this study, we introduce a domain knowledge-driven framework for generating synthetic EHRs, as an alternative to methods only using EHR data or expert knowledge. By leveraging external medical knowledge sources in the training algorithm, the suggested framework is designed to maintain data utility, fidelity, and clinical validity while preserving patient privacy.
Convolutional Neural Networks for Optical Discrimination Between Histological Types of Colorectal Polyps Based on White Light Endoscopic Images

The objective of this study was to compare different convolutional neural networks (CNNs), as employed in a Python-produced deep learning process, used on white light images of colorectal polyps acquired during the process of a colonoscopy, in order to estimate the accuracy of the optical recognition of particular histologic types of polyps. The TensorFlow framework was used for Inception V3, ResNet50, DenseNet121, and NasNetLarge, which were trained with 924 images, drawn from 86 patients.
A Framework for Evaluating Synthetic Electronic Health Records

Synthetic data generation can be applied to Electronic Health Records (EHRs) to obtain synthetic versions that do not compromise patients' privacy. However, the proliferation of synthetic data generation techniques has led to the introduction of a wide variety of methods for evaluating the quality of generated data. This makes the task of evaluating generated data from different models challenging as there is no consensus on the methods used. Hence the need for standard ways of evaluating the generated data. In addition, the available methods do not assess whether dependencies between different variables are maintained in the synthetic data. Furthermore, synthetic time series EHRs (patient encounters) are not well investigated, as the available methods do not consider the temporality of patient encounters. In this work, we present an overview of evaluation methods and propose an evaluation framework to guide the evaluation of synthetic EHRs.
An Integrated Approach to Automated Diagnosis of Cervical Intraepithelial Neoplasia in Digital Histology Images

The study proposes an integrated approach to automated cervical intraepithelial neoplasia (CIN) diagnosis in epithelial patches extracted from digital histology images. The model ensemble, combined CNN classifier, and highest-performing fusion approach achieved an accuracy of 94.57%. This result demonstrates significant improvement over the state-of-the-art classifiers for cervical cancer histopathology images and promises further improvement in the automated diagnosis of CIN.
Using Real-Time Interaction Analysis to Explore Human-Robot Interaction

Despite the increasing presence of social robots (SRs) in Human-Robot Interaction, there are few studies that quantify these interactions and explore children's attitudes by analyzing real-time data as they communicate with SRs. Therefore, we attempted to explore the interaction between pediatric patients and SRs by analyzing the interaction log collected from real-time. This study is a retrospective analysis of data collected in a prospective study conducted on 10 pediatric cancer patients at tertiary hospitals in Korea. Using the Wizard of Oz method, we collected the interaction log during the interaction between pediatric cancer patients and the robot. Out of the collected data, 955 sentences from the robot and 332 sentences from the children were available for analysis, except for the logs that were missing due to environmental errors. we analyzed the delay time from saving the interaction log and the sentence similarity of the interaction log. The interaction log delay time between robot and child was 5.01 seconds. And the child's delay time averaged 7.2 seconds, which was longer than the robot's delay time of 4.29 seconds. Additionally, as a result of analyzing the sentence similarity of the interaction log, the robot (97.2%) was higher than the children (46.2%). The results of the sentiment analysis of the patient's attitude toward the robot were 73% neutral, 13.59% positive, and 12.42% negative. The observational evaluations of pediatric psychological experts identified curiosity (n=7, 70.0%), activity (n=5, 50.0%), passivity (n=5, 50.0%), sympathy (n=7, 70.0%), concentration (n=6, 60.0%), high interest (n=5, 50.0%), positive attitude (n=9, 90.0%), and low interaction initiative (n=6, 60.0%). This study made it possible to explore the feasibility of interaction with SRs and to confirm differences in attitudes toward robots according to child characteristics. To increase the feasibility of human-robot interaction, measures such as improving the completeness of log records by enhancing the network environment are required.
Visualising Path Finding Algorithms Application Development and Implementing

Abstract: The Dijkstra algorithm, A* Search, Greedy Best-first Search, Swarm Search, Breadth-first, and Depth-first Search are some of the common algorithms used today. The pathfinding algorithm is used in this study to provide an overview of algorithms and how they are implemented. The user will also learn more about how different algorithms and programming in general work. Knowing these tactics will give them a fundamental understanding of how to create different navigational tools. The visualizer is a grid page containing a "start node" and a "end node." In order to enhance the overall picture and better understand how these pathfinding algorithms deal with our everyday problems, the spectator can add new characteristics like a maze, walls, and weights. To build a visualizer, a programmer needs a solid grasp of front-end programming languages and pathfinding techniques.
Information Extraction from Medical Texts with BERT Using Human-in-the-Loop Labeling

Neural network language models, such as BERT, can be used for information extraction from medical texts with unstructured free text. These models can be pre-trained on a large corpus to learn the language and characteristics of the relevant domain and then fine-tuned with labeled data for a specific task. We propose a pipeline using human-in-the-loop labeling to create annotated data for Estonian healthcare information extraction. This method is particularly useful for low-resource languages and is more accessible to those in the medical field than rule-based methods like regular expressions.
The Complexity of a Clinical History

The paper describes a new metrics for measuring the structural complexity of clinical history (modelled by a HINe model) in order to compare different clinical histories and then assign it to the right types of learners.