Reviewerly/exHarmony huggingface dataset:
Robust human locomotion and localization activity recognition over multisensory

Human activity recognition (HAR) plays a pivotal role in various domains, including healthcare, sports, robotics, and security. With the growing popularity of wearable devices, particularly Inertial Measurement Units (IMUs) and Ambient sensors, researchers and engineers have sought to take advantage of these advances to accurately and efficiently detect and classify human activities. This research paper presents an advanced methodology for human activity and localization recognition, utilizing smartphone IMU, Ambient, GPS, and Audio sensor data from two public benchmark datasets: the Opportunity dataset and the Extrasensory dataset. The Opportunity dataset was collected from 12 subjects participating in a range of daily activities, and it captures data from various body-worn and object-associated sensors. The Extrasensory dataset features data from 60 participants, including thousands of data samples from smartphone and smartwatch sensors, labeled with a wide array of human activities. Our study incorporates novel feature extraction techniques for signal, GPS, and audio sensor data. Specifically, for localization, GPS, audio, and IMU sensors are utilized, while IMU and Ambient sensors are employed for locomotion activity recognition. To achieve accurate activity classification, state-of-the-art deep learning techniques, such as convolutional neural networks (CNN) and long short-term memory (LSTM), have been explored. For indoor/outdoor activities, CNNs are applied, while LSTMs are utilized for locomotion activity recognition. The proposed system has been evaluated using the k-fold cross-validation method, achieving accuracy rates of 97% and 89% for locomotion activity over the Opportunity and Extrasensory datasets, respectively, and 96% for indoor/outdoor activity over the Extrasensory dataset. These results highlight the efficiency of our methodology in accurately detecting various human activities, showing its potential for real-world applications. Moreover, the research paper introduces a hybrid system that combines machine learning and deep learning features, enhancing activity recognition performance by leveraging the strengths of both approaches.
Strategic Analysis of the Parameter Servers and Participants in Federated Learning: An Evolutionary Game Perspective

Federated learning (FL) is a new decentralized deep learning paradigm developed for collaborative model training and solving the problem of data privacy and has received extensive attention from both the academic and business worlds. However, FL still faces challenges in encouraging participants to contribute private data and computational resources. Although many studies have applied game theory models to improve the incentive mechanism design of FL, they assume that the players are absolutely rational and that the game models are static. In this study, a mathematical model based on evolutionary game theory (EGT) is established to analyze the interaction between parameter servers and participants, considering that the participants are not completely rational in the long-term dynamic decision-making process. The evolutionarily stable status of the FL system and the strategies of the parameter servers and participants were analyzed under eight different scenarios. Based on the model analysis and results of the numerical experiments, managerial insights for maintaining a sustainable FL system are summarized.
Quantum Vision Transformers

In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis. Building upon the previous work, which uses parametrised quantum circuits for data loading and orthogonal neural layers, we introduce three types of quantum transformers for training and inference, including a quantum transformer based on compound matrices, which guarantees a theoretical advantage of the quantum attention mechanism compared to their classical counterpart both in terms of asymptotic run time and the number of model parameters. These quantum architectures can be built using shallow quantum circuits and produce qualitatively different classification models. The three proposed quantum attention layers vary on the spectrum between closely following the classical transformers and exhibiting more quantum characteristics. As building blocks of the quantum transformer, we propose a novel method for loading a matrix as quantum states as well as two new trainable quantum orthogonal layers adaptable to different levels of connectivity and quality of quantum computers. We performed extensive simulations of the quantum transformers on standard medical image datasets that showed competitively, and at times better performance compared to the classical benchmarks, including the best-in-class classical vision transformers. The quantum transformers we trained on these small-scale datasets require fewer parameters compared to standard classical benchmarks. Finally, we implemented our quantum transformers on superconducting quantum computers and obtained encouraging results for up to six qubit experiments.
LEAF: A Federated Learning-Aware Privacy-Preserving Framework for Healthcare Ecosystem

Over the last decades, the healthcare industry has been revolutionized like anything, especially after the Covid-19 surge. Various artificial intelligence approaches have also been explored during this era for their applicability in healthcare. However, traditional AI techniques and algorithms are prone to overfitting with minimum robustness to unseen or untrained data. So, there is a requirement for new techniques which can counterfeit the issues mentioned earlier. Federated learning (FL) can help to make specific AI services for the network of hospitals with less overfitting and more robust modules. However, with the inclusion of FL, the problem related to user privacy is the biggest challenge, making using FL in the real world a grand challenge. Most solutions presented in the literature used blockchain technology to mitigate the issues mentioned earlier. However, it prevents third-party systems from penetrating the decision process, but the network devices can access shared data. Moreover, blockchain implementation requires new paradigms and infrastructure with an additional overhead cost. Motivated by these facts, the paper presents a limited access encryption algorithm incorporating FL (LEAF) framework, i.e., an encryption technique that solves privacy issues with the help of edge-enabled AI models. The proposed LEAF framework preserves user privacy and minimizes overhead costs. The authors have evaluated the performance of the LEAF framework using extensive simulations and achieved superior results. The achieved accuracy of the proposed LEAF framework is 3% more than that of the traditional centralized and FL-based systems advantages without compromising user privacy. In the best scenario, the proposed framework’s encryption process also compresses the data size by 4-5 times.
FastAL: Fast Evaluation Module for Efficient Dynamic Deep Active Learning Using Broad Learning System

State-of-the-art Active Learning (AL) methods often encounter challenges associated with a hysteretic learning process and an expensive data sampling mechanism. The former implies that data selection in the ( <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">i</i> + 1)-th round is solely based on the learned model’s results in the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">i</i> -th round. The latter involves using model inference to calculate data value (e.g., uncertainty estimation based on model inference), which can be cumbersome, particularly when working with large datasets or Deep Neural Networks (DNNs). To address these challenges, we propose FastAL, an efficient and dynamic deep AL framework. Our approach includes an efficient method for calculating data value from the frequency domain perspective, generating multiple candidates. Then, we introduce the Fast Evaluation Module, which directly calculates each candidate’s contribution to future model training and selects the best options. In addition, current AL methods, particularly those based on uncertainty, are susceptible to data bias, which implies that selected data may not represent the original unlabeled data adequately. To alleviate this issue, we propose the De-similar Module, which removes partially similar data. The above three modules are model-agnostic and thus can be seamlessly integrated into any Active Learning framework. We conducted rigorous experiments on various benchmark datasets to validate our approach’s effectiveness. Our results demonstrate that FastAL outperforms other state-of-the-art methods by a significant margin, including those based on uncertainty, diversity, and expected model change.
Introducing instance label correlation in multiple instance learning. Application to cancer detection on histopathological images

In the last years, the weakly supervised paradigm of multiple instance learning (MIL) has become very popular in many different areas. A paradigmatic example is computational pathology, where the lack of patch-level labels for whole-slide images prevents the application of supervised models. Probabilistic MIL methods based on Gaussian Processes (GPs) have obtained promising results due to their excellent uncertainty estimation capabilities. However, these are general-purpose MIL methods that do not take into account one important fact: in (histopathological) images, the labels of neighboring patches are expected to be correlated. In this work, we extend a state-of-the-art GP-based MIL method, which is called VGPMIL-PR, to exploit such correlation. To do so, we develop a novel coupling term inspired by the statistical physics Ising model. We use variational inference to estimate all the model parameters. Interestingly, the VGPMIL-PR formulation is recovered when the weight that regulates the strength of the Ising term vanishes. The performance of the proposed method is assessed in two real-world problems of prostate cancer detection. We show that our model achieves better results than other state-of-the-art probabilistic MIL methods. We also provide different visualizations and analysis to gain insights into the influence of the novel Ising term. These insights are expected to facilitate the application of the proposed model to other research areas.
The development of orthography and phonology coupling in the ventral occipito-temporal cortex and its relation to reading.

The left ventral occipito-temporal (lvOT) cortex is considered to house the brain's representation of orthography (i.e., the spelling patterns of words). Because letter-sound coupling is crucial in reading, we investigated the engagement of the lvOT cortex in processing phonology (i.e., the sound patterns of words) as a function of reading acquisition. We tested 47 Polish children both at the beginning of formal literacy instruction and 2 years later. During functional magnetic resonance imaging, children performed auditory phonological tasks from small to large grain size levels (i.e., single phoneme, rhyme). We showed that orthographically relevant lvOT areas activated during small-grain size phonological tasks were skill-dependent, perhaps due to the relatively transparent mappings between orthography and phonology in Polish. We also studied activation pattern similarity between processing visual and auditory word stimuli in the lvOT. We found that a higher similarity level was observed in the anterior lvOT compared to the posterior lvOT after 2 years of schooling. This is consistent with models proposing a posterior-to-anterior shift in word processing during reading acquisition. We argue that the development of orthography-phonology coupling at the brain level reflects writing system-specific effects and a more universal pathway of the left vOT development in reading acquisition. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
A Preliminary Investigation into Search and Matching for Tumor Discrimination in World Health Organization Breast Taxonomy Using Deep Networks

Breast cancer is one of the most common cancers affecting women worldwide. They include a group of malignant neoplasms with a vari- ety of biological, clinical, and histopathological characteristics. There are more than 35 different histological forms of breast lesions that can be classified and diagnosed histologically according to cell morphology, growth, and architecture patterns. Recently, deep learning, in the field of artificial intelligence, has drawn a lot of attention for the computerized representation of medical images. Searchable digital atlases can provide pathologists with patch matching tools allowing them to search among evidently diagnosed and treated archival cases, a technology that may be regarded as computational second opinion. In this study, we indexed and analyzed the WHO breast taxonomy (Classification of Tumours 5th Ed.) spanning 35 tumour types. We visualized all tumour types using deep fea- tures extracted from a state-of-the-art deep learning model, pre-trained on millions of diagnostic histopathology images from the TCGA reposi- tory. Furthermore, we test the concept of a digital “atlas” as a referencefor search and matching with rare test cases. The patch similarity search within the WHO breast taxonomy data reached over 88% accuracy when validating through “majority vote” and more than 91% accuracy when validating using top-n tumour types. These results show for the first time that complex relationships among common and rare breast lesions can be investigated using an indexed digital archive.
Graph representation learning method based on three-way partial order structure

In the era of big data, handling massive datasets to extract valuable information has become increasingly critical. Knowledge representation emerges as a pivotal method to address this challenge. In the domain of knowledge representation, there exist two primary approaches: symbolic representation and vector representation. The integration of symbolic and vector representations to harness their respective strengths has become the cutting-edge approach to address challenges in the field of knowledge representation. This paper proposes a method that integrates a partial order formal structure analysis (POFSA) with graph representation learning. Specifically, we initially construct three-way partial order structure graphs, then create an attribute graph based on this structure, which can be processed by the graph representation learning methods. Finally, we utilize the graph representation learning to construct embeddings for three-way attribute partial order structure diagram (APOSD). We comprehensively assesse these embeddings across eight different datasets and present the results. The experiments indicate the feasibility of our proposed approach which is proven a novel approach of combining symbolic and vector representations for handling complex data and implicit knowledge.
Blockchains for SMEs: A Fit-Viability perspective moderated by organizational innovation diffusion for supply chain performance

This paper empirically examines the suitability of blockchain for improving supply chain performance in small-medium enterprises through the theoretical lens of the fit-viability model against the impact of organisation innovation diffusion level Data gathered from 206 respondents are analysed using partial least square-structured equation modelling (PLS-SEM) and artificial neural network (ANN). The findings of this study show empirically that enhanced supply chain connectivity, information sharing, and supply chain visibility are fit for enhancing supply chain performance. Economics, management support, and technology infrastructure are important for blockchain viability. Further, an organisation's innovation diffusion level affects the fitness of blockchain for supply chain performance but not viability. The transformational effects of blockchain are mainly centred on its security and trust-enhancing features. However, its deployment continues to be marred by technical complexities and often, scenarios that seem opportune may be a poor fit. This study is among the few that consider the impact of blockchain on supply chain performance through a fit-viability lens against the effect of organisation innovation diffusion level.
SwinHR: Hemodynamic-powered hierarchical vision transformer for breast tumor segmentation

Accurate and automated segmentation of breast tumors in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) plays a critical role in computer-aided diagnosis and treatment of breast cancer. However, this task is challenging, due to random variation in tumor sizes, shapes, appearances, and blurred boundaries of tumors caused by inherent heterogeneity of breast cancer. Moreover, the presence of ill-posed artifacts in DCE-MRI further complicate the process of tumor region annotation. To address the challenges above, we propose a scheme (named SwinHR) integrating prior DCE-MRI knowledge and temporal-spatial information of breast tumors. The prior DCE-MRI knowledge refers to hemodynamic information extracted from multiple DCE-MRI phases, which can provide pharmacokinetics information to describe metabolic changes of the tumor cells over the scanning time. The Swin Transformer with hierarchical re-parameterization large kernel architecture (H-RLK) can capture long-range dependencies within DCE-MRI while maintaining computational efficiency by a shifted window-based self-attention mechanism. The use of H-RLK can extract high-level features with a wider receptive field, which can make the model capture contextual information at different levels of abstraction. Extensive experiments are conducted in large-scale datasets to validate the effectiveness of our proposed SwinHR scheme, demonstrating its superiority over recent state-of-the-art segmentation methods. Also, a subgroup analysis split by MRI scanners, field strength, and tumor size is conducted to verify its generalization. The source code is released on (https://github.com/GDPHMediaLab/SwinHR).
Deposit type discrimination based on trace elements in sphalerite

Sphalerite can form in different geological environments and is the main ore mineral of most Pb-Zn deposits. Trace elements in sphalerite combined with machine learning (ML) methods have been used for deposit type discrimination. However, the performance of different multivariate and ML methods is not systematically compared. Here more than four thousand laser ablation inductively coupled plasma mass spectrometry data from more than one hundred deposits were compiled and investigated by different multivariate and ML methods. Unsupervised multivariate and ML methods including principal component analysis (PCA) and t-distributed stochastic neighbor embedding (t-SNE), and supervised multivariate and ML methods including partial least squares-discriminant analysis (PLS-DA), logistic regression (LR), support vector machine (SVM), K-nearest neighbors (KNN), random forest (RF), naïve Bayes (NB), and neural network (NN) are used to classify deposit types. The models are constructed for five deposit types, Mississippi Valley-type (MVT), Volcanogenic Massive Sulfide (VMS), sedimentary exhalative (SEDEX), Epithermal, and Skarn deposits, based on twelve elements in sphalerite, Fe, Pb, Mn, Co, Cu, Ga, Ge, Ag, Cd, In, Sn, and Sb. The PCA and PLS-DA methods show similar clustering results, where Epithermal, MVT, SEDEX, and Skarn deposits can be separated from other deposit types. The t-SNE method is only efficient in discriminating MVT, SEDEX, and Epithermal deposits. The KNN, RF, and NN methods show better performance than LR, SVM, and NB in terms of average accuracy and precision. The PCA, t-SNE, and PLS-DA methods have advantages in data visualization, whereas KNN, NN, and RF methods are more suitable for classification tasks. Feature importance analyses of the PLS-DA and RF methods show that the most important discriminant elements in the classification are Ge, Mn, In, Sn, Ga and Sb. The models based on PCA, PLS-DA, KNN, NN, and RF are used to predict sphalerite samples with uncertain origins. All the models give similar classification results for deposit types, which are consistent with the ore-forming geological setting. The multivariate and ML models, including discrimination diagrams of PCA and PLS-DA, can be used as the first screening for the type of Pb-Zn mineralization in mineral exploration.
Korean Syntactic Complexity Analyzer (KOSCA): An NLP application for the analysis of syntactic complexity in second language production

Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides seven indices of syntactic complexity, including traditional and Korean-specific ones. Its validity was tested by investigating whether the syntactic complexity indices measured by it in L2 written and spoken production could explain the variability of L2 Korean learners’ proficiency. The results of mixed-effects regression analyses showed that all seven indices significantly accounted for learner proficiency in Korean. Subsequent stepwise multiple regression analyses revealed that the syntactic complexity indices explained 56.0% of the total variance in proficiency for the written data and 54.4% for the spoken data. These findings underscore the validity of the syntactic complexity indices measured by KOSCA as reliable indicators of L2 Korean proficiency, which can serve as a valuable resource for researchers and educators in the field of L2 Korean learning and assessment.
Multimodal human motion dataset of 3D anatomical landmarks and pose keypoints

In this paper, we present a dataset that takes 2D and 3D human pose keypoints estimated from images and relates them to the location of 3D anatomical landmarks. The dataset contains 51,051 poses obtained from 71 persons in A-Pose while performing 7 movements (walking, running, squatting, and four types of jumping). These poses were scanned to build a collection of 3D moving textured meshes with anatomical correspondence. Each mesh in that collection was used to obtain the 3D locations of 53 anatomical landmarks, and 48 images were created using virtual cameras with different perspectives. 2D pose keypoints from those images were obtained using the MediaPipe Human Pose Landmarker, and their corresponding 3D keypoints were calculated by linear triangulation. The dataset consists of a folder for each participant containing two Track Row Column (TRC) files and one JSON file for each movement sequence. One TRC file is used to store the 3D data of the triangulated 3D keypoints while the other contains the 3D anatomical landmarks. The JSON file is used to store the 2D keypoints and the calibration parameters of the virtual cameras. The anthropometric characteristics of the participants are annotated in a single CSV file. These data are intended to be used in developments that require the transformation of existing human pose solutions in computer vision into biomechanical applications or simulations. This dataset can also be used in other applications related to training neural networks for human motion analysis and studying their influence on anthropometric characteristics.