Reviewerly/exHarmony huggingface dataset:
A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis

Authors:
raw_author_name: Xi Xu
raw_affiliation_string: Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
raw_author_name: Jianqiang Li
raw_affiliation_string: Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
raw_author_name: Zhichao Zhu
raw_affiliation_string: Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
raw_author_name: Linna Zhao
raw_affiliation_string: Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
raw_author_name: Yining Chen
raw_affiliation_string: Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
raw_author_name: Qing Zhao
raw_affiliation_string: Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
raw_author_name: Jijiang Yang
raw_affiliation_string: Tsinghua National Laboratory for Information Science and Technology, Tsinghua University, Beijing 100084, China
raw_author_name: Yan Pei
raw_affiliation_string: School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Japan

Abstract: Disease diagnosis represents a critical and arduous endeavor within the medical field. Artificial intelligence (AI) techniques, spanning from machine learning and deep learning to large model paradigms, stand poised to significantly augment physicians in rendering more evidence-based decisions, thus presenting a pioneering solution for clinical practice. Traditionally, the amalgamation of diverse medical data modalities (e.g., image, text, speech, genetic data, physiological signals) is imperative to facilitate a comprehensive disease analysis, a topic of burgeoning interest among both researchers and clinicians in recent times. Hence, there exists a pressing need to synthesize the latest strides in multi-modal data and AI technologies in the realm of medical diagnosis. In this paper, we narrow our focus to five specific disorders (Alzheimer's disease, breast cancer, depression, heart disease, epilepsy), elucidating advanced endeavors in their diagnosis and treatment through the lens of artificial intelligence. Our survey not only delineates detailed diagnostic methodologies across varying modalities but also underscores commonly utilized public datasets, the intricacies of feature engineering, prevalent classification models, and envisaged challenges for future endeavors. In essence, our research endeavors to contribute to the advancement of diagnostic methodologies, furnishing invaluable insights for clinical decision making.
Chaotic opposition learning with mirror reflection and worst individual disturbance grey wolf optimizer for continuous global numerical optimization

Authors:
raw_author_name: Oluwatayomi Rereloluwa Adegboye
raw_affiliation_string: Management Information Systems, University of Mediterranean Karpasia, Mersin-10, Turkey
raw_author_name: Ephraim Bonah Agyekum
raw_affiliation_string: Department of Nuclear and Renewable Energy, Ural Federal University Named After the First President of Russia Boris Yeltsin, 19 Mira Street, Yekaterinburg, Russia, 620002
raw_author_name: Abdelazim G. Hussien
raw_affiliation_string: Department of Computer and Information Science, Linköping University, Linköping, Sweden
raw_author_name: Salah Kamel
raw_affiliation_string: Electrical Engineering Department, Faculty of Engineering, Aswan University, Aswan, 81542, Egypt

Abstract: The effective meta-heuristic technique known as the grey wolf optimizer (GWO) has shown its proficiency. However, due to its reliance on the alpha wolf for guiding the position updates of search agents, the risk of being trapped in a local optimal solution is notable. Furthermore, during stagnation, the convergence of other search wolves towards this alpha wolf results in a lack of diversity within the population. Hence, this research introduces an enhanced version of the GWO algorithm designed to tackle numerical optimization challenges. The enhanced GWO incorporates innovative approaches such as Chaotic Opposition Learning (COL), Mirror Reflection Strategy (MRS), and Worst Individual Disturbance (WID), and it's called CMWGWO. MRS, in particular, empowers certain wolves to extend their exploration range, thus enhancing the global search capability. By employing COL, diversification is intensified, leading to reduced solution stagnation, improved search precision, and an overall boost in accuracy. The integration of WID fosters more effective information exchange between the least and most successful wolves, facilitating a successful exit from local optima and significantly enhancing exploration potential. To validate the superiority of CMWGWO, a comprehensive evaluation is conducted. A wide array of 23 benchmark functions, spanning dimensions from 30 to 500, ten CEC19 functions, and three engineering problems are used for experimentation. The empirical findings vividly demonstrate that CMWGWO surpasses the original GWO in terms of convergence accuracy and robust optimization capabilities.
Fully automated kidney image biomarker prediction in ultrasound scans using Fast-Unet++

Authors:
raw_author_name: Mostafa Ghelich Oghli
raw_affiliation_string: Research and Development Department, Med Fanavaran Plus Co., Karaj, Iran
raw_author_name: Ali Shabanzadeh
raw_affiliation_string: Research and Development Department, Med Fanavaran Plus Co., Karaj, Iran
raw_author_name: Ardavan Akhavan
raw_affiliation_string: Research and Development Department, Med Fanavaran Plus Co., Karaj, Iran
raw_author_name: Isaac Shiri
raw_affiliation_string: Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva 4, Switzerland
raw_author_name: Mostafa Taghipour
raw_affiliation_string: Research and Development Department, Med Fanavaran Plus Co., Karaj, Iran
raw_author_name: Zahra Shabanzadeh
raw_affiliation_string: Research and Development Department, Med Fanavaran Plus Co., Karaj, Iran

Abstract: Abstract Any kidney dimension and volume variation can be a remarkable indicator of kidney disorders. Precise kidney segmentation in standard planes plays an undeniable role in predicting kidney size and volume. On the other hand, ultrasound is the modality of choice in diagnostic procedures. This paper proposes a convolutional neural network with nested layers, namely Fast-Unet++, promoting the Fast and accurate Unet model. First, the model was trained and evaluated for segmenting sagittal and axial images of the kidney. Then, the predicted masks were used to estimate the kidney image biomarkers, including its volume and dimensions (length, width, thickness, and parenchymal thickness). Finally, the proposed model was tested on a publicly available dataset with various shapes and compared with the related networks. Moreover, the network was evaluated using a set of patients who had undergone ultrasound and computed tomography. The dice metric, Jaccard coefficient, and mean absolute distance were used to evaluate the segmentation step. 0.97, 0.94, and 3.23 mm for the sagittal frame, and 0.95, 0.9, and 3.87 mm for the axial frame were achieved. The kidney dimensions and volume were evaluated using accuracy, the area under the curve, sensitivity, specificity, precision, and F1.
Self-Localization of Guide Robots Through Image Classification

Authors:
raw_author_name: Muhammad S. Alam
raw_affiliation_string: Department of Emergent Computing, Universiti Teknologi Malaysia, Johor Bahru, Malaysia & Department of Computer Science, University of Bisha, Bisha, Saudi Arabia.
raw_author_name: Farhan B. Mohamed
raw_affiliation_string: Department of Emergent Computing, Universiti Teknologi Malaysia, Johor Bahru, Malaysia & Department of Media and Game Innovation, Centre of Excellence (MaGICX), Universiti Teknologi Malaysia, Johor Bahru, Malaysia.

Abstract: The field of autonomous robotic systems has advanced tremendously in the last few years, allowing them to perform complicated tasks in various contexts. One of the most important and useful applications of guide robots is the support of the blind. The successful implementation of this study requires a more accurate and powerful self-localization system for guide robots in indoor environments. This paper proposes a self-localization system for guide robots. To successfully implement this study, images were collected from the perspective of a robot inside a room, and a deep learning system such as a convolutional neural network (CNN) was used. An image-based self-localization guide robot image-classification system delivers a more accurate solution for indoor robot navigation. The more accurate solution of the guide robotic system opens a new window of the self-localization system and solves the more complex problem of indoor robot navigation. It makes a reliable interface between humans and robots. This study successfully demonstrated how a robot finds its initial position inside a room. A deep learning system, such as a convolutional neural network, trains the self-localization system as an image classification problem. The robot was placed inside the room to collect images using a panoramic camera. Two datasets were created from the room images based on the height above and below the chest. The above-mentioned method achieved a localization accuracy of 98.98%.
Pixel-wise calibration method for telecentric structured light system

Authors:
raw_author_name: Yuchen Yang
raw_author_name: Song Zhang

Abstract: This paper introduces a pixelwise calibration method designed for a structured light system utilizing a camera attached with a telecentric lens. In the calibration process, a white flat surface and a flat surface with circle dots serve as the calibration targets. After deriving the properties of the pinhole projector through a conventional camera calibration method using circle dots and determining the camera's attributes via 3D feature points estimation through iterative optimizations, the white surface calibration target was positioned at various poses and reconstructed with initial camera and projector calibration data. Each 3D reconstruction was fitted with a virtual ideal plane that was further used to create the pixelwise phase-to-coordinate mapping. To optimize the calibration accuracy, various angled poses of the calibration target are employed to refine the initial results. Experimental findings show that the proposed approach offers high calibration accuracy for a structured light system using a telecentric lens.
Unsupervised underwater imaging based on polarization and binocular depth estimation

Authors:
raw_author_name: Enlai Guo
raw_author_name: YingJie Shi
raw_author_name: Lianfa Bai
raw_author_name: Jing Han

Abstract: Scattering caused by suspended particles in the water severely reduces the radiance of the scene. This paper proposes an unsupervised underwater restoration method based on binocular estimation and polarization. Based on the correlation between the underwater transmission process and depth, this method combines the depth information and polarization information in the scene, uses the neural network to perform global optimization and the depth information is recalculated and updated in the network during the optimization process, and reduces the error generated by using the polarization image to calculate parameters, so that detailed parts of the image are restored. Furthermore, the method reduces the requirement for rigorous pairing of data compared to previous approaches for underwater imaging using neural networks. Experimental results show that this method can effectively reduce the noise in the original image and effectively preserve the detailed information in the scene.
Security-oriented steganographic payload allocation for multi-remote sensing images

Authors:
raw_author_name: Tian Wu
raw_affiliation_string: Digital Literacy and Skills Enhancement Research Center, Jiangxi Province Philosophy and Social Science Key Research Base, School of Public Policy and Administration, Nanchang University, Nanchang, 330031, China
raw_author_name: Chunnian Liu
raw_affiliation_string: Digital Literacy and Skills Enhancement Research Center, Jiangxi Province Philosophy and Social Science Key Research Base, School of Public Policy and Administration, Nanchang University, Nanchang, 330031, China

Abstract: Multi-image steganography, a technique for concealing information within multiple carrier mediums, finds remote sensing images to be particularly apt carriers due to their complex structures and abundant texture data. These characteristics bolster the resilience against steganalysis and enhance steganographic capacity. The efficacy of multi-image steganography hinges on the diplomatic strategy of cover selection and the meticulous allocation of the payload. Nevertheless, the majority of current methods, which are empirically formulated, predominantly focus on the texture complexity of individual images, thereby potentially undermining overall security. This paper introduces a security-oriented approach to steganographic payload allocation for multiple remote sensing images aimed at fortifying the security of multi-image steganography. Our primary contributions include employing a steganalysis pre-trained network to quantify texture complexity in remote sensing cover images, directly correlating it with security. Additionally, we have developed an adaptive payload allocation strategy for multiple images, which embeds a payload proximate to each image's maximal steganographic capacity while concurrently ensuring the security of the embedding process. Experimental results corroborate that our methodology excels in cover selection and payload allocation and achieves better undetectability against modern steganalysis tools.
Assessment of inference accuracy and memory capacity of computation-in-memory enabled neural network due to quantized weights, gradients, input and output signals, and memory non-idealities

Authors:
raw_author_name: Ken Takeuchi
raw_affiliation_string: The University of Tokyo, Bunkyo-ku, Tokyo, JAPAN

Abstract: Abstract This paper proposes an approach to enhance the efficiency of computation-in-memory enabled neural networks. The proposed methods involve partial quantization of learning and inference processes within the neural network to increase the training and inference speed while reducing energy and memory consumption. The impact of quantization due to the usage of computation-in-memory is evaluated based on inference accuracy. The effect of non-idealities incurred due to the employment of different memories such as ReRAM on the network accuracy is documented and reported. The results indicate that a certain quantization bit precision threshold is necessary for weights, input/output data, and gradients to maintain an acceptable inference accuracy level. Notably, the experiments demonstrate a modest degradation of approximately 2.8% in inference accuracy compared to the neural network trained without using computation-in-memory, this accuracy trade-off is accompanied by a substantial memory capacity improvement, with best-case memory usage reductions of 62% and 93% during the training and inference phase respectively.
Privacy-Preserving Breast Cancer Classification: A Federated Transfer Learning Approach

Authors:
raw_author_name: Rekha V
raw_affiliation_string: Department of Artificial Intelligence and Data Science, Panimalar Engineering College, Chennai, Tamil Nadu, India
raw_author_name: J Jeyalakshmi
raw_affiliation_string: Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidhyapeetham, Chennai, India

Abstract: Breast cancer is deadly cancer causing a considerable number of fatalities among women in worldwide. To enhance patient outcomes as well as survival rates, early and accurate detection is crucial. Machine learning techniques, particularly deep learning, have demonstrated impressive success in various image recognition tasks, including breast cancer classification. However, the reliance on large labeled datasets poses challenges in the medical domain due to privacy issues and data silos. This study proposes a novel transfer learning approach integrated into a federated learning framework to solve the limitations of limited labeled data and data privacy in collaborative healthcare settings. For breast cancer classification, the mammography and MRO images were gathered from three different medical centers. Federated learning, an emerging privacy-preserving paradigm, empowers multiple medical institutions to jointly train the global model while maintaining data decentralization. Our proposed methodology capitalizes on the power of pre-trained ResNet, a deep neural network architecture, as a feature extractor. By fine-tuning the higher layers of ResNet using breast cancer datasets from diverse medical centers, we enable the model to learn specialized features relevant to different domains while leveraging the comprehensive image representations acquired from large-scale datasets like ImageNet. To overcome domain shift challenges caused by variations in data distributions across medical centers, we introduce domain adversarial training. The model learns to minimize the domain discrepancy while maximizing classification accuracy, facilitating the acquisition of domain-invariant features. We conducted extensive experiments on diverse breast cancer datasets obtained from multiple medical centers. Comparative analysis was performed to evaluate the proposed approach against traditional standalone training and federated learning without domain adaptation. When compared with traditional models, our proposed model showed a classification accuracy of 98.8% and a computational time of 12.22 s. The results showcase promising enhancements in classification accuracy and model generalization, underscoring the potential of our method in improving breast cancer classification performance while upholding data privacy in a federated healthcare environment.
Assessing spontaneous categorical processing of visual shapes via frequency-tagging EEG

Authors:
raw_author_name: Sander Van de Cruys
raw_affiliation_string: Department of Brain and Cognition, Leuven Brain Institute
raw_author_name: Johan Wagemans
raw_affiliation_string: Department of Brain and Cognition, Leuven Brain Institute

Abstract: Categorization is an essential cognitive and perceptual process, which happens spontaneously. However, earlier research often neglected the spontaneous nature of this process by mainly adopting explicit tasks in behavioural or neuroimaging paradigms. Here, we use frequency-tagging (FT) during electroencephalography (EEG) in 22 healthy human participants (both male and female) as a direct approach to pinpoint spontaneous visual categorical processing. Starting from schematic natural visual stimuli, we created morph sequences comprising 11 equal steps. Mirroring a behavioural categorical perception discrimination paradigm, we administered an FT-EEG oddball paradigm, assessing neural sensitivity for equally sized differences within and between stimulus categories. Likewise, mirroring a behavioural category classification paradigm, we administered a sweep FT-EEG oddball paradigm, sweeping from one end of the morph sequence to the other, thereby allowing us to objectively pinpoint the neural category boundary. We found that FT-EEG can implicitly measure categorical processing and discrimination. More specifically, we could derive an objective neural index of the required level to differentiate between the two categories, and this neural index showed the typical marker of categorical perception (i.e., stronger discrimination across as compared to within categories). The neural findings of the implicit paradigms were also validated using an explicit behavioural task. These results provide evidence that FT-EEG can be used as an objective tool to measure discrimination and categorization and that the human brain inherently and spontaneously (without any conscious or decisional processes) uses higher-level meaningful categorization information to interpret ambiguous (morph) shapes. Significance Statement Every time when we encounter a new image or object, we will automatically relate it to previously stored categories. This categorization process allows us to efficiently react on new information and it influences our perception. The behavioural hallmark of categorical perception entails that we perceive differences between categories more distinctly than within a category. Previous research has mainly investigated categorical processing using explicit tasks. Here, we use carefully controlled morphs with implicit, neural electroencephalography measures to assess spontaneous categorical processing. We found higher neural amplitudes for “between”- than “within”-category morph pairs, establishing a neural correlate of categorical perception. This provides evidence that the brain inherently and automatically uses higher-level meaningful categorization information to interpret ambiguous shapes.
Special issue on analysis and mining of social media data

Authors:
raw_author_name: Arkaitz Zubiaga
raw_affiliation_string: School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom
raw_author_name: Paolo Rosso
raw_affiliation_string: Technical University of Valencia, Valencia, Spain

Abstract: This Editorial introduces the PeerJ Computer Science Special Issue on Analysis and Mining of Social Media Data. The special issue called for submissions with a primary focus on the use of social media data, for a variety of fields including natural language processing, computational social science, data mining, information retrieval and recommender systems. Of the 48 abstract submissions that were deemed within the scope of the special issue and were invited to submit a full article, 17 were ultimately accepted. These included a diverse set of articles covering, inter alia, sentiment analysis, detection and mitigation of online harms, analytical studies focused on societal issues and analysis of images surrounding news. The articles primarily use Twitter, Facebook and Reddit as data sources; English, Arabic, Italian, Russian, Indonesian and Javanese as languages; and over a third of the articles revolve around COVID-19 as the main topic of study. This article discusses the motivation for launching such a special issue and provides an overview of the articles published in the issue.
CuentosIE: can a chatbot about “tales with a message” help to teach emotional intelligence?

Authors:
raw_author_name: Antonio Ferrández
raw_affiliation_string: Department of Languages and Computing Systems, Universidad de Alicante, Alicante, Spain
raw_author_name: Jesús Peral
raw_affiliation_string: Department of Languages and Computing Systems, Universidad de Alicante, Alicante, Spain
raw_author_name: Ángel Lloret
raw_affiliation_string: Department of Languages and Computing Systems, Universidad de Alicante, Alicante, Spain
raw_author_name: David Gil
raw_affiliation_string: Department of Languages and Computing Systems, Universidad de Alicante, Alicante, Spain

Abstract: In this article, we present CuentosIE (TalesEI: chatbot of tales with a message to develop Emotional Intelligence), an educational chatbot on emotions that also provides teachers and psychologists with a tool to monitor their students/patients through indicators and data compiled by CuentosIE. The use of "tales with a message" is justified by their simplicity and easy understanding, thanks to their moral or associated metaphors. The main contributions of CuentosIE are the selection, collection, and classification of a set of highly specialized tales, as well as the provision of tools (searching, reading comprehension, chatting, recommending, and classifying) that are useful for both educating users about emotions and monitoring their emotional development. The preliminary evaluation of the tool has obtained encouraging results, which provides an affirmative answer to the question posed in the title of the article.