Reviewerly/exHarmony huggingface dataset:
Exploration of Augmented Reality in Spatial Abilities Training: A Systematic Literature Review for the Last Decade

This review paper presents a systematic literature review on the use of Augmented Reality (AR) in engineering education, and specifically in student’s spatial ability training, for the last decade. Researchers have explored the benefits of AR, and its application has been of increasing interest in all levels of education. Engineering students tend to have difficulties in acquiring visualization skills, and hence, AR is gaining momentum in enhancing students’ learning achievements. This paper aims to present valuable information to researchers, tutors and software developers of learning technology systems concerning the advantages and limitations of AR in spatial ability training, the incorporation of adaptivity and personalization in AR applications as well as the aspects of spatial ability having been evaluated using AR and the prevalent evaluation methods for AR applications. To this direction, a total of thirty-two (32) studies were reviewed, having been published since 2010. The findings reveal an increase in the number of studies during the last three years. One major conclusion is the improvement of learners’ spatial ability using AR in educational settings, and the noted challenge is the need for more learning content. One research gap that has been identified is the lack of personalization in the developed applications, offering space for future research. Concluding, this area is under-researched, and thus, there is scope for a lot of improvement.
RadarNet: Efficient Gesture Recognition Technique Utilizing a Miniature Radar Sensor

Gestures are a promising candidate as an input modality for ambient computing where conventional input modalities such as touchscreens are not available. Existing works have focused on gesture recognition using image sensors. However, their cost, high battery consumption, and privacy concerns made cameras challenging as an always-on solution. This paper introduces an efficient gesture recognition technique using a miniaturized 60 GHz radar sensor. The technique recognizes four directional swipes and an omni-swipe using a radar chip (6.5 × 5.0 mm) integrated into a mobile phone. We developed a convolutional neural network model efficient enough for battery powered and computationally constrained processors. Its model size and inference time is less than 1/5000 compared to an existing gesture recognition technique using radar. Our evaluations with large scale datasets consisting of 558,000 gesture samples and 3,920,000 negative samples demonstrated our algorithm’s efficiency, robustness, and readiness to be deployed outside of research laboratories.
Smart Assistive System for Visually Impaired People Obstruction Avoidance Through Object Detection and Classification

Recent progress in innovation is making the life prosper, simpler and easier for common individual. The World Health Organization (WHO) statistics indicate that a large amount of people experience visual losses, because of which they encounter many difficulties in everyday jobs. Hence, our goal is to structure a modest, secure, wearable, and versatile framework for visually impaired to help them in their daily routines. For this, the plan is to make an effective system which will assist visually impaired people through obstacle detection and scenes classification. The proposed methodology utilizes Raspberry-Pi 4B, Camera, Ultrasonic Sensor and Arduino, mounted on the stick of the individual. We take pictures of the scene and afterwards pre-process these pictures with the help of Viola Jones and TensorFlow Object Detection algorithm. The said techniques are used to detect objects. We also used an ultrasonic sensor mounted on a servomotor to measure the distance between the blind person and obstacles. The presented research utilizes simple calculations for its execution, and detects the obstructions with a notably high efficiency. When contrasted with different frameworks, this framework is a minimal effort, convenient, and simple to wear.
Single Image Super-Resolution Quality Assessment: A Real-World Dataset, Subjective Studies, and an Objective Metric

Numerous single image super-resolution (SISR) algorithms have been proposed during the past years to reconstruct a high-resolution (HR) image from its low-resolution (LR) observation. However, how to fairly compare the performance of different SISR algorithms/results remains a challenging problem. So far, the lack of comprehensive human subjective study on large-scale real-world SISR datasets and accurate objective SISR quality assessment metrics makes it unreliable to truly understand the performance of different SISR algorithms. We in this paper make efforts to tackle these two issues. Firstly, we construct a real-world SISR quality dataset (i.e., RealSRQ) and conduct human subjective studies to compare the performance of the representative SISR algorithms. Secondly, we propose a new objective metric, i.e., KLTSRQA, based on the Karhunen-Loéve Transform (KLT) to evaluate the quality of SISR images in a no-reference (NR) manner. Experiments on our constructed RealSRQ and the latest synthetic SISR quality dataset (i.e., QADS) have demonstrated the superiority of our proposed KLTSRQA metric, achieving higher consistency with human subjective scores than relevant existing NR image quality assessment (NR-IQA) metrics. The dataset and the code will be made available at https://github.com/Zhentao-Liu/RealSRQ-KLTSRQA.
Blueprint Separable Residual Network for Efficient Image Super-Resolution

Recent advances in single image super-resolution (SISR) have achieved extraordinary performance, but the computational cost is too heavy to apply in edge devices. To alleviate this problem, many novel and effective solutions have been proposed. Convolutional neural network (CNN) with the attention mechanism has attracted increasing attention due to its efficiency and effectiveness. However, there is still redundancy in the convolution operation. In this paper, we propose Blueprint Separable Residual Network (BSRN) containing two efficient designs. One is the usage of blueprint separable convolution (BSConv), which takes place of the redundant convolution operation. The other is to enhance the model ability by introducing more effective attention modules. The experimental results show that BSRN achieves state-of-the-art performance among existing efficient SR methods. Moreover, a smaller variant of our model BSRN-S won the first place in model complexity track of NTIRE 2022 Efficient SR Challenge. The code is available at https://github.com/xiaom233/BSRN.
Enhanced Remora Optimization Algorithm for Solving Constrained Engineering Optimization Problems

Remora Optimization Algorithm (ROA) is a recent population-based algorithm that mimics the intelligent traveler behavior of Remora. However, the performance of ROA is barely satisfactory; it may be stuck in local optimal regions or has a slow convergence, especially in high dimensional complicated problems. To overcome these limitations, this paper develops an improved version of ROA called Enhanced ROA (EROA) using three different techniques: adaptive dynamic probability, SFO with Levy flight, and restart strategy. The performance of EROA is tested using two different benchmarks and seven real-world engineering problems. The statistical analysis and experimental results show the efficiency of EROA.
Blockchain in construction management: Applications, advantages and limitations

Blockchain technology (BCT) has been implemented in different industries, including healthcare, manufacturing and construction. Integrating recent technologies such as the internet of things (IoT), building information modeling (BIM), and artificial intelligence with BCT creates the potential for overcoming many limitations within the construction industry. Blockchain smart contracts, for example, can solve problems related to traditional contract forms. In construction projects, smart contracts based on BCT can enhance payment transparency, protect transaction histories, and provide secure access to information. Since BCT platforms are decentralized, reducing unnecessary bureaucracy will improve open communications, and BCT application can prevent disputes rooted in communication issues, inaccurate documentation, and payment problems. This study focuses on reviewing BCT characteristics to evaluate impacts on mitigating disputes. Based on a systematic review of the publications, a comprehensive classification of blockchain-enabled applications in managing construction disputes is presented. This review identifies gaps in research and opportunities for future studies in the construction domain.
Explainability of Deep Vision-Based Autonomous Driving Systems: Review and Challenges

This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a safety-critical application. Gathering contributions from several research fields, namely computer vision, deep learning, autonomous driving, explainable AI (X-AI), this survey tackles several points. First, it discusses definitions, context, and motivation for gaining more interpretability and explainability from self-driving systems, as well as the challenges that are specific to this application. Second, methods providing explanations to a black-box self-driving system in a post-hoc fashion are comprehensively organized and detailed. Third, approaches from the literature that aim at building more interpretable self-driving systems by design are presented and discussed in detail. Finally, remaining open-challenges and potential future research directions are identified and examined.
Generative Artificial Intelligence: Trends and Prospects

Generative artificial intelligence can make powerful artifacts when used at scale, but developing trust in these artifacts and controlling their creation are essential for user adoption.
Unified Contrastive Learning in Image-Text-Label Space

Visual recognition is recently learned via either super-vised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more discriminative representation, language-image pretraining shows unprecedented zero-shot recognition ca-pability, largely due to the different properties of data sources and learning objectives. In this work, we intro-duce a new formulation by combining the two data sources into a common image-text-label space. In this space, we propose a new learning paradigm, called Unified Con-trastive Learning (UniCL) with a single learning objective to seamlessly prompt the synergy of two data types. Ex-tensive experiments show that our UniCL is an effective way of learning semantically rich yet discriminative repre-sentations, universally for image recognition in zero-shot, linear-probing, fully finetuning and transfer learning sce-narios. Particularly, it attains gains up to 9.2% and 14.5% in average on zero-shot recognition benchmarks over the language-image contrastive learning and supervised learning methods, respectively. In linear probe setting, it also boosts the performance over the two methods by 7.3% and 3.4%, respectively. Our study also indicates that UniCL stand-alone is a good learner on pure image-label data, rivaling the supervised learning methods across three im-age classification datasets and two types of vision back-bones, ResNet and Swin Transformer. Code is available at: https://github.com/microsoft/UniCL.
Metaverse in Healthcare Integrated with Explainable AI and Blockchain: Enabling Immersiveness, Ensuring Trust, and Providing Patient Data Security

Digitization and automation have always had an immense impact on healthcare. It embraces every new and advanced technology. Recently the world has witnessed the prominence of the metaverse which is an emerging technology in digital space. The metaverse has huge potential to provide a plethora of health services seamlessly to patients and medical professionals with an immersive experience. This paper proposes the amalgamation of artificial intelligence and blockchain in the metaverse to provide better, faster, and more secure healthcare facilities in digital space with a realistic experience. Our proposed architecture can be summarized as follows. It consists of three environments, namely the doctor's environment, the patient's environment, and the metaverse environment. The doctors and patients interact in a metaverse environment assisted by blockchain technology which ensures the safety, security, and privacy of data. The metaverse environment is the main part of our proposed architecture. The doctors, patients, and nurses enter this environment by registering on the blockchain and they are represented by avatars in the metaverse environment. All the consultation activities between the doctor and the patient will be recorded and the data, i.e., images, speech, text, videos, clinical data, etc., will be gathered, transferred, and stored on the blockchain. These data are used for disease prediction and diagnosis by explainable artificial intelligence (XAI) models. The GradCAM and LIME approaches of XAI provide logical reasoning for the prediction of diseases and ensure trust, explainability, interpretability, and transparency regarding the diagnosis and prediction of diseases. Blockchain technology provides data security for patients while enabling transparency, traceability, and immutability regarding their data. These features of blockchain ensure trust among the patients regarding their data. Consequently, this proposed architecture ensures transparency and trust regarding both the diagnosis of diseases and the data security of the patient. We also explored the building block technologies of the metaverse. Furthermore, we also investigated the advantages and challenges of a metaverse in healthcare.
A Secured Database Monitoring Method to Improve Data Backup and Recovery Operations in Cloud Computing

In general, the company sometimes uses unregistered functions in database, which significantly improves performance, but does not leave the possibility of recovery except for backup. That is, actions must be performed immediately after passing the session. A queue problem is likely to cause data loss and downtime of about a week. In modern conditions, this can lead to the bankruptcy of the company. It can be seen that backup systems have been installed and configured, but despite this, they have not succeeded in restoring within the time frame specified in the SLA. In this study, a secured database monitoring method was proposed to improve data backup and recovery operations in cloud computing. In this proposed method, the backup speed is directly proportional to the amount of data, while having at least 30% annual data growth. In 3–4 years, the data at least doubled, but for some companies, this number is even higher, while the backup speed does not change. Those terms and those SLAs that were relevant 3–4 years ago now need to be at least doubled. At the same time, business requirements for data recovery (recovery point objective/recovery time objective) continue to grow
Deep learning: Applications, architectures, models, tools, and frameworks: A comprehensive survey

Abstract Deep Learning (DL) is a subfield of machine learning that significantly impacts extracting new knowledge. By using DL, the extraction of advanced data representations and knowledge can be made possible. Highly effective DL techniques help to find more hidden knowledge. Deep learning has a promising future due to its great performance and accuracy. We need to understand the fundamentals and the state‐of‐the‐art of DL to leverage it effectively. A survey on DL ways, advantages, drawbacks, architectures, and methods to have a straightforward and clear understanding of it from different views is explained in the paper. Moreover, the existing related methods are compared with each other, and the application of DL is described in some applications, such as medical image analysis, handwriting recognition, and so on.
Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book

Advances in natural language processing have resulted in large language models (LLMs) that can generate code and code explanations. In this paper, we report on our experiences generating multiple code explanation types using LLMs and integrating them into an interactive e-book on web software development. Three different types of explanations -- a line-by-line explanation, a list of important concepts, and a high-level summary of the code -- were created. Students could view explanations by clicking a button next to code snippets, which showed the explanation and asked about its utility. Our results show that all explanation types were viewed by students and that the majority of students perceived the code explanations as helpful to them. However, student engagement varied by code snippet complexity, explanation type, and code snippet length. Drawing on our experiences, we discuss future directions for integrating explanations generated by LLMs into CS classrooms.
Deep Long-Tailed Learning: A Survey

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning has emerged as a powerful recognition model for learning high-quality image representations and has led to remarkable breakthroughs in generic visual recognition. However, long-tailed class imbalance, a common problem in practical visual recognition tasks, often limits the practicality of deep network based recognition models in real-world applications, since they can be easily biased towards dominant classes and perform poorly on tail classes. To address this problem, a large number of studies have been conducted in recent years, making promising progress in the field of deep long-tailed learning. Considering the rapid evolution of this field, this article aims to provide a comprehensive survey on recent advances in deep long-tailed learning. To be specific, we group existing deep long-tailed learning studies into three main categories (i.e., class re-balancing, information augmentation and module improvement), and review these methods following this taxonomy in detail. Afterward, we empirically analyze several state-of-the-art methods by evaluating to what extent they address the issue of class imbalance via a newly proposed evaluation metric, i.e., relative accuracy. We conclude the survey by highlighting important applications of deep long-tailed learning and identifying several promising directions for future research.
ChatGPT: A revolutionary tool for teaching and learning mathematics

This study aims to examine the perspectives of various stakeholders, such as students and educators, on the use of artificial intelligence in teaching mathematics, specifically after the launch of ChatGPT. The study adopts a qualitative case study approach consisting of two stages: content analysis of interviews and investigation of user experience. The first stage of the study shows that ChatGPT is recognized for its improved math capabilities and ability to increase educational success by providing users with basic knowledge of mathematics and various topics. ChatGPT can offer comprehensive instruction and assistance in the study of geometry, and the public discourse on social media is generally positive, with enthusiasm for the use of ChatGPT in teaching mathematics and educational settings. However, there are also voices that approach using ChatGPT in educational settings with caution. In the second stage of the study, the investigation of user experiences through three educational scenarios revealed various issues. ChatGPT lacks a deep understanding of geometry and cannot effectively correct misconceptions. The accuracy and effectiveness of ChatGPT solutions may depend on the complexity of the equation, input data, and the instructions given to ChatGPT. ChatGPT is expected to become more efficient in resolving increasingly complex mathematical problems. The results of this investigation propose a number of avenues for research that ought to be explored in order to guarantee the secure and conscientious integration of chatbots, especially ChatGPT, into mathematics education and learning.
Deep Learning for Multi-Class Identification From Domestic Violence Online Posts

Domestic violence (DV) is not only a major health and welfare issue but also a violation of human rights. In recent years, domestic violence crisis support (DVCS) groups active on social media have proven indispensable in the support services provided to victims and their families. In the deluge of online-generated content, the significant challenge arises for DVCS groups' to manually detect the critical situation in a timely manner. For instance, the reports of abuse or urgent financial help solicitation are typically obscured by a vast amount of awareness campaigns or prayers for the victims. The state-of-the-art deep learning models with the embeddings approach have already demonstrated superior results in online text classification tasks. The automatic content categorization would address the scalability issue and allow the DVCS groups to intervene instantly with the exact support needed. Given the problem identified, the study aims to: 1) construct the novel “gold standard' dataset from social media with multi-class annotation; 2) perform the extensive experiments with multiple deep learning architectures; 3) train the domain-specific embeddings for performance improvement and knowledge discovery; and 4) produce the visualizations to facilitate models analysis and results in interpretation. The empirical evidence on a ground truth dataset has achieved an accuracy of up to 92% in classes prediction. The study validates an application of cutting edge technology to a real-world problem and proves beneficial to DVCS groups, health care practitioners, and most of all victims.
COVID-19—Extending Surveillance and the Panopticon

Surveillance is a core function of all public health systems. Responses to the COVID-19 pandemic have deployed traditional public health surveillance responses, such as contact tracing and quarantine, and extended these responses with the use of varied technologies, such as the use of smartphone location data, data networks, ankle bracelets, drones, and big data analysis. Applying Foucault's (1979) notion of the panopticon, with its twin focus on surveillance and self-regulation, as the preeminent form of social control in modern societies, we examine the increasing levels of surveillance enacted during this pandemic and how people have participated in, and extended, this surveillance, self-regulation, and social control through the use of digital media. Consideration is given to how such surveillance may serve public health needs and/or political interests and whether the rapid deployment of these extensive surveillance mechanisms risks normalizing these measures so that they become more acceptable and then entrenched post-COVID-19.