Reviewerly/exHarmony huggingface dataset:
Joint Incentive Mechanism Design and Energy-Efficient Resource Allocation for Federated Learning in UAV-Assisted Internet of Vehicles

With the increasing demand for application development of task publishers (e.g., automobile enterprises) in the Internet of Vehicles (IoV), federated learning (FL) can be used to enable vehicle users (VUs) to conduct local application training without disclosing data. However, the challenges of VUs’ intermittent connectivity, low proactivity, and limited resources are inevitable issues in the process of FL. In this paper, we propose a UAV-assisted FL framework in the context of the IoV. An incentive stage and a training stage are involved in this framework. UAVs serve as central servers, which assist to incentivize VUs, manage VUs’ contributed resources, and provide model aggregation, making sure communication efficiency and mobility enhancement in FL. The numerical results show that, compared with the baseline algorithms, the proposed algorithm reduces energy consumption by 50.3% and improves model convergence speed by 30.6%.
Hardware–Software Co-Design of an Audio Feature Extraction Pipeline for Machine Learning Applications

Keyword spotting is an important part of modern speech recognition pipelines. Typical contemporary keyword-spotting systems are based on Mel-Frequency Cepstral Coefficient (MFCC) audio features, which are relatively complex to compute. Considering the always-on nature of many keyword-spotting systems, it is prudent to optimize this part of the detection pipeline. We explore the simplifications of the MFCC audio features and derive a simplified version that can be more easily used in embedded applications. Additionally, we implement a hardware generator that generates an appropriate hardware pipeline for the simplified audio feature extraction. Using Chisel4ml framework, we integrate hardware generators into Python-based Keras framework, which facilitates the training process of the machine learning models using our simplified audio features.
A method to increase video streaming speed and efficiency of storage video using multithreading and Random Access Memory

There are numerous vital applications for online video storage and network transmission today. With exceptional scalability and browser and device compatibility, Hypertext Transfer Protocol (HTTP) live streaming (HLS) is today's most popular video and audio transmission protocol. In the article, the authors proposed a method of using multithreading and Random Access Memory (RAM) to store and transmit videos to help the server achieve higher speed, improve video transmission speed and video storage efficiency. The results of this research will help multimedia server developers evaluate the appropriate balance of resource usage while still ensuring the quality of online video transmission with a large number of videos and viewers.
Threats, Attacks, and Cryptography Frameworks of Cybersecurity in Critical Infrastructures

Critical Infrastructures (CIs), such as healthcare facilities, power grids, transportation systems, and financial institutions, are vital components of a functioning society, with the economy and safety being dependent on them. Nevertheless, they have become increasingly vulnerable to cyber threats and attacks in recent years. The main reason is their inability to quickly adapt to technological changes, employ updated cryptographic frameworks, and implement a thoroughly secure architecture based on their characteristics. In this study, the unique complexities of these systems are highlighted. Various verified cyberattacks that were executed against CIs in recent years are analyzed. Moreover, the general framework of CIs is demonstrated together with the employed technologies and cryptographic primitives. A thorough architecture of said technologies is developed to better understand the targeted components and easily identify potentially hidden threats. Afterwards, threat, adversary, and attack models that target critical systems and services are designed. The purpose is a better comprehension of the systems’ vulnerabilities, attack structures, motives, and targets for assisting CIs’ designers in creating secure frameworks and mechanisms, with the ability to mitigate such threats. Lastly, security controls and cryptography frameworks are demonstrated together with efficient mitigation architectures and implementations from the research community.
Quantum complementarity from a measurement-based perspective

One of the most remarkable features of quantum physics is that attributes of quantum objects, such as the wavelike and particlelike behaviors of single photons, can be complementary in the sense that they are equally real but cannot be observed simultaneously. Quantum measurements, serving as windows providing views into the abstract edifice of quantum theory, are basic tools for manifesting the intrinsic behaviors of quantum objects. However, a quantitative formulation of complementarity that highlights its manifestations in general measurement scenarios remains elusive. Here we develop a general framework for demonstrating quantum complementarity in the form of information exclusion relations (IERs), which incorporates the wave-particle duality relations as particular examples. Moreover, we explore the applications of our theory in entanglement detection and elucidate that our IERs lead to an extended form of entropic uncertainty relations, providing insights into the connection between quantum complementarity and the preparation uncertainty.
A randomized operator splitting scheme inspired by stochastic optimization methods

Abstract In this paper, we combine the operator splitting methodology for abstract evolution equations with that of stochastic methods for large-scale optimization problems. The combination results in a randomized splitting scheme, which in a given time step does not necessarily use all the parts of the split operator. This is in contrast to deterministic splitting schemes which always use every part at least once, and often several times. As a result, the computational cost can be significantly decreased in comparison to such methods. We rigorously define a randomized operator splitting scheme in an abstract setting and provide an error analysis where we prove that the temporal convergence order of the scheme is at least 1/2. We illustrate the theory by numerical experiments on both linear and quasilinear diffusion problems, using a randomized domain decomposition approach. We conclude that choosing the randomization in certain ways may improve the order to 1. This is as accurate as applying e.g. backward (implicit) Euler to the full problem, without splitting.
Evaluation of security framework for BYOD device in cloud environment

The widespread practice of Bring your own device (BYOD) to work significantly raises cybersecurity risks. All organization’s employees and employers will greatly benefit from this trend. The growth of spyware, malware and other dubious downloads on individual devices has compelled the government to review its data security guidelines. Without user knowledge, hazardous apps are downloaded to personal devices. Both people and governments could suffer tragic consequences as a result of this. In this situation, BYODs are problematic since they can alter policies without permission and release private information. The main goal of the research was to detect fraudulent communications coming from BYOD environments. A network monitoring and managing information configuration settings of mobile devices in the network is established by providing policies and authenticating endpoint devices in the BYOD network using a mix of NAC and MDM. This framework deals with Security Manager (SaaS) as the second module is briefly described. The study's early results were positive and suggested that the framework would lessen access control-related issues.
Quantum Molecular Devices

Miniaturization has been the driving force in contemporary technologies. However, two main obstacles limit further progress: additional reduction in size has reached its quantum limit, and lithography has reached its threshold. Future progress requires tackling three challenges: chemical synthesis of a complete device, active cooling for exploiting quantum characteristics, and quantum coherent control for operation. Chemical synthesis replaces the current top-bottom approach to manufacturing with bottom-up synthesis from elementary building blocks. New ultracold synthetic methods should be developed. An additional challenge is the active cooling of molecules, where the bottleneck is entropy removal. Notably, the current solution, namely, diffusion, is too slow. A coherent approach offers a possible solution; specifically, quantum coherent control is the method of choice for manipulating ultracold matter. Finally, the many degrees of freedom of molecules should be an asset that allows the design and implementation of complex tasks such as sensing communication and computing.
Blockchain-based deep learning in IoT, healthcare and cryptocurrency price prediction: a comprehensive review

Purpose Deep learning (DL) is on the rise because it can make predictions and judgments based on data that is unseen. Blockchain technologies are being combined with DL frameworks in various industries to provide a safe and effective infrastructure. The review comprises literature that lists the most recent techniques used in the aforementioned application sectors. We examine the current research trends across several fields and evaluate the literature in terms of its advantages and disadvantages. Design/methodology/approach The integration of blockchain and DL has been explored in several application domains for the past five years (2018–2023). Our research is guided by five research questions, and based on these questions, we concentrate on key application domains such as the usage of Internet of Things (IoT) in several applications, healthcare and cryptocurrency price prediction. We have analyzed the main challenges and possibilities concerning blockchain technologies. We have discussed the methodologies used in the pertinent publications in these areas and contrasted the research trends during the previous five years. Additionally, we provide a comparison of the widely used blockchain frameworks that are used to create blockchain-based DL frameworks. Findings By responding to five research objectives, the study highlights and assesses the effectiveness of already published works using blockchain and DL. Our findings indicate that IoT applications, such as their use in smart cities and cars, healthcare and cryptocurrency, are the key areas of research. The primary focus of current research is the enhancement of existing systems, with data analysis, storage and sharing via decentralized systems being the main motivation for this integration. Amongst the various frameworks employed, Ethereum and Hyperledger are popular among researchers in the domain of IoT and healthcare, whereas Bitcoin is popular for research on cryptocurrency. Originality/value There is a lack of literature that summarizes the state-of-the-art methods incorporating blockchain and DL in popular domains such as healthcare, IoT and cryptocurrency price prediction. We analyze the existing research done in the past five years (2018–2023) to review the issues and emerging trends.
Automating Ground Control Point Detection in Drone Imagery: From Computer Vision to Deep Learning

Drone-based photogrammetry typically requires the task of georeferencing aerial images by detecting the center of Ground Control Points (GCPs) placed in the field. Since this is a very labor-intensive task, it could benefit greatly from automation. In this study, we explore the extent to which traditional computer vision approaches can be generalized to deal with variability in real-world drone data sets and focus on training different residual neural networks (ResNet) to improve generalization. The models were trained to detect single keypoints of fixed-sized image tiles with a historic collection of drone-based Red–Green–Blue (RGB) images with black and white GCP markers in which the center was manually labeled by experienced photogrammetry operators. Different depths of ResNets and various hyperparameters (learning rate, batch size) were tested. The best results reached sub-pixel accuracy with a mean absolute error of 0.586. The paper demonstrates that this approach to drone-based mapping is a promising and effective way to reduce the human workload required for georeferencing aerial images.
Exploring semantic consistency in unpaired image translation to generate data for surgical applications

In surgical computer vision applications, data privacy and expert annotation challenges impede the acquisition of labeled training data. Unpaired image-to-image translation techniques have been explored to automatically generate annotated datasets by translating synthetic images into a realistic domain. The preservation of structure and semantic consistency, i.e., per-class distribution during translation, poses a significant challenge, particularly in cases of semantic distributional mismatch.This study empirically investigates various translation methods for generating data in surgical applications, explicitly focusing on semantic consistency. Through our analysis, we introduce a novel and simple combination of effective approaches, which we call ConStructS. The defined losses within this approach operate on multiple image patches and spatial resolutions during translation.Various state-of-the-art models were extensively evaluated on two challenging surgical datasets. With two different evaluation schemes, the semantic consistency and the usefulness of the translated images on downstream semantic segmentation tasks were evaluated. The results demonstrate the effectiveness of the ConStructS method in minimizing semantic distortion, with images generated by this model showing superior utility for downstream training.In this study, we tackle semantic inconsistency in unpaired image translation for surgical applications with minimal labeled data. The simple model (ConStructS) enhances consistency during translation and serves as a practical way of generating fully labeled and semantically consistent datasets at minimal cost. Our code is available at https://gitlab.com/nct_tso_public/constructs .
Fast Digital Orthophoto Generation: A Comparative Study of Explicit and Implicit Methods

A digital orthophoto is an image with geometric accuracy and no distortion. It is acquired through a top view of the scene and finds widespread applications in map creation, planning, and related fields. This paper classifies the algorithms for digital orthophoto generation into two groups: explicit methods and implicit methods. Explicit methods rely on traditional geometric methods, obtaining geometric structure presented with explicit parameters with Multi-View Stereo (MVS) theories, as seen in our proposed Top view constrained Dense Matching (TDM). Implicit methods rely on neural rendering, obtaining implicit neural representation of scenes through the training of neural networks, as exemplified by Neural Radiance Fields (NeRFs). Both of them obtain digital orthophotos via rendering from a top-view perspective. In addition, this paper conducts an in-depth comparative study between explicit and implicit methods. The experiments demonstrate that both algorithms meet the measurement accuracy requirements and exhibit a similar level of quality in terms of generated results. Importantly, the explicit method shows a significant advantage in terms of efficiency, with a time consumption reduction of two orders of magnitude under our latest Compute Unified Device Architecture (CUDA) version TDM algorithm. Although explicit and implicit methods differ significantly in their representation forms, they share commonalities in the implementation across algorithmic stages. These findings highlight the potential advantages of explicit methods in orthophoto generation while also providing beneficial references and practical guidance for fast digital orthophoto generation using implicit methods.
Control and Position Tracking for UAVs

There has been exponential development of UAV technology and related research areas such as artificial intelligence, which will raise UAVs’ ability for autonomous flights to a higher level [...]
Solar and Wind Data Recognition: Fourier Regression for Robust Recovery

Accurate prediction of renewable energy output is essential for integrating sustainable energy sources into the grid, facilitating a transition towards a more resilient energy infrastructure. Novel applications of machine learning and artificial intelligence are being leveraged to enhance forecasting methodologies, enabling more accurate predictions and optimized decision-making capabilities. Integrating these novel paradigms improves forecasting accuracy, fostering a more efficient and reliable energy grid. These advancements allow better demand management, optimize resource allocation, and improve robustness to potential disruptions. The data collected from solar intensity and wind speed is often recorded through sensor-equipped instruments, which may encounter intermittent or permanent faults. Hence, this paper proposes a novel Fourier network regression model to process solar irradiance and wind speed data. The proposed approach enables accurate prediction of the underlying smooth components, facilitating effective reconstruction of missing data and enhancing the overall forecasting performance. The present study focuses on Midland, Texas, as a case study to assess direct normal irradiance (DNI), diffuse horizontal irradiance (DHI), and wind speed. Remarkably, the model exhibits a correlation of 1 with a minimal RMSE (root mean square error) of 0.0007555. This study leverages Fourier analysis for renewable energy applications, with the aim of establishing a methodology that can be applied to a novel geographic context.
Transfer Learning for Computer Vision

Computer vision has benefited from deep learning, making it possible to create complex systems. Computer vision has seen radical changes using deep learning techniques, specifically transfer learning for computer vision. It enables computers to understand and interpret visual data, such as images and videos, with great precision. Transfer learning in particular, is a deep learning technique that has transformed several areas of computer vision, including face recognition, semantic segmentation, object detection, and image categorization. This powerful technology is essential in applications such as autonomous vehicles, healthcare, surveillance, and more, since it has improved our capacity to identify, locate, and classify objects in images as well as comprehend complex visual scenes. In computer vision, transfer learning is a method that allows us to use previously taught models to tackle new problems. Benefits include shortened training times and efficient feature extraction. This chapter provides a brief help for implementation of transfer learning for computer vision.
VTG-GPT: Tuning-Free Zero-Shot Video Temporal Grounding with GPT

Video temporal grounding (VTG) aims to locate specific temporal segments from an untrimmed video based on a linguistic query. Most existing VTG models are trained on extensive annotated video-text pairs, a process that not only introduces human biases from the queries but also incurs significant computational costs. To tackle these challenges, we propose VTG-GPT, a GPT-based method for zero-shot VTG without training or fine-tuning. To reduce prejudice in the original query, we employ Baichuan2 to generate debiased queries. To lessen redundant information in videos, we apply MiniGPT-v2 to transform visual content into more precise captions. Finally, we devise the proposal generator and post-processing to produce accurate segments from debiased queries and image captions. Extensive experiments demonstrate that VTG-GPT significantly outperforms SOTA methods in zero-shot settings and surpasses unsupervised approaches. More notably, it achieves competitive performance comparable to supervised methods. The code is available on GitHub.
An Introduction to Reinforcement Learning and Its Application in Various Domains

Reinforcement learning (RL) is a dynamic and evolving subfield of machine learning that focuses on training intelligent agents to learn and adapt through interactions with their environment. This introductory article provides an overview of the fundamental concepts and principles of RL, elucidating its core components, such as the agent, environment, actions, and rewards. This study aims to give readers an in-depth introduction to RL and show examples of its different uses in various domains. RL can allow agents to learn through interaction with an environment, which has led to its enormous interest. The core ideas of RL and its essential elements will be covered in this study, after which it will go into applications in industries including robotics, gaming, finance, healthcare, and more. The fundamental ideas of RL will become clearer to readers, and they will recognize how transformative it can be when used to address challenging decision-making issues. These applications demonstrate the versatility and significance of RL in shaping the future of technology and automation.
Non-Autoregressive Line-Level Code Completion

Software developers frequently use code completion tools to accelerate software development by suggesting the following code elements. Researchers usually employ AutoRegressive (AR) decoders to complete code sequences in a left-to-right, token-by-token fashion. To improve the accuracy and efficiency of code completion, we argue that tokens within a code statement have the potential to be predicted concurrently. In this paper, we first conduct an empirical study to analyze the dependency among the target tokens in line-level code completion. The results suggest that it is potentially practical to generate all statement tokens in parallel. To this end, we introduce SANAR, a simple and effective syntax-aware non-autoregressive model for line-level code completion. To further improve the quality of the generated code, we propose an adaptive and syntax-aware sampling strategy to boost the model’s performance. The experimental results obtained from two widely used datasets indicate that our model outperforms state-of-the-art code completion approaches of similar model size by a considerable margin, and is faster than these models with up to 9 × speed-up. Moreover, the extensive results additionally demonstrate that the enhancements achieved by SANAR become even more pronounced with larger model sizes, highlighting their significance.