Reviewerly/exHarmony huggingface dataset:
An adaptive quadratic interpolation and rounding mechanism sine cosine algorithm with application to constrained engineering optimization problems

The sine cosine algorithm (SCA) is a well-known meta-heuristic optimization algorithm. SCA has received much attention in various optimization fields due to its simple structure and excellent optimization capabilities. However, the dimension of objective function also increases with the increasing complexity of optimization tasks. This makes the original SCA appear to have insufficient optimization capability and likely to fall into premature convergence. A multi-mechanism acting variant of SCA, called ARSCA, is proposed to address the above deficiencies. ARSCA is an enhanced SCA algorithm based on the adaptive quadratic interpolation mechanism (AQIM) and Rounding mechanism (RM). RM enables a more balanced state between exploration and exploitation of the ARSCA. AQIM enhances local exploitation capabilities. To verify the performance of ARSCA, we compared ARSCA with some advanced traditional optimization algorithms and variants of algorithms for 30 consecutive benchmark functions of IEEE CEC2014. In addition, ARSCA was applied to 6 constrained engineering optimization problems. These six algorithms include the tension–compression spring design problem, the welded beam design problem, the pressure vessel design problem, the I-beam design problem, the speed reducer design problem, and the three-bar design problem. Experimental results show that ARSCA outperforms its competitors in both the solution quality and the ability to jump out of the local optimum. The relevant codes for the paper are publicly available at https://github.com/YangXiao9799/paper_ARSCA.
Application of Meta-Heuristic Algorithms for Training Neural Networks and Deep Learning Architectures: A Comprehensive Review

The learning process and hyper-parameter optimization of artificial neural networks (ANNs) and deep learning (DL) architectures is considered one of the most challenging machine learning problems. Several past studies have used gradient-based back propagation methods to train DL architectures. However, gradient-based methods have major drawbacks such as stucking at local minimums in multi-objective cost functions, expensive execution time due to calculating gradient information with thousands of iterations and needing the cost functions to be continuous. Since training the ANNs and DLs is an NP-hard optimization problem, their structure and parameters optimization using the meta-heuristic (MH) algorithms has been considerably raised. MH algorithms can accurately formulate the optimal estimation of DL components (such as hyper-parameter, weights, number of layers, number of neurons, learning rate, etc.). This paper provides a comprehensive review of the optimization of ANNs and DLs using MH algorithms. In this paper, we have reviewed the latest developments in the use of MH algorithms in the DL and ANN methods, presented their disadvantages and advantages, and pointed out some research directions to fill the gaps between MHs and DL methods. Moreover, it has been explained that the evolutionary hybrid architecture still has limited applicability in the literature. Also, this paper classifies the latest MH algorithms in the literature to demonstrate their effectiveness in DL and ANN training for various applications. Most researchers tend to extend novel hybrid algorithms by combining MHs to optimize the hyper-parameters of DLs and ANNs. The development of hybrid MHs helps improving algorithms performance and capable of solving complex optimization problems. In general, the optimal performance of the MHs should be able to achieve a suitable trade-off between exploration and exploitation features. Hence, this paper tries to summarize various MH algorithms in terms of the convergence trend, exploration, exploitation, and the ability to avoid local minima. The integration of MH with DLs is expected to accelerate the training process in the coming few years. However, relevant publications in this way are still rare.
A Novel Chaos-Based Privacy-Preserving Deep Learning Model for Cancer Diagnosis

Early cancer identification is regarded as a challenging problem in cancer prevention for the healthcare community. In addition, ensuring privacy-preserving healthcare data becomes more difficult with the growing demand for sharing these data. This study proposes a novel privacy-preserving non-invasive cancer detection method using Deep Learning (DL). Initially, the clinical data is collected over the Internet via wireless channels for diagnostic purposes. It is paramount to secure personal clinical data against eavesdropping by unauthorized users that may exploit it for personalized interests. Therefore, the collected data is encrypted before transmission over the channel to prevent data theft. Various security measures, including correlation, entropy, contrast, structural content, and energy, are used to assess the proposed encryption method's efficiency. In this paper, we proposed using the Convolutional Neural Network (CNN)-based model and Magnetic Resonance Imaging (MRI) with different techniques, including transfer learning, fine-tuning, and K-fold analysis cancer detection. Extensive experiments are carried out to evaluate the performance of the proposed DL techniques with regard to traditional machine learning approaches such as Decision Tree (DT), Naive Bayes (NB), Random Forest (RF), and Support Vector Machine (SVM). Results show that the CNN-based model has achieved an accuracy of 98.9% and outperforms conventional ML algorithms. Further experiments demonstrate the efficiency of both encryption schemes, achieving entropy, contrast, and energy of 7.9999, 10.9687, and 0.0151, respectively.
Optimizing the thermal performance of solar energy devices using meta-heuristic algorithms: A critical review

Since solar energy is intermittent, finding the best solutions for solar operated devices is a challenge. Multiple techniques exist to reach the best solutions for optimal solar operated devices. A thorough review of solar energy systems' optimization methods and tools is presented in this work. The intelligent optimization techniques for solar energy systems are discussed, including their functions, constraints, contributions, mathematical models, and analysis methods. Optimization studies using new and traditional generation techniques are analyzed, and a few optimization methods, including combined hybrid algorithms, are presented. New generation artificial intelligence algorithms have been most widely used during the last decade, needing less computational time. They have good convergence and better accuracy than traditional optimization methods. They can scan local and global optima and do robust calculations. Solar system optimization has demonstrated remarkable benefits in size, load demand, and electricity output. The improvements reduce operating expenditures, power losses, and peak output integration and controllability. With a 50% rise in power prices, the optimal number of solar collectors rises by approximately 25%. However, with adjustment as per optimization techniques, the solar absorption cooling system's maximum thermal efficiency can be increased up to 75%. The present study recommends using two or more algorithms to overcome the curbs of a single algorithm. The main aim of the optimization strategies, according to this assessment, is to reduce capital expenditures, operation and maintenance expenses, and emissions while improving system reliability. The paper also briefly describes several solar energy optimization challenges and issues. Lastly, some practical future approaches for establishing a reliable and efficient solar power system are proposed for developing the complex renewable energy-based hybrid system.
CT synthesis from MR in the pelvic area using Residual Transformer Conditional GAN

Magnetic resonance (MR) image-guided radiation therapy is a hot topic in current radiation therapy research, which relies on MR to generate synthetic computed tomography (SCT) images for radiation therapy. Convolution-based generative adversarial networks (GAN) have achieved promising results in synthesizing CT from MR since the introduction of deep learning techniques. However, due to the local limitations of pure convolutional neural networks (CNN) structure and the local mismatch between paired MR and CT images, particularly in pelvic soft tissue, the performance of GAN in synthesizing CT from MR requires further improvement. In this paper, we propose a new GAN called Residual Transformer Conditional GAN (RTCGAN), which exploits the advantages of CNN in local texture details and Transformer in global correlation to extract multi-level features from MR and CT images. Furthermore, the feature reconstruction loss is used to further constrain the image potential features, reducing over-smoothing and local distortion of the SCT. The experiments show that RTCGAN is visually closer to the reference CT (RCT) image and achieves desirable results on local mismatch tissues. In the quantitative evaluation, the MAE, SSIM, and PSNR of RTCGAN are 45.05 HU, 0.9105, and 28.31 dB, respectively. All of them outperform other comparison methods, such as deep convolutional neural networks (DCNN), Pix2Pix, Attention-UNet, WPD-DAGAN, and HDL.
Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and provides a principled way to maintain the representations of old models while adjusting to new tasks effectively. The proposed method estimates the relationship between the representation changes and the resulting loss increases incurred by model updates. It minimizes the upper bound of the loss increases using the representations, which exploits the estimated importance of each feature map within a backbone model. Based on the importance, the model restricts updates of important features for robustness while allowing changes in less critical features for flexibility. This optimization strategy effectively alleviates the notorious catastrophic forgetting problem despite the limited accessibility of data in the previous tasks. The experimental results show significant accuracy improvement of the proposed algorithm over the existing methods on the standard datasets. Code is available. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> https://github.com/kminsoo/AFC
Clothes-Changing Person Re-identification with RGB Modality Only

The key to address clothes-changing person re-identification (re-id) is to extract clothes-irrelevant features, e.g., face, hairstyle, body shape, and gait. Most current works mainly focus on modeling body shape from multi-modality information (e.g., silhouettes and sketches), but do not make full use of the clothes-irrelevant information in the original RGB images. In this paper, we propose a Clothes-based Adversarial Loss (CAL) to mine clothes-irrelevant features from the original RGB images by penalizing the predictive power of re-id model w.r.t. clothes. Extensive experiments demonstrate that using RGB images only, CAL outperforms all state-of-the-art methods on widely-used clothes-changing person re-id benchmarks. Besides, compared with images, videos contain richer appearance and additional temporal information, which can be used to model proper spatiotemporal patterns to assist clothes-changing re-id. Since there is no publicly available clothes-changing video re-id dataset, we contribute a new dataset named CCVID and show that there exists much room for improvement in modeling spatiotemporal information. The code and new dataset are available at: h t t <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$p$</tex> s: //github.com/guxinqian/Simple-CCReID.
Deep Color Consistent Network for Low-Light Image Enhancement

Low-light image enhancement (LLIE) explores how to refine the illumination and obtain natural normal-light images. Current LLIE methods mainly focus on improving the illumination, but do not consider the color consistency by reasonably incorporating color information into the LLIE process. As a result, color difference usually exists between the enhanced image and ground-truth. To address this issue, we propose a new deep color consistent network termed DCC-Net to retain the color consistency for LLIE. A new “divide and conquer” collaborative strategy is presented, which can jointly preserve color information and enhance the illumination. Specifically, the decoupling strategy of our DCC-Net decouples each color image into two main components, i.e., gray image plus color histogram. Gray image is used to generate reasonable structures and textures, and the color histogram is beneficial for preserving the color consistency. That is, they both are utilized to complete the LLIE task collaboratively. To match the color and content features, and reduce the color consistency gap between enhanced image and ground-truth, we also design a new pyramid color embedding (PCE) module, which can better embed color information into the LLIE process. Extensive experiments on six real datasets show that the enhanced images of our DCC-Net are more natural and colorful, and perform favorably against the state-of-the-art methods.
Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey

As the computing paradigm shifts from cloud computing to end-edge-cloud computing, it also supports artificial intelligence evolving from a centralized manner to a distributed one. In this paper, we provide a comprehensive survey on the distributed artificial intelligence (DAI) empowered by end-edge-cloud computing (EECC), where the heterogeneous capabilities of on-device computing, edge computing, and cloud computing are orchestrated to satisfy the diverse requirements raised by resource-intensive and distributed AI computation. Particularly, we first introduce several mainstream computing paradigms and the benefits of the EECC paradigm in supporting distributed AI, as well as the fundamental technologies for distributed AI. We then derive a holistic taxonomy for the state-of-the-art optimization technologies that are empowered by EECC to boost distributed training and inference, respectively. After that, we point out security and privacy threats in DAI-EECC architecture and review the benefits and shortcomings of each enabling defense technology in accordance with the threats. Finally, we present some promising applications enabled by DAI-EECC and highlight several research challenges and open issues toward immersive performance acquisition.
Hybrid Motion Model for Multiple Object Tracking in Mobile Devices

For an intelligent transportation system, multiple object tracking (MOT) is more challenging from the traditional static surveillance camera to mobile devices of the Internet of Things (IoT). To cope with this problem, previous works always rely on additional information from multivision, various sensors, or precalibration. Only based on a monocular camera, we propose a hybrid motion model to improve the tracking accuracy in mobile devices. First, the model evaluates camera motion hypotheses by measuring optical flow similarity and transition smoothness to perform robust camera trajectory estimation. Second, along the camera trajectory, smooth dynamic projection is used to map objects from image to world coordinate. Third, to deal with trajectory motion inconsistency, which is caused by occlusion and interaction of long time interval, tracklet motion is described by the multimode motion filter for adaptive modeling. Fourth, in tracklets association, we propose a spatiotemporal evaluation mechanism, which achieves higher discriminability in motion measurement. Experiments on MOT15, MOT17, and KITTI benchmarks show that our proposed method improves the trajectory accuracy, especially in mobile devices and our method achieves competitive results over other state-of-the-art methods.
StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two main challenges in 3D-aware GANs: 1) high-resolution, view-consistent generation of the RGB images, and 2) detailed 3D shape. We achieve this by merging a SDF-based 3D representation with a style-based 2D generator. Our 3D implicit network renders low-resolution feature maps, from which the style-based network generates view-consistent, 1024×1024 images. Notably, our SDF-based 3D modeling defines detailed 3D surfaces, leading to consistent volume rendering. Our method shows higher quality results compared to state of the art in terms of visual and geometric quality.
Spatial–Spectral Weighted and Regularized Tensor Sparse Correlation Filter for Object Tracking in Hyperspectral Videos

Hyperspectral video camera captures spatial, spectral and temporal information of moving objects. Traditional object tracking methods developed for color videos have been applied to hyperspectral videos after compressing hundreds of spectral bands into three, which does not fully utilize the wealth spectral information. In order to address this issue, we present a tensor sparse correlation filter with a spatial-spectral weighted regularizer for object tracking. First, tensor processing is employed to reduce the spectral differences of homogeneous background, thereby producing robust spectral structure features. Second, a spatial-spectral weighted regularizer is designed in the correlation filter framework to penalize filter template by suppressing spectral features dissimilar to the center pixel in tracking. Third, a sparse constraint term and tracking context information are incorporated to suppress unexpected peaks in the response map. Finally, a reformulated stacked HOG feature extractor and a two-dimensional adaptive scale search strategy are developed to further improve the tracker’s feature discrimination and scale adaptation capability. Experimental results demonstrate that the proposed method achieves superior tracking performance than traditional correlation filter-based trackers.
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal gaps remain unanswered, limiting applicability and quality. We propose a novel text-to-image method that addresses these gaps by (i) enabling a simple control mechanism complementary to text in the form of a scene, (ii) introducing elements that substantially improve the tokenization process by employing domain-specific knowledge over key image regions (faces and salient objects), and (iii) adapting classifier-free guidance for the transformer use case. Our model achieves state-of-the-art FID and human evaluation results, unlocking the ability to generate high fidelity images in a resolution of $$512\times 512$$ pixels, significantly improving visual quality. Through scene controllability, we introduce several new capabilities: (i) Scene editing, (ii) text editing with anchor scenes, (iii) overcoming out-of-distribution text prompts, and (iv) story illustration generation, as demonstrated in the story we wrote .
Multimodal Token Fusion for Vision Transformers

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vision transformers could improve the performance, yet the innermodal attentive weights may be diluted, which could thus greatly undermine the final performance. In this paper, we propose a multimodal token fusion method (TokenFusion), tailored for transformer-based vision tasks. To effectively fuse multiple modalities, TokenFusion dynamically detects uninformative tokens and substitute these tokens with projected and aggregated inter-modal features. Residual positional alignment is also adopted to enable explicit utilization of the inter-modal alignments after fusion. The design of TokenFusion allows the transformer to learn correlations among multimodal features, while the single-modal transformer architecture remains largely intact. Extensive experiments are conducted on a variety of homogeneous and heterogeneous modalities and demonstrate that TokenFusion surpasses state-of-the-art methods in three typical vision tasks: multimodal image-to-image translation, RGB-depth semantic segmentation, and 3D object detection with point cloud and images. Code will be released <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> https://github.com/huawei-noah/noah-research <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> https://gitee.com/mindspore/models/tree/master/research/cv/TokenFusion.
Weather Impact on Solar Farm Performance: A Comparative Analysis of Machine Learning Techniques

Forecasting the performance and energy yield of photovoltaic (PV) farms is crucial for establishing the economic sustainability of a newly installed system. The present study aims to develop a prediction model to forecast an installed PV system’s annual power generation yield and performance ratio (PR) using three environmental input parameters: solar irradiance, wind speed, and ambient air temperature. Three data-based artificial intelligence (AI) techniques, namely, adaptive neuro-fuzzy inference system (ANFIS), response surface methodology (RSM), and artificial neural network (ANN), were employed. The models were developed using three years of data from an operational 2MWp Solar PV Project at Kuzhalmannam, Kerala state, India. Statistical indices such as Pearson’s R, coefficient of determination (R2), root-mean-squared error (RMSE), Nash-Sutcliffe efficiency (NSCE), mean absolute-percentage error (MAPE), Kling-Gupta efficiency (KGE), Taylor’s diagram, and correlation matrix were used to determine the most accurate prediction model. The results demonstrate that ANFIS was the most precise performance ratio prediction model, with an R2 value of 0.9830 and an RMSE of 0.6. It is envisaged that the forecast model would be a valuable tool for policymakers, solar energy researchers, and solar farm developers.