Miracle-dz/UniFAR-FTUs huggingface dataset:
Dynamic and Memory-efficient Shape Based Methodologies for User Type Identification in Smart Grid Applications

Detecting behind-the-meter (BTM) equipment and major appliances at the residential level and tracking their changes in real time is important for aggregators and traditional electricity utilities. In our previous work, we developed a systematic solution called IRMAC to identify residential users' BTM equipment and applications from their imported energy data. As a part of IRMAC, a Similarity Profile (SP) was proposed for dimensionality reduction and extracting self-join similarity from the end users' daily electricity usage data. The proposed SP calculation, however, was computationally expensive and required a significant amount of memory at the user's end. To realise the benefits of edge computing, in this paper, we propose and assess three computationally-efficient updating solutions, namely additive, fixed memory, and codebook-based updating methods. Extensive simulation studies are carried out using real PV users' data to evaluate the performance of the proposed methods in identifying PV users, tracking changes in real time, and examining memory usage. We found that the Codebook-based solution reduces more than 30\% of the required memory without compromising the performance of extracting users' features. When the end users' data storage and computation speed are concerned, the fixed-memory method outperforms the others. In terms of tracking the changes, different variations of the fixed-memory method show various inertia levels, making them suitable for different applications.
TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessment

Recently, AIGC image quality assessment (AIGCIQA), which aims to assess the quality of AI-generated images (AIGIs) from a human perception perspective, has emerged as a new topic in computer vision. Unlike common image quality assessment tasks where images are derived from original ones distorted by noise, blur, and compression, \textit{etc.}, in AIGCIQA tasks, images are typically generated by generative models using text prompts. Considerable efforts have been made in the past years to advance AIGCIQA. However, most existing AIGCIQA methods regress predicted scores directly from individual generated images, overlooking the information contained in the text prompts of these images. This oversight partially limits the performance of these AIGCIQA methods. To address this issue, we propose a text-image encoder-based regression (TIER) framework. Specifically, we process the generated images and their corresponding text prompts as inputs, utilizing a text encoder and an image encoder to extract features from these text prompts and generated images, respectively. To demonstrate the effectiveness of our proposed TIER method, we conduct extensive experiments on several mainstream AIGCIQA databases, including AGIQA-1K, AGIQA-3K, and AIGCIQA2023. The experimental results indicate that our proposed TIER method generally demonstrates superior performance compared to baseline in most cases.
A hybrid metaheuristic to optimize electric first-mile feeder services with charging synchronization constraints and customer rejections

This paper addresses the on-demand meeting-point-based feeder electric bus routing and charging scheduling problem under charging synchronization constraints. The problem considered exhibits the structure of the location routing problem, which is more difficult to solve than many electric vehicle routing problems with capacitated charging stations. We propose to model the problem using a mixed-integer linear programming approach based on a layered graph structure. An efficient hybrid metaheuristic solution algorithm is proposed. A mixture of random and greedy partial charging scheduling strategies is used to find feasible charging schedules under the synchronization constraints. The algorithm is tested on instances with up to 100 customers and 49 bus stops/meeting points. The results show that the proposed algorithm provides near-optimal solutions within less one minute on average compared with the best solutions found by a mixed-integer linear programming solver set with a 4-hour computation time limit. A case study on a larger sized case with 1000 customers and 111 meeting points shows the proposed method is applicable to real-world situations.
An adaptive numerical method for multi-cellular simulations of organ development and disease

In recent years, multi-cellular models, where cells are represented as individual interacting entities, are becoming ever popular. This has led to a proliferation of novel methods and simulation tools. The first aim of this paper is to review the numerical methods utilised by multi-cellular modelling tools and to demonstrate which numerical methods are appropriate for simulations of tissue and organ development and disease. The second aim is to introduce an adaptive time-stepping algorithm and to demonstrate it’s efficiency and accuracy. We focus on off-lattice, mechanics based, models where cell movement is defined by a series of differential equations, derived by considering a force balance. We see that many numerical methods have been used, ranging from simple Forward Euler approaches through to higher order single-step methods like Runge-Kutta 4 and multi-step methods like Adams-Bashforth 2. Through a series of exemplar multi-cellular simulations, we see that if: care is taken to have events (births deaths and re-meshing/re-arrangements) occur on common time-steps; and boundaries are imposed on all sub-steps of numerical methods or implemented using forces, then all numerical methods can converge with the correct order. We introduce an adaptive time-stepping method and demonstrate that the best compromise between L∞ error and run-time is to use Runge-Kutta 4 with an increased time-step and moderate adaptivity. We see that a judicious choice of numerical method can speed the simulation up by a factor of 10 and a further speed up by a factor of 4 can be achieved by using an adaptive time-step.
Information-based rhythmic transcranial magnetic stimulation accelerates learning during auditory working memory training

Rhythmic transcranial magnetic stimulation (rhTMS) has been shown to enhance auditory working memory manipulation, specifically by boosting theta oscillatory power in the dorsal auditory pathway during task performance. It remains unclear whether these enhancements i) persist beyond the period of stimulation, ii) if they can accelerate learning and iii) if they would accumulate over several days of stimulation. In the present study, we investigated the lasting behavioural and electrophysiological effects of applying rhTMS over the left intraparietal sulcus (IPS) throughout the course of seven sessions of cognitive training on an auditory working memory task. Fourteen neurologically healthy participants took part in the training protocol with an auditory working memory task while being stimulated with either theta (5Hz) rhTMS or sham TMS. Electroencephalography (EEG) was recorded before, throughout five training sessions and after the end of training to assess to effects of rhTMS on behavioural performance and on oscillatory entrainment of the dorsal auditory network. We show that this combined approach enhances theta oscillatory activity within the fronto-parietal network and causes improvements in auditory working memory performance. We show that compared to individuals who received sham stimulation, cognitive training can be accelerated when combined with optimized rhTMS, and that task performance benefits can outlast the training period by up to 3 days. Furthermore, we show that there is increased theta oscillatory power within the recruited dorsal auditory network during training, and that sustained EEG changes can be observed up to 3 days following stimulation. The present study improves our understanding of the causal dynamic interactions supporting auditory working memory. Our results constitute an important proof of concept for the potential translational impact of non-invasive brain stimulation protocols and provide preliminary data for developing optimized rhTMS and training protocols that could be implemented in clinical populations.
EAT: Self-Supervised Pre-Training with Efficient Audio Transformer

Audio self-supervised learning (SSL) pre-training, which aims to learn good representations from unlabeled audio, has made remarkable progress. However, the extensive computational demands during pre-training pose a significant barrier to the potential application and optimization of audio SSL models. In this paper, inspired by the success of data2vec 2.0 in image modality and Audio-MAE in audio modality, we introduce Efficient Audio Transformer (EAT) to further improve the effectiveness and efficiency in audio SSL. The proposed EAT adopts the bootstrap self-supervised training paradigm to the audio domain. A novel Utterance-Frame Objective (UFO) is designed to enhance the modeling capability of acoustic events. Furthermore, we reveal that the masking strategy is critical in audio SSL pre-training, and superior audio representations can be obtained with large inverse block masks. Experiment results demonstrate that EAT achieves state-of-the-art (SOTA) performance on a range of audio-related tasks, including AudioSet (AS-2M, AS-20K), ESC-50, and SPC-2, along with a significant pre-training speedup up to ~15x compared to existing audio SSL models.
Advancing Noise-Resilient Twist Angle Characterization in Bilayer Graphene through Raman Spectroscopy via GAN-CNN Modeling

In this study, we introduce an innovative methodology for robust twist angle identification in bilayer graphene using Raman spectroscopy, featuring the integration of generative adversarial network and convolutional neural network (GAN-CNN). Our proposed approach showcases remarkable resistance to noise interference, particularly in ultra-low Signal-to-Noise Ratio (SNR) conditions. We demonstrate the GAN-CNN model's robust learning capability, even when SNR reaches minimal levels. The model's exceptional noise resilience negates the necessity for preprocessing steps, facilitating accurate classification, and substantially reducing computational expenses. Empirical results reveal the model's prowess, achieving heightened accuracy in twist angle identification. Specifically, our GAN-CNN model achieves a test accuracy exceeding 99.9% and a recall accuracy of 99.9%, relying on an augmented dataset containing 4209 spectra. This work not only contributes to the evolution of noise-resistant spectral analysis methodologies but also provides crucial insights into the application of advanced deep learning techniques for bilayer graphene characterization through Raman spectroscopy. The findings presented herein have broader implications for enhancing the precision and efficiency of material characterization methodologies, laying the foundation for future advancements in the field.
Scheduling for Downlink OFDMA With IRS Reconfiguration Constraints

The technical limitations of the intelligent reflecting surface (IRS) (re)configurations in terms of both communication overhead and energy efficiency must be considered when IRSs are used in cellular networks. In this paper, we investigate the downlink time-frequency scheduling of an IRS-assisted multi-user system in the orthogonal frequency-division multiple access (OFDMA) framework wherein both the set of possible IRS configurations and the number of IRS reconfigurations within a time frame are limited. We formulate the sum rate maximization problem as a non-polynomial (NP)-complete generalized multi-knapsack problem. A heuristic greedy algorithm for the joint IRS configuration and time-frequency scheduling is also proposed. Numerical simulations prove the effectiveness of our greedy solution.
More MDS codes of non-Reed-Solomon type

MDS codes have diverse practical applications in communication systems, data storage, and quantum codes due to their algebraic properties and optimal error-correcting capability. In this paper, we focus on a class of linear codes and establish some sufficient and necessary conditions for them being MDS. Notably, these codes differ from Reed-Solomon codes up to monomial equivalence. Additionally, we also explore the cases in which these codes are almost MDS or near MDS. Applying our main results, we determine the covering radii and deep holes of the dual codes associated with specific Roth-Lempel codes and discover an infinite family of (almost) optimally extendable codes with dimension three.
Warming Effect Reanalysis of Greenhouse Gases and Clouds

The author has reanalysed the warming effects of greenhouse (GH) gases utilising the latest HITRAN 2012 database and improved water continuum calculations in the spectral analysis tool. The contributions of GH gases in the GH effect in the all-sky conditions are found to be: H2O 81%, CO2 13%, O3 4%, CH4 & N2O 1%, and clouds 1%. Because the total absorption is already 93% from the maximum in the altitude of 1.6 km, which is the average global cloud base, the GH gas impacts are almost the same in the clear and all-sky conditions. The impacts of clouds are based on the normal cloudiness changes between the clear and cloudy skies. The positive impact of clouds is analysed and it is based on the warming impact of clouds during the night-time. The warming impact of CO2 is very nonlinear and it means that in the present climate the strength of H2O is 11.8 times stronger than CO2, when in the total GH effect this relationship is 6.2:1. The atmospheric Total Precipitable Water (TPW) changes during ENSO events are the essential parts of the ENSO process and they are not actually separate feedback processes. The TPW changes during the ENSO events almost double the original ENSO effects. On the other hand, during Mt. Pinatubo eruption and during the three latest solar cycles, the long-term water feedback effect cannot be found despite of rapid warming from 1980 to 2000. This empirical result confirms that the assumption of no water feedback in calculating the climate sensitivity of 0.6°C is justified. Because there is no long-term positive feedback, it explains why the IPCC model calculated temperature 1.2°C in 2015 is 44 % greater than the average 0.85oC of the pause period since 2000. Original Research Article Ollila; PSIJ, 13(2): 1-13, 2017; Article no.PSIJ. 30781 2
Loss of the E3 ubiquitin ligase TRIM67 alters the post-synaptic density proteome

The E3 ubiquitin ligase TRIM67 is enriched in the central nervous system and is required for proper neuronal development. Previously we demonstrated TRIM67 coordinates with the closely related E3 ubiquitin ligase TRIM9 to regulate cytoskeletal dynamics downstream of the netrin-1 during axon guidance and axon branching in early neuronal morphogenesis. Interestingly, loss of Trim67 impacts cognitive flexibility in a spatial learning and memory task. Despite this behavioral phenotype, it was previously uninvestigated if TRIM67 was involved in synapse formation or function. Here we demonstrate TRIM67 localizes to the post-synaptic density (PSD) within dendritic spines. Furthermore, we show that loss of Trim67 significantly changes the PSD proteome, including changes in the regulation of the actin and microtubule cytoskeletons. Collectively, our data propose a synaptic role for TRIM67.
Quantum revivals in HgTe/CdTe quantum wells and topological phase transitions

The time evolution of a wave packet is a tool to detect topological phase transitions in two-dimensional Dirac materials, such as graphene and silicene. Here we extend the analysis to HgTe/CdTe quantum wells and study the evolution of their electron current wave packet, using 2D effective Dirac Hamiltonians and different layer thicknesses. We show that the two different periodicities that appear in this temporal evolution reach a minimum near the critical thickness, where the system goes from normal to inverted regime. Moreover, the maximum of the electron current amplitude changes with the layer thickness, identifying that current maxima reach their higher value at the critical thickness. Thus, we can characterize the topological phase transitions in terms of the periodicity and amplitude of the electron currents.
Deep FBSDE Neural Networks for Solving Incompressible Navier-Stokes Equation and Cahn-Hilliard Equation

Efficient algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the curse of dimensionality. We extend the forward-backward stochastic neural networks (FBSNNs) which depends on forward-backward stochastic differential equation (FBSDE) to solve incompressible Navier-Stokes equation. For Cahn-Hilliard equation, we derive a modified Cahn-Hilliard equation from a widely used stabilized scheme for original Cahn-Hilliard equation. This equation can be written as a continuous parabolic system, where FBSDE can be applied and the unknown solution is approximated by neural network. Also our method is successfully developed to Cahn-Hilliard-Navier-Stokes (CHNS) equation. The accuracy and stability of our methods are shown in many numerical experiments, specially in high dimension.
Bridging Modalities: Knowledge Distillation and Masked Training for Translating Multi-Modal Emotion Recognition to Uni-Modal, Speech-Only Emotion Recognition

This paper presents an innovative approach to address the challenges of translating multi-modal emotion recognition models to a more practical and resource-efficient uni-modal counterpart, specifically focusing on speech-only emotion recognition. Recognizing emotions from speech signals is a critical task with applications in human-computer interaction, affective computing, and mental health assessment. However, existing state-of-the-art models often rely on multi-modal inputs, incorporating information from multiple sources such as facial expressions and gestures, which may not be readily available or feasible in real-world scenarios. To tackle this issue, we propose a novel framework that leverages knowledge distillation and masked training techniques.
Neuronal Temporal Filters as Normal Mode Extractors

To generate actions in the face of physiological delays, the brain must predict the future. Here we explore how prediction may lie at the core of brain function by considering a neuron predicting the future of a scalar time series input. Assuming that the dynamics of the lag vector (a vector composed of several consecutive elements of the time series) are locally linear, Normal Mode Decomposition decomposes the dynamics into independently evolving (eigen-)modes allowing for straightforward prediction. We propose that a neuron learns the top mode and projects its input onto the associated subspace. Under this interpretation, the temporal filter of a neuron corresponds to the left eigenvector of a generalized eigenvalue problem. We mathematically analyze the operation of such an algorithm on noisy observations of synthetic data generated by a linear system. Interestingly, the shape of the temporal filter varies with the signal-to-noise ratio (SNR): a noisy input yields a monophasic filter and a growing SNR leads to multiphasic filters with progressively greater number of phases. Such variation in the temporal filter with input SNR resembles that observed experimentally in biological neurons.
Intranight variability of ultraviolet emission from high-$z$ blazars

Rapid intranight variability of continuum and polarization in blazars is a very useful tool to probe the beaming of a relativistic jet and the associated population of the relativistic particles. Such intranight variability in the rest-frame optical continuum has been carried out extensively, but there is a scarcity of such information in the rest-frame ultra-violet (UV), where the cause of variability might be due to {a} secondary population of relativistic particles. To fill this gap, recently in Chand et al. (2022) we reported for the first time intranight variability study of a sample of high-$z$ blazars so that the monitored optical radiation is their rest-frame UV radiation. Here we discuss in detail the implication of this investigation with a proper comparison of high-$z$ blazar samples with fractional optical polarization ($p_{opt}$) smaller and higher than 3\%. In this context, we also report intranight variability study of an additional high-$z$ blazar at $z$=2.347, namely J161942.38+525613.41, monitored over three sessions each with a duration of $\sim$5 hr. Our investigation does not reveal any compelling evidence for a stronger intranight variability of UV emission for high polarization blazars, in contrast to the blazars monitored in the rest-frame blue-optical. We also discuss this trend in light of the proposal that the synchrotron radiation of blazar jets in the UV/X-ray regime may arise from a relativistic particle population different from that radiating up to near-infrared/optical frequencies.
Deformable Audio Transformer for Audio Event Detection

Transformers have achieved promising results on a variety of tasks. However, the quadratic complexity in self-attention computation has limited the applications, especially in low-resource settings and mobile or edge devices. Existing works have proposed to exploit hand-crafted attention patterns to reduce computation complexity. However, such hand-crafted patterns are data-agnostic and may not be optimal. Hence, it is likely that relevant keys or values are being reduced, while less important ones are still preserved. Based on this key insight, we propose a novel deformable audio Transformer for audio recognition, named DATAR, where a deformable attention equipping with a pyramid transformer backbone is constructed and learnable. Such an architecture has been proven effective in prediction tasks,~\textit{e.g.}, event classification. Moreover, we identify that the deformable attention map computation may over-simplify the input feature, which can be further enhanced. Hence, we introduce a learnable input adaptor to alleviate this issue, and DATAR achieves state-of-the-art performance.
FaultFormer: Pretraining Transformers for Adaptable Bearing Fault Classification

The growth of global consumption has motivated important applications of deep learning to smart manufacturing and machine health monitoring. In particular, vibration data offers a rich and reliable source to provide meaningful insights into machine health and predictive maintenance. In this work, we present pretraining and fine-tuning frameworks for identifying bearing faults based on transformer models. In particular, we investigate different tokenization and data augmentation strategies to improve performance and reach state of the art accuracies. Furthermore, we demonstrate masked self-supervised pretraining for vibration signals and its application to low-data regimes, task adaptation, and dataset adaptation. Pretraining is able to improve performance on 10-way bearing classification on scarce, unseen training samples. Transformer models also benefit from pretraining when fine-tuning on fault classes outside of the pretraining distribution. Lastly, pretrained transformers are shown to be able to generalize to a different dataset in a few-shot manner. This introduces a new paradigm where models can be pretrained across different bearings, faults, and machinery and quickly deployed to new, data-scarce applications to suit specific manufacturing needs.