Miracle-dz/UniFAR-FTUs huggingface dataset:
Neuromuscular Reinforcement Learning to Actuate Human Limbs through FES

: Functional Electrical Stimulation (FES) is a technique to evoke muscle contraction through low-energy electrical signals. FES can animate paralysed limbs. Yet, an open challenge remains on how to apply FES to achieve desired movements. This challenge is accentuated by the complexities of human bodies and the non-stationarities of the muscles' responses. The former causes difficulties in performing inverse dynamics, and the latter causes control performance to degrade over extended periods of use. Here, we engage the challenge via a data-driven approach. Specifically, we learn to control FES through Reinforcement Learning (RL) which can automatically customise the stimulation for the patients. However, RL typically has Markovian assumptions while FES control systems are non-Markovian because of the non-stationarities. To deal with this problem, we use a recurrent neural network to create Markovian state representations. We cast FES controls into RL problems and train RL agents to control FES in different settings in both simulations and the real world. The results show that our RL controllers can maintain control performances over long periods and have better stimulation characteristics than PID controllers.
Self-Relation Attention and Temporal Awareness for Emotion Recognition via Vocal Burst

Speech emotion recognition (SER) is one of the most exciting topics many researchers have recently been involved in. Although much research has been conducted recently on this topic, emotion recognition via non-verbal speech (known as the vocal burst) is still sparse. The vocal burst is concise and has meaningless content, which is harder to deal with than verbal speech. Therefore, in this paper, we proposed a self-relation attention and temporal awareness (SRA-TA) module to tackle this problem with vocal bursts, which could capture the dependency in a long-term period and focus on the salient parts of the audio signal as well. Our proposed method contains three main stages. Firstly, the latent features are extracted using a self-supervised learning model from the raw audio signal and its Mel-spectrogram. After the SRA-TA module is utilized to capture the valuable information from latent features, all features are concatenated and fed into ten individual fully-connected layers to predict the scores of 10 emotions. Our proposed method achieves a mean concordance correlation coefficient (CCC) of 0.7295 on the test set, which achieves the first ranking of the high-dimensional emotion task in the 2022 ACII Affective Vocal Burst Workshop & Challenge.
Direct vs Indirect Methods for Behavior-based Attack Detection

We study the problem of data-driven attack detection for unknown LTI systems using only input-output behavioral data. In contrast with model-based detectors that use errors from an output predictor to detect attacks, we study behavior-based data-driven detectors. We construct a behavior-based chi-squared detector that uses a sequence of inputs and outputs and their covariance. The covariance of the behaviors is estimated using data by two methods. The first (direct) method employs the sample covariance as an estimate of the covariance of behaviors. The second (indirect) method uses a lower dimensional generative model identified from data to estimate the covariance of behaviors. We prove the consistency of the two methods of estimation and provide finite sample error bounds. Finally, we numerically compare the performance and establish a tradeoff between the methods at different regimes of the size of the data set and the length of the detection horizon. Our numerical study indicates that neither method is invariable superior, and reveals the existence of two regimes for the performance of the two methods, wherein the direct method is superior in cases with large data sets relative to the length of the detection horizon, while the indirect method is superior in cases with small data sets.
Entity-Centric Query Refinement

We introduce the task of entity-centric query refinement. Given an input query whose answer is a (potentially large) collection of entities, the task output is a small set of query refinements meant to assist the user in efficient domain exploration and entity discovery. We propose a method to create a training dataset for this task. For a given input query, we use an existing knowledge base taxonomy as a source of candidate query refinements, and choose a final set of refinements from among these candidates using a search procedure designed to partition the set of entities answering the input query. We demonstrate that our approach identifies refinement sets which human annotators judge to be interesting, comprehensive, and non-redundant. In addition, we find that a text generation model trained on our newly-constructed dataset is able to offer refinements for novel queries not covered by an existing taxonomy. Our code and data are available at https://github.com/google-research/language/tree/master/language/qresp.
'Surprised, Shocked, Worried': User Reactions to Facebook Data Collection from Third Parties

Data collection and aggregation by online services happens to an extent that is often beyond awareness and comprehension of its users. Transparency tools become crucial to inform people, though it is unclear how well they work. To investigate this matter, we conducted a user study focusing on Facebook, which has recently released the 'Off-Facebook Activity' transparency dashboard that informs about personal data collection from third parties. We exposed a group of n = 100 participants to the dashboard and surveyed their level of awareness and reactions to understand how transparency impacts users' privacy attitudes and intended behavior. Our participants were surprised about the massive amount of collected data, became significantly less comfortable with data collection, and more likely to take protective measures. Collaterally, we observed that current consent schemes are inadequate. Based on the survey findings, we make recommendations for more usable transparency and highlight the need to raise awareness about transparency tools and to provide easily actionable privacy controls.
"For an App Supposed to Make Its Users Feel Better, It Sure is a Joke" - An Analysis of User Reviews of Mobile Mental Health Applications

Mobile mental health applications are seen as a promising way to fulfill the growing need for mental health care. Although there are more than ten thousand mental health apps available on app marketplaces, such as Google Play and Apple App Store, many of them are not evidence-based, or have been minimally evaluated or regulated. The real-life experience and concerns of the app users are largely unknown. To address this knowledge gap, we analyzed 2159 user reviews from 117 Android apps and 2764 user reviews from 76 iOS apps. Our findings include the critiques around inconsistent moderation standards and lack of transparency. App-embedded social features and chatbots were criticized for providing little support during crises. We provide research and design implications for future mental health app developers, discuss the necessity of developing a comprehensive and centralized app development guideline, and the opportunities of incorporating existing AI technology in mental health chatbots.
Observation of anisotropic Dirac cones in the topological material Ti2Te2P

Anisotropic bulk Dirac (or Weyl) cones in three dimensional systems have recently gained intense research interest as they are examples of materials with tilted Dirac (or Weyl) cones indicatig the violation of Lorentz invariance. In contrast, the studies on anisotropic surface Dirac cones in topological materials which contribute to anisotropic carrier mobility have been limited. By employing angle-resolved photoemission spectroscopy and first-principles calculations, we reveal the anisotropic surface Dirac dispersion in a tetradymite material Ti2Te2P on the (001) plane of the Brillioun zone. We observe the quasi-elliptical Fermi pockets at the M -point of the Brillouin zone forming the anisotropic surface Dirac cones. Our calculations of the Z2 indices confirm that the system is topologically non-trivial with multiple topological phases in the same material. In addition, the observed nodal-line like feature formed by bulk bands makes this system topologically rich.
Numerical study of ignition and combustion of hydrogen-enriched methane in a sequential combustor

Ignition and combustion behavior in the second stage of a sequential combustor are investigated numerically at atmospheric pressure for pure CH4 fueling and for a CH4/H2 fuel blend in 24:1 mass ratio using Large Eddy Simulation (LES). Pure CH4 fueling results in a turbulent propagating flame anchored by the hot gas recirculation zone developed near the inlet of the sequential combustion chamber. Conversely, CH4/H2 fueling results in a drastic change of the combustion process, with multiple auto-ignition kernels produced upstream of the main flame brush. Chemical Explosive Mode Analysis indicates that, when H2 is added, flame stabilization in the combustion chamber is strongly supported by auto-ignition chemistry. The analysis of fuel decomposition pathways highlights that radicals advected from the first stage flame, in particular OH, induce a rapid fuel decomposition and cause the reactivity enhancement that leads to auto-ignition upstream of the sequential flame. This behavior is promoted by the relatively large mass fraction of OH radicals found in the flow reaching the second stage, which is approximately one order of magnitude greater than it would be at chemical equilibrium. The importance of the out-of-equilibrium vitiated air on the ignition behavior is proven via an additional LES that features weak auto-ignition kernel formation when equilibrium is artificially imposed. It is concluded, therefore, that parameters affecting the relaxation towards chemical equilibrium of the vitiated flow can have an important influence on the operability of sequential combustors fueled with varying fractions of H2 blending.
KaliCalib: A Framework for Basketball Court Registration

Tracking the players and the ball in team sports is key to analyse the performance or to enhance the game watching experience with augmented reality. When the only sources for this data are broadcast videos, sports-field registration systems are required to estimate the homography and re-project the ball or the players from the image space to the field space. This paper describes a new basketball court registration framework in the context of the MMSports 2022 camera calibration challenge. The method is based on the estimation by an encoder-decoder network of the positions of keypoints sampled with perspective-aware constraints. The regression of the basket positions and heavy data augmentation techniques make the model robust to different arenas. Ablation studies show the positive effects of our contributions on the challenge test set. Our method divides the mean squared error by 4.7 compared to the challenge baseline.
A regularization-patching dual quaternion optimization method for solving the hand-eye calibration problem

The hand-eye calibration problem is an important application problem in robot research. Based on the 2-norm of dual quaternion vectors, we propose a new dual quaternion optimization method for the hand-eye calibration problem. The dual quaternion optimization problem is decomposed to two quaternion optimization subproblems. The first quaternion optimization subproblem governs the rotation of the robot hand. It can be solved efficiently by the eigenvalue decomposition or singular value decomposition. If the optimal value of the first quaternion optimization subproblem is zero, then the system is rotationwise noiseless, i.e., there exists a “perfect” robot hand motion which meets all the testing poses rotationwise exactly. In this case, we apply the regularization technique for solving the second subproblem to minimize the distance of the translation. Otherwise we apply the patching technique to solve the second quaternion optimization subproblem. Then solving the second quaternion optimization subproblem turns out to be solving a quadratically constrained quadratic program. In this way, we give a complete description for the solution set of hand-eye calibration problems. This is new in the hand-eye calibration literature. The numerical results are also presented to show the efficiency of the proposed method.
Report of the Topical Group on Electroweak Precision Physics and Constraining New Physics for Snowmass 2021

The precise measurement of physics observables and the test of their consistency within the standard model (SM) are an invaluable approach, complemented by direct searches for new particles, to determine the existence of physics beyond the standard model (BSM). Studies of massive electroweak gauge bosons (W and Z bosons) are a promising target for indirect BSM searches, since the interactions of photons and gluons are strongly constrained by the unbroken gauge symmetries. They can be divided into two categories: (a) Fermion scattering processes mediated by s- or t-channel W/Z bosons, also known as electroweak precision measurements; and (b) multi-boson processes, which include production of two or more vector bosons in fermion-antifermion annihilation, as well as vector boson scattering (VBS) processes. The latter categories can test modifications of gauge-boson self-interactions, and the sensitivity is typically improved with increased collision energy. This report evaluates the achievable precision of a range of future experiments, which depend on the statistics of the collected data sample, the experimental and theoretical systematic uncertainties, and their correlations. In addition it presents a combined interpretation of these results, together with similar studies in the Higgs and top sector, in the Standard Model effective field theory (SMEFT) framework. This framework provides a model-independent prescription to put generic constraints on new physics and to study and combine large sets of experimental observables, assuming that the new physics scales are significantly higher than the EW scale.
Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentation

Generating precise class-aware pseudo ground-truths, a.k. a, class activation maps (CAMs), is essential for weakly-supervised semantic segmentation. The original CAM method usually produces incomplete and inaccurate localization maps. To tackle with this issue, this paper proposes an Expansion and Shrinkage scheme based on the offset learning in the deformable convolution, to sequentially improve the recall and precision of the located object in the two respective stages. In the Expansion stage, an offset learning branch in a deformable convolution layer, referred as"expansion sampler"seeks for sampling increasingly less discriminative object regions, driven by an inverse supervision signal that maximizes image-level classification loss. The located more complete object in the Expansion stage is then gradually narrowed down to the final object region during the Shrinkage stage. In the Shrinkage stage, the offset learning branch of another deformable convolution layer, referred as"shrinkage sampler", is introduced to exclude the false positive background regions attended in the Expansion stage to improve the precision of the localization maps. We conduct various experiments on PASCAL VOC 2012 and MS COCO 2014 to well demonstrate the superiority of our method over other state-of-the-art methods for weakly-supervised semantic segmentation. Code will be made publicly available here https://github.com/TyroneLi/ESOL_WSSS.
Towards super-resolution via iterative multi-exposure coaddition

In this article, we provide an alternative upsampling and point-spread function (PSF) deconvolution method for iterative multi-exposure coaddition. In contrast to previous works, the new method has a ratio-correction term, which allows the iterations to converge more rapidly to an accurate representation of the underlying image than methods with difference-correction terms. By employing this method, one can coadd undersampled multi-exposures to a super-resolution and obtain a higher peak signal-to-noise ratio. A set of simulations shows that there are many advantages of the new method, e.g. in the signal-to-noise ratio, average deviation of all source fluxes, super-resolution, and source distortion ratio, which are friendly to astronomical photometry and morphology and benefit faint source detection and shear measurement of weak gravitational lensing. The method provides an improvement in fidelity over the previous ones tested in this work.
Out-of-time-order correlations and quantum chaos

Quantum Chaos has originally emerged as the field which studies how the properties of classical chaotic systems arise in their quantum counterparts. The growing interest in quantum many-body systems, with no obvious classical meaning has led to consider time-dependent quantities that can help to characterize and redefine Quantum Chaos. This article reviews the prominent role that the out of time ordered correlator (OTOC) plays to achieve such goal.
Training Recipe for N: M Structured Sparsity with Decaying Pruning Mask

Sparsity has become one of the promising methods to compress and accelerate Deep Neural Networks (DNNs). Among different categories of sparsity, structured sparsity has gained more attention due to its efficient execution on modern accelerators. Particularly, N:M sparsity is attractive because there are already hardware accelerator architectures that can leverage certain forms of N:M structured sparsity to yield higher compute-efficiency. In this work, we focus on N:M sparsity and extensively study and evaluate various training recipes for N:M sparsity in terms of the trade-off between model accuracy and compute cost (FLOPs). Building upon this study, we propose two new decay-based pruning methods, namely"pruning mask decay"and"sparse structure decay". Our evaluations indicate that these proposed methods consistently deliver state-of-the-art (SOTA) model accuracy, comparable to unstructured sparsity, on a Transformer-based model for a translation task. The increase in the accuracy of the sparse model using the new training recipes comes at the cost of marginal increase in the total training compute (FLOPs).
ConFiguRe: Exploring Discourse-level Chinese Figures of Speech

Figures of speech, such as metaphor and irony, are ubiquitous in literature works and colloquial conversations. This poses great challenge for natural language understanding since figures of speech usually deviate from their ostensible meanings to express deeper semantic implications. Previous research lays emphasis on the literary aspect of figures and seldom provide a comprehensive exploration from a view of computational linguistics. In this paper, we first propose the concept of figurative unit, which is the carrier of a figure. Then we select 12 types of figures commonly used in Chinese, and build a Chinese corpus for Contextualized Figure Recognition (ConFiguRe). Different from previous token-level or sentence-level counterparts, ConFiguRe aims at extracting a figurative unit from discourse-level context, and classifying the figurative unit into the right figure type. On ConFiguRe, three tasks, i.e., figure extraction, figure type classification and figure recognition, are designed and the state-of-the-art techniques are utilized to implement the benchmarks. We conduct thorough experiments and show that all three tasks are challenging for existing models, thus requiring further research. Our dataset and code are publicly available at https://github.com/pku-tangent/ConFiguRe.
Band structures of Cu2ZnSnS4 and Cu2ZnSnSe4 from many-body methods

We calculate the band structures of kesterite and stannite Cu2ZnSnS4 and Cu2ZnSnSe4, using a state-of-the-art self-consistent GW approach. Our accurate quasiparticle states allow to discuss: the dependence of the gap on the anion displacement; the key-role of the nonlocality of the exchange-correlation potential to obtain good structural parameters; the reliability of less expensive hybrid functional and generalized gradient approximation+U approaches. In particular, we show that even if the band gap is correctly reproduced by hybrid functionals, the band-edge corrections are in disagreement with self-consistent GW results, which have decisive implications for the positioning of the defect levels in the band gap.
A Mosquito is Worth 16x16 Larvae: Evaluation of Deep Learning Architectures for Mosquito Larvae Classification

Mosquito-borne diseases (MBDs), such as dengue virus, chikungunya virus, and West Nile virus, cause over one million deaths globally every year. Because many such diseases are spread by the Aedes and Culex mosquitoes, tracking these larvae becomes critical in mitigating the spread of MBDs. Even as citizen science grows and obtains larger mosquito image datasets, the manual annotation of mosquito images becomes ever more time-consuming and inefficient. Previous research has used computer vision to identify mosquito species, and the Convolutional Neural Network (CNN) has become the de-facto for image classification. However, these models typically require substantial computational resources. This research introduces the application of the Vision Transformer (ViT) in a comparative study to improve image classification on Aedes and Culex larvae. Two ViT models, ViT-Base and CvT-13, and two CNN models, ResNet-18 and ConvNeXT, were trained on mosquito larvae image data and compared to determine the most effective model to distinguish mosquito larvae as Aedes or Culex. Testing revealed that ConvNeXT obtained the greatest values across all classification metrics, demonstrating its viability for mosquito larvae classification. Based on these results, future research includes creating a model specifically designed for mosquito larvae classification by combining elements of CNN and transformer architecture.
The BLue Amazon Brain (BLAB): A Modular Architecture of Services about the Brazilian Maritime Territory

We describe the first steps in the development of an artificial agent focused on the Brazilian maritime territory, a large region within the South Atlantic also known as the Blue Amazon. The"BLue Amazon Brain"(BLAB) integrates a number of services aimed at disseminating information about this region and its importance, functioning as a tool for environmental awareness. The main service provided by BLAB is a conversational facility that deals with complex questions about the Blue Amazon, called BLAB-Chat; its central component is a controller that manages several task-oriented natural language processing modules (e.g., question answering and summarizer systems). These modules have access to an internal data lake as well as to third-party databases. A news reporter (BLAB-Reporter) and a purposely-developed wiki (BLAB-Wiki) are also part of the BLAB service architecture. In this paper, we describe our current version of BLAB's architecture (interface, backend, web services, NLP modules, and resources) and comment on the challenges we have faced so far, such as the lack of training data and the scattered state of domain information. Solving these issues presents a considerable challenge in the development of artificial intelligence for technical domains.