Miracle-dz/UniFAR-FTUs huggingface dataset:
A Critique of the Enforcement of Nigeria Extractive Industries Transparency Initiative (Neiti) Act 2007 in Oil and Gas Sector

Nigeria is richly blessed with mineral resources, and of all these mineral resources oil and gas with the proven 600 trillion cubic feet reserve of gas and estimated 40 billion barrels of crude oil reserve is the most strategic and fundamental to the Nigerian economy such that Nigeria is reputed to be the seventh largest oil producing country in the whole world. Yet Nigerians have been wallowing in abject poverty with inadequate infrastructural and social amenities, poor standard of living, low per capita income, and all other forms of poor human development index; often attributed to corruption, unaccountability and lack of transparency leading to cases of under-paid revenues and unaccounted oil produce in the Nigerian oil and gas sector as a result of structural fiscal/financial leakages with the collaboration of oil multinationals and high level officials in Nigerian petroleum sector. Even with the enactment of NEITI Act 2007, the culture of impunity and corruption continued unabated resulting to little or no effect on the quality of living of Nigerian citizens. The core of this paper is that the NEITI Act of 2007 inadequately empowers NEITI to compel oil and gas multinationals to carry out remediation of their account.
Lung Nodule Segmentation and Recognition Algorithm Based on Multiposition U-Net

Lung nodules are the main lesions of the lung, and conditions of the lung can be directly displayed through CT images. Due to the limited pixel number of lung nodules in the lung, doctors have the risk of missed detection and false detection in the detection process. In order to reduce doctors' work intensity and assist doctors to make accurate diagnosis, a lung nodule segmentation and recognition algorithm is proposed by simulating doctors' diagnosis process with computer intelligent methods. Firstly, the attention mechanism model is established to focus on the region of lung parenchyma. Then, a pyramid network of bidirectional enhancement features is established from multiple body positions to extract lung nodules. Finally, the morphological and imaging features of lung nodules are calculated, and then, the signs of lung nodules can be identified. The experiments show that the algorithm conforms to the doctor's diagnosis process, focuses the region of interest step by step, and achieves good results in lung nodule segmentation and recognition.
Engineering of phenylalanine dehydrogenase from Thermoactinomyces intermedius for the production of a novel homoglutamate

The dramatic increase in healthcare costs has become a significant burden to this era. Many patients are unable to access medication because of the high price of drugs. Genetic engineering has made advances to increase the yield, titer, and productivity in the bio-based production of chemicals, materials of interest, and identification of innovative targets for drug discovery. Currently, the production of homoglutamate (α-Aminoadipic acid) involves petrochemical routes that are costly with low yield and often not suitable for industrial production. Here, we established the development of NADH-dependent homoglutamate by engineering NADH-dependent phenylalanine dehydrogenase (PDH) from Thermoactinomyces intermedius, which provides a novel tool for in-vivo metabolic engineering and in-vitro catalysis. Based on computational insight into the structure, we proposed the site-specific directed mutagenesis of the two important residues of PDH through docking simulations by AutoDock Vina which elucidated the binding mode of PDH with α-Ketoadipic acid and ligands. Our results demonstrated that the catalytic efficiency Km/Kcat of the final mutant Ala135Arg showed a 3-fold increase amination activity towards the ketoadipic acid as compared to the other mutant Gly114Arg, a double mutant Gly114Arg/Ala135Arg, and wild type TiPDH. Furthermore, we have introduced formate dehydrogenase as a cofactor regenerative system in this study which further made this study economically viable. Our study unfolds the possibility of biosynthesis of other non-proteinogenic amino acids that might be valuable pharmaceutical intermediaries.
Audio-Visual Speech Codecs: Rethinking Audio-Visual Speech Enhancement by Re-Synthesis

Since facial actions such as lip movements contain significant information about speech content, it is not surprising that audio-visual speech enhancement methods are more accurate than their audio-only counterparts. Yet, state-of-the-art approaches still struggle to generate clean, realistic speech without noise artifacts and unnatural distortions in challenging acoustic environments. In this paper, we propose a novel audio-visual speech enhancement framework for high-fidelity telecommunications in AR/VR. Our approach leverages audio-visual speech cues to generate the codes of a neural speech codec, enabling efficient synthesis of clean, realistic speech from noisy signals. Given the importance of speaker-specific cues in speech, we focus on developing personalized models that work well for individual speakers. We demonstrate the efficacy of our approach on a new audio-visual speech dataset collected in an unconstrained, large vocabulary setting, as well as existing audio-visual datasets, outperforming speech enhancement baselines on both quantitative metrics and human evaluation studies. Please see the supplemental video for qualitative results11https://github.com/facebookresearch/facestar/releases/download/paper_materials/video.mp4.
JETS: Jointly Training FastSpeech2 and HiFi-GAN for End to End Text to Speech

In neural text-to-speech (TTS), two-stage system or a cascade of separately learned models have shown synthesis quality close to human speech. For example, FastSpeech2 transforms an input text to a mel-spectrogram and then HiFi-GAN generates a raw waveform from a mel-spectogram where they are called an acoustic feature generator and a neural vocoder respectively. However, their training pipeline is somewhat cumbersome in that it requires a ﬁne-tuning and an accurate speech-text alignment for optimal performance. In this work, we present end-to-end text-to-speech (E2E-TTS) model which has a simpliﬁed training pipeline and outperforms a cascade of separately learned models. Speciﬁcally, our proposed model is jointly trained FastSpeech2 and HiFi-GAN with an alignment module. Since there is no acoustic feature mismatch between training and inference, it does not requires ﬁne-tuning. Furthermore, we remove dependency on an external speech-text alignment tool by adopting an alignment learning objective in our joint training framework. Experiments on LJSpeech corpus shows that the proposed model outperforms publicly available, state-of-the-art implementations of ESPNet2-TTS on subjective evaluation (MOS) and some objective evaluations.
Automatic detection of expressed emotion from Five-Minute Speech Samples: Challenges and opportunities

Research into clinical applications of speech-based emotion recognition (SER) technologies has been steadily increasing over the past few years. One such potential application is the automatic recognition of expressed emotion (EE) components within family environments. The identification of EE is highly important as they have been linked with a range of adverse life events. Manual coding of these events requires time-consuming specialist training, amplifying the need for automated approaches. Herein we describe an automated machine learning approach for determining the degree of warmth, a key component of EE, from acoustic and text natural language features. Our dataset of 52 recorded interviews is taken from recordings, collected over 20 years ago, from a nationally representative birth cohort of British twin children, and was manually coded for EE by two researchers (inter-rater reliability 0.84–0.90). We demonstrate that the degree of warmth can be predicted with an F1-score of 64.7% despite working with audio recordings of highly variable quality. Our highly promising results suggest that machine learning may be able to assist in the coding of EE in the near future.
Graph Refinement for Coreference Resolution

The state-of-the-art models for coreference resolution are based on independent mention pair-wise decisions. We propose a modelling approach that learns coreference at the document-level and takes global decisions. For this purpose, we model coreference links in a graph structure where the nodes are tokens in the text, and the edges represent the relationship between them. Our model predicts the graph in a non-autoregressive manner, then iteratively refines it based on previous predictions, allowing global dependencies between decisions. The experimental results show improvements over various baselines, reinforcing the hypothesis that document-level information improves conference resolution.
When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning

Physics-informed machine learning (PIML), referring to the combination of prior knowledge of physics, which is the high level abstraction of natural phenomenons and human behaviours in the long history, with data-driven machine learning models, has emerged as an effective way to mitigate the shortage of training data, to increase models' generalizability and to ensure the physical plausibility of results. In this paper, we survey an abundant number of recent works in PIML and summarize them from three aspects: (1) motivations of PIML, (2) physics knowledge in PIML, (3) methods of physics knowledge integration in PIML. We also discuss current challenges and corresponding research opportunities in PIML.
MMER: Multimodal Multi-task learning for Emotion Recognition in Spoken Utterances

Emotion Recognition (ER) aims to classify human utterances into different emotion categories. Based on early-fusion and self-attention-based multimodal interaction between text and acoustic modalities, in this paper, we propose a multimodal multitask learning approach for ER from individual utterances in isolation. Experiments on the IEMOCAP benchmark show that our proposed model performs better than our re-implementation of state-of-the-art and achieves better performance than all other unimodal and multimodal approaches in literature. In addition, strong baselines and ablation studies prove the effectiveness of our proposed approach. We make all our codes publicly available on GitHub 1 .
Eﬀect of nonfactorizable background geometry on thermodynamics of clustering of galaxies

We study the eﬀect of nonfactorizable background geometry on the thermodynamics of the clustering of galaxies. A canonical partition function is derived for the gravitating system of galaxies treated as point particles contained in cells of appropriate dimensions. Various thermodynamic equations of state, like Helmholtz free energy and entropy, among others, are also obtained. We also estimate the eﬀect of the corrected Newton’s law on the distribution function of galaxies. Remarkably, the eﬀect of the modiﬁed Newton’s law is seen only in the clustering parameter while the standard structure of the equations is preserved. A comparison of the modiﬁed clustering parameter ( b ∗ ) with that of the original clustering parameter is made to visualize the eﬀect of the correction on the time scale of clustering. The possibility of system symmetry breaking is also analyzed by investigating the behavior of the speciﬁc heat with increasing system temperature.
Spatially Adaptive Online Prediction of Piecewise Regular Functions

We consider the problem of estimating piecewise regular functions in an online setting, i.e., the data arrive sequentially and at any round our task is to predict the value of the true function at the next revealed point using the available data from past predictions. We propose a suitably modified version of a recently developed online learning algorithm called the sleeping experts aggregation algorithm. We show that this estimator satisfies oracle risk bounds simultaneously for all local regions of the domain. As concrete instantiations of the expert aggregation algorithm proposed here, we study an online mean aggregation and an online linear regression aggregation algorithm where experts correspond to the set of dyadic subrectangles of the domain. The resulting algorithms are near linear time computable in the sample size. We specifically focus on the performance of these online algorithms in the context of estimating piecewise polynomial and bounded variation function classes in the fixed design setup. The simultaneous oracle risk bounds we obtain for these estimators in this context provide new and improved (in certain aspects) guarantees even in the batch setting and are not available for the state of the art batch learning estimators.
Multi-Agent Spatial Predictive Control with Application to Drone Flocking

We introduce Spatial Predictive Control (SPC), a technique for solving the following problem: given a collection of robotic agents with black-box positional low-level controllers (PLLCs) and a mission-specific distributed cost function, how can a distributed controller achieve and maintain cost-function minimization without a plant model and only positional observations of the environment? Our fully distributed SPC controller is based strictly on the position of the agent itself and on those of its neighboring agents. This information is used in every time step to compute the gradient of the cost function and to perform a spatial look-ahead to predict the best next target position for the PLLC. Using a simulation environment, we show that SPC outperforms Potential Field Controllers, a related class of controllers, on the drone flocking problem. We also show that SPC works on real hardware, and is therefore able to cope with the potential sim-to-real transfer gap. We demonstrate its performance using as many as 16 Crazyflie 2.1 drones in a number of scenarios, including obstacle avoidance.
An Empirical Study of Language Model Integration for Transducer based Speech Recognition

Utilizing text-only data with an external language model (ELM) in end-to-end RNN-Transducer (RNN-T) for speech recognition is challenging. Recently, a class of methods such as density ratio (DR) and internal language model estimation (ILME) have been developed, outperforming the classic shallow fusion (SF) method. The basic idea behind these methods is that RNN-T posterior should first subtract the implicitly learned internal language model (ILM) prior, in order to integrate the ELM. While recent studies suggest that RNN-T only learns some low-order language model information, the DR method uses a well-trained neural language model with full context, which may be inappropriate for the estimation of ILM and deteriorate the integration performance. Based on the DR method, we propose a low-order density ratio method (LODR) by replacing the estimation with a low-order weak language model. Extensive empirical experiments are conducted on both in-domain and cross-domain scenarios on English LibriSpeech&Tedlium-2 and Chinese WenetSpeech&AISHELL-1 datasets. It is shown that LODR consistently outperforms SF in all tasks, while performing generally close to ILME and better than DR in most tests.
A Baseline Readability Model for Cebuano

In this study, we developed the first baseline readability model for the Cebuano language. Cebuano is the second most-used native language in the Philippines with about 27.5 million speakers. As the baseline, we extracted traditional or surface-based features, syllable patterns based from Cebuano’s documented orthography, and neural embeddings from the multilingual BERT model. Results show that the use of the first two handcrafted linguistic features obtained the best performance trained on an optimized Random Forest model with approximately 87% across all metrics. The feature sets and algorithm used also is similar to previous results in readability assessment for the Filipino language—showing potential of crosslingual application. To encourage more work for readability assessment in Philippine languages such as Cebuano, we open-sourced both code and data.
PANGUBOT: Efficient Generative Dialogue Pre-training from Pre-trained Language Model

In this paper, we introduce PanGu-Bot, a Chinese pre-trained open-domain dialogue generation model based on a large pre-trained language model (PLM) PANGU-alpha (Zeng et al.,2021). Different from other pre-trained dialogue models trained over a massive amount of dialogue data from scratch, we aim to build a powerful dialogue model with relatively fewer data and computation costs by inheriting valuable language capabilities and knowledge from PLMs. To this end, we train PanGu-Bot from the large PLM PANGU-alpha, which has been proven well-performed on a variety of Chinese natural language tasks. We investigate different aspects of responses generated by PanGu-Bot, including response quality, knowledge, and safety. We show that PanGu-Bot outperforms state-of-the-art Chinese dialogue systems (CDIALGPT (Wang et al., 2020), EVA (Zhou et al., 2021), EVA2.0 (Gu et al., 2022)) w.r. t. the above three aspects. We also demonstrate that PanGu-Bot can be easily deployed to generate emotional responses without further training. Throughout our empirical analysis, we also point out that the PanGu-Bot response quality, knowledge correctness, and safety are still far from perfect, and further explorations are indispensable to building reliable and smart dialogue systems. Our model and code will be available at https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/PanGu-Bot soon.
A Proof of the Kahn-Kalai Conjecture

Proving the “expectation-threshold” conjecture of Kahn and Kalai, we show that for any increasing property $\mathcal{F}$ on a finite set X,\begin{equation*}p_{c}(\mathcal{F})=O(q(\mathcal{F})\log\ell(\mathcal{F})),\end{equation*}where $p_{c}(\mathcal{F})$ and $q(\mathcal{F})$ are the threshold and “expectation threshold” of $\mathcal{F}$, and $\ell(\mathcal{F})$ is the maximum size of a minimal member of $\mathcal{F}$.
Mask Atari for Deep Reinforcement Learning as POMDP Benchmarks

We present Mask Atari, a new benchmark to help solve partially observable Markov decision process (POMDP) problems with Deep Reinforcement Learning (DRL)-based approaches. To achieve a simulation environment for the POMDP problems, Mask Atari is constructed based on Atari 2600 games with controllable, moveable, and learnable masks as the observation area for the target agent, especially with the active information gathering (AIG) setting in POMDPs. Given that one does not yet exist, Mask Atari provides a challenging, efficient benchmark for evaluating the methods that focus on the above problem. Moreover, the mask operation is a trial for introducing the receptive field in the human vision system into a simulation environment for an agent, which means the evaluations are not biased from the sensing ability and purely focus on the cognitive performance of the methods when compared with the human baseline. We describe the challenges and features of our benchmark and evaluate several baselines with Mask Atari.
A soft switching active snubber optimized for IGBTs in single switch unity power factor three-phase diode rectifiers

The soft switching snubber circuit provides zero-voltage turn-off for the main switch. The high turn-off losses of the IGBT due to the current tailing are reduced by zero-voltage switching. This allows the circuit to be operated at very high switching frequencies with regulated DC output voltage, high quality input current and unity input power factor. Simulation and experimental results are included. <<ETX>>
Neutrino follow-up with the Zwicky Transient Facility: Results from the first 24 campaigns

The Zwicky Transient Transient Facility (ZTF) performs a systematic neutrino follow-up program, searching for optical counterparts to high-energy neutrinos with dedicated Target-of-Opportunity (ToO) observations. Since first light in March 2018, ZTF has taken prompt observations for 24 high-quality neutrino alerts from the IceCube Neutrino Observatory, with a median latency of 12.2 hours from initial neutrino detection. From two of these campaigns, we have already reported tidal disruption event (TDE) AT2019dsg and likely TDE AT2019fdr as probable counterparts, suggesting that TDEs contribute>7.8% of the astrophysical neutrino flux. We here present the full results of our program through to December 2021. No additional candidate neutrino sources were identified by our program, allowing us to place the first constraints on the underlying optical luminosity function of astrophysical neutrino sources. Transients with optical absolutes magnitudes brighter that -21 can contribute no more than 87% of the total, while transients brighter than -22 can contribute no more than 58% of the total, neglecting the effect of extinction. These are the the first observational constraints on the neutrino emission of bright populations such as superluminous supernovae. None of the neutrinos were coincident with bright optical AGN flares comparable to that observed for TXS 0506+056/IC170922A, suggesting that most astrophysical neutrinos are not produced during such optical flares. We highlight the outlook for electromagnetic neutrino follow-up programs, including the expected potential for the Rubin Observatory.
Learning Local Displacements for Point Cloud Completion

We propose a novel approach aimed at object and semantic scene completion from a partial scan represented as a 3D point cloud. Our architecture relies on three novel layers that are used successively within an encoder-decoder structure and specifically developed for the task at hand. The first one carries out feature extraction by matching the point features to a set of pre-trained local descriptors. Then, to avoid losing individual descriptors as part of standard operations such as max-pooling, we propose an alternative neighbor-pooling operation that relies on adopting the feature vectors with the highest activations. Finally, upsampling in the decoder modifies our feature extraction in order to increase the output dimension. While this model is already able to achieve competitive results with the state of the art, we further propose a way to increase the versatility of our approach to process point clouds. To this aim, we introduce a second model that assembles our layers within a transformer architecture. We evaluate both architectures on object and indoor scene completion tasks, achieving state-of-the-art performance.
Rethinking Video Salient Object Ranking

Salient Object Ranking (SOR) involves ranking the degree of saliency of multiple salient objects in an input image. Most recently, a method is proposed for ranking salient objects in an input video based on a predicted fixation map. It relies solely on the density of the fixations within the salient objects to infer their saliency ranks, which is incompatible with human perception of saliency ranking. In this work, we propose to explicitly learn the spatial and temporal relations between different salient objects to produce the saliency ranks. To this end, we propose an end-to-end method for video salient object ranking (VSOR), with two novel modules: an intra-frame adaptive relation (IAR) module to learn the spatial relation among the salient objects in the same frame locally and globally, and an inter-frame dynamic relation (IDR) module to model the temporal relation of saliency across different frames. In addition, to address the limited video types (just sports and movies) and scene diversity in the existing VSOR dataset, we propose a new dataset that covers different video types and diverse scenes on a large scale. Experimental results demonstrate that our method outperforms state-of-the-art methods in relevant fields. We will make the source code and our proposed dataset available.