Miracle-dz/UniFAR-FTUs huggingface dataset:
Advancing neural language modeling in automatic speech recognition

Statistical language modeling is one of the fundamental problems in natural language processing. In the recent years, language modeling has seen great advances by active research and engineering efforts in applying artificial neural networks, especially those which are recurrent. The application of neural language models to speech recognition has now become well established and ubiquitous. Despite this impression of some degree of maturity, we claim that the full potential of the neural network based language modeling is yet to be explored. In this thesis, we further advance neural language modeling in automatic speech recognition, by investigating a number of new perspectives. From the architectural view point, we investigate the newly proposed Transformer neural networks for language modeling application. The original model architecture proposed for machine translation is studied and modified to accommodate the specific task of language modeling. Particularly deep models with about one hundred layers are developed. We present an in-depth comparison with the state-of-the-art recurrent neural network language models based on the long short-term memory. While scaling up language modeling to larger scale datasets, the diversity of the data emerges as an opportunity and a challenge. The current state-of-the-art neural language modeling lacks a mechanism of handling diverse data from different domains for a single model to perform well across different domains. In this context, we introduce domain robust language modeling with neural networks, and propose two solutions. As a first solution, we propose a new type of adaptive mixture of experts model which is fully based on neural networks. In the second approach, we investigate knowledge distillation from multiple domain expert models, as a solution to the large model size problem seen in the first approach. Methods for practical applications of knowledge distillation to large vocabulary language modeling are proposed, and studied to a large extent. Finally, we investigate the potential of neural language models to leverage long-span crosssentence contexts for cross-utterance speech recognition. The appropriate training method for such a scenario is under-explored in the existing works. We carry out systematic comparisons of the training methods, allowing us to achieve improvements in cross-utterance speech recognition. In the same context, we study the sequence length robustness for both recurrent neural networks based on the long short-term memory and Transformers, because such a robustness is one of the fundamental properties we wish to have, in neural networks with the ability to handle variable length contexts. Throughout the thesis, we tackle these problems through novel perspectives of neural language modeling, while keeping the traditional spirit of language modeling in speech recognition.
Microphysical and Polarimetric Radar Signatures of an Epic Flood Event in Southern China

An extremely heavy rainfall event hit Guangdong province, China, from 27 August to 1 September 2018. There were two different extreme rain regions, respectively, at the Pearl River estuary and eastern Guangdong, and a record-breaking daily precipitation of 1056.7 mm was observed at Gaotan station on 30 August. This paper utilizes a suite of observations from soundings, a gauge network, disdrometers, and polarimetric radars to gain insights to the two rainfall centers. The large-scale meteorological forcing, rainfall patterns, and microphysical processes, as well as radar-based precipitation signatures are investigated. It is concluded that a west-moving monsoon depression played a critical role in sustaining the moisture supply to the two extreme rain regions, and the combined orographic enhancement further contributed to the torrential rainfall over Gaotan station. The raindrop size distributions (DSD) observed at Zhuhai and Huidong stations, as well as the observed polarimetric radar signatures indicate that the rainfall at Doumen region was characterized by larger raindrops but a lower number concentration compared with that at Gaotan region. In addition, the dual-polarization radars are used to quantify precipitation intensity during this extreme event, providing timely information for flood warning and emergency management decision-making.
Context Aware Recommender Systems and Techniques in offering Smart Learning: A Survey and Future work

 Abstract — There exist several context aware recommender systems (CARS) that have been designed to perform specific tasks in facilitating smart learning. Such context aware recommender systems have potentially played important roles in education, especially in recommending to a learner certain activities. In this research we reviewed existing context aware recommender systems used in facilitating pedagogical smart learning. Our survey paper addressed the following research questions; which contexts are used in smart learning, how the contexts are collected, recommended activities, data mining techniques, and future work in CARS for smart learning. In our findings we addressed the research questions with reference to smart learning. We identified that there are numerous context aware recommender systems; but despite all existing CARS in smart learning, there are several challenges and gaps that are still existing. Such challenges include: - Absence of CARS that perfectly fits the ever changing learner’s needs and preferences, and lack of standard database for smart learning, among other issues highlighted in our future work.
The Role of Frontoparietal Cortex across the Functional Stages of Visual Search

Areas in frontoparietal cortex have been shown to be active in a range of cognitive tasks and have been proposed to play a key role in goal-driven activities (Dosenbach, N. U. F., Fair, D. A., Miezin, F. M., Cohen, A. L., Wenger, K. K., Dosenbach, R. A. T., et al. Distinct brain networks for adaptive and stable task control in humans. Proceedings of the National Academy of Sciences, U.S.A., 104, 11073–11078, 2007; Duncan, J. The multiple-demand (MD) system of the primate brain: Mental programs for intelligent behavior. Trends in Cognitive Sciences, 14, 172–179, 2010). Here, we examine the role this frontoparietal system plays in visual search. Visual search, like many complex tasks, consists of a sequence of operations: target selection, stimulus–response (SR) mapping, and response execution. We independently manipulated the difficulty of target selection and SR mapping in a novel visual search task that involved identical stimulus displays. Enhanced activity was observed in areas of frontal and parietal cortex during both difficult target selection and SR mapping. In addition, anterior insula and ACC showed preferential representation of SR-stage information, whereas the medial frontal gyrus, precuneus, and inferior parietal sulcus showed preferential representation of target selection-stage information. A connectivity analysis revealed dissociable neural circuits underlying visual search. We hypothesize that these circuits regulate distinct mental operations associated with the allocation of spatial attention, stimulus decisions, shifts of task set from selection to SR mapping, and SR mapping. Taken together, the results show frontoparietal involvement in all stages of visual search and a specialization with respect to cognitive operations.
Management Zone Delineation for Site-Specific Fertilization in Rice Crop Using Multi-Temporal RapidEye Imagery

The objective of this research is to assess the potential of satellite imagery in detecting soil heterogeneity, with a focus on site-specific fertilization in rice. The basic hypothesis is that spectral variation would express soil fertility variations analogously. A 100-ha rice crop, located in the Plain of Thessaloniki, Greece, was selected as the study area for the 2016 cropping season. Three RapidEye images were acquired during critical growth stages of rice cultivation from the previous year (2015). Management zones were delineated with image segmentation of a 15-band multi-temporal composite of the RapidEye images (three dates × five bands), using the Fractal Net Evolution Approach (FNEA) algorithm. Then, an equal number of soil samples were collected from the centroid of each management zone before seedbed preparation. The between-zone variation of the soil properties was found to be 33.7% on average, whereas the within-zone variation 18.2%. The basic hypothesis was confirmed, and moreover, it was proved that zonal applications reduced within-zone soil variation by 18.6% compared to conventional uniform applications. Finally, between-zone soil variation was significant enough to dictate differentiated fertilization recommendations per management zone by 24.5% for the usual inputs.
Sentinel-3A/B SLSTR Pre-Launch Calibration of the Thermal InfraRed Channels

The first two models of the Sea and Land Surface Temperature Radiometers (SLSTR) for the European Copernicus Sentinel-3 missions were tested prior to launch at the Rutherford Appleton Laboratory space instrument calibration facility. The pre-launch tests provide an essential reference that ensures that the flight data of SLSTR are calibrated to the same standards needed for surface temperature measurements and to those used by shipborne radiometers for Fiducial Reference Measurement (FRM). The radiometric calibrations of the thermal infrared channels were validated against accurate and traceable reference BB sources under flight representative thermal vacuum environment. Measurements were performed in both earth views for source temperatures covering the main operating range, for different instrument configurations and for the full field-of-view of the instruments. The data were used to derive non-linearity curves to be used in the level-1 processing. All results showed that the measured brightness temperatures and radiometric noise agreed within the requirements for the mission. An inconsistency that particularly affected SLSTR-A was observed which has been attributed to an internal stray light error. A correction for the stray light has been proposed to reduce the error. The internal stray light error was reduced for SLSTR-B by replacing the coating on the main aperture stop. We present a description of the test methodology and the key results.
Investigations into Synoptic Spatiotemporal Characteristics of Coastal Upper Ocean Circulation Using High Frequency Radar Data and Model Output

Numerical models and remote sensing observation systems such as radars are useful for providing information on surface flows for coastal areas. Evaluation of their performance and extracting synoptic characteristics are challenging and important tasks. This research aims to investigate synoptic characteristics of surface flow fields through undertaking a detailed analysis of model results and high frequency radar (HFR) data using self-organizing map (SOM) and empirical orthogonal function (EOF) analysis. A dataset of surface flow fields over thirteen days from these two sources was used. A SOM topology map of size 4 × 3 was developed to explore spatial patterns of surface flows. Additionally, comparisons of surface flow patterns between SOM and EOF analysis were carried out. Results illustrate that both SOM and EOF analysis methods are valuable tools for extracting characteristic surface current patterns. Comparisons indicated that the SOM technique displays synoptic characteristics of surface flow fields in a more detailed way than EOF analysis. Extracted synoptic surface current patterns are useful in a variety of applications, such as oil spill treatment and search and rescue. This research provides an approach to using powerful tools to diagnose ocean processes from different aspects. Moreover, it is of great significance to assess SOM as a potential forecasting tool for coastal surface currents.
Landscape Dynamics in an Iconic Watershed of Northwestern Mexico: Vegetation Condition Insights Using Landsat and PlanetScope Data

Natural vegetation in arid and semi-arid environments of Northwestern Mexico has been subject to transformation due to extensive and intensive human occupation related mostly to primary activities. Keystone habitats such as riparian ecosystems are extremely sensitive to land use changes that occur in their surrounding landscape. In this study, we developed remote sensing-based land cover classifications and post-classification fragmentation analysis, by using data from Landsat’s moderate resolution sensors Thematic Mapper and Operational Land Imager (TM and OLI) to assess land use changes and the shift in landscape configuration in a riparian corridor of a dynamic watershed in central Sonora during the last 30 years. In addition, we derived a high spatial resolution classification (using PlanetScope-PS2 imagery) to assess the “recent state” of the riparian corridor. According to our results, riparian vegetation has increased by 40%, although only 9% of this coverage corresponds to obligate riparian species. Scrub area shows a declining trend, with a loss of more than 17,000 ha due to the expansion of mesquite and buffelgrass-dominated areas. The use of moderate resolution Landsat data was essential to register changes in vegetation cover through time, however, higher resolution PlanetScope data were fundamental for the detection of limited aerial extent classes such as obligate riparian vegetation. The unregulated development of anthropogenic activities is suggested to be the main driver of land cover change processes for arid ecosystems in this region. These results highlight the urgent need for alternative management and restoration projects in an area where there is almost a total lack of protection regulations or conservation efforts.
Nutritive evaluation of grain Amaranth (Amaranthus spp.) in broiler chicken diets

Studies were carried out to determine the nutritive value of grain amaranth as a feed ingredient for broiler chickens and assess the extent to which it could replace maize in broiler diets. Three grain species were evaluated namely, Amaranthus cruentus L. , Amaranthus hypochondriacus L. and Amaranthus caudatus L. In the preliminary study, the chemical attributes of the grain were assessed. The average crude protein and metabolisable energy contents of the three grain species were 15.80% and 3310 kcal/kg, respectively. The mean lysine and sulphur amino acid levels were 0.78 and 0.67%, respectively. The mean tannin and trypsin inhibitor contents were 0.093% and 0.65 trypsin inhibitor units/mg, respectively. A. caudatus species had superior nutrient composition but contained the highest levels of antinutritional factors. In Experiment 1, raw grain from each of the three species was incorporated in broiler starter diets at 20, 40 and 60% levels. Chick body weight and feed intake at four weeks of age declined (P<0.05) while pancreas weights increased with increasing levels of dietary amaranth. The 20% A . hypochondriacus diet however gave similar (P>0.05) chick performance to that of the maize-soyabean meal control diet. Upon thermal extrusion of grain amaranth in Experiment 2, chick performance markedly improved, with the 20 and 40% A . hypochondriacus and A . cruentus grain diets showing similar (P>0.05) body weight, feed intake and feed efficiency as the maize-soya bean meal control diet. In Experiment 3, inclusion of lysine, lysine plus methionine and casein in 40% raw and 60% thermal processed A. hypochondriacus diets showed similar (P>0.05) chick performance between the thermal processed amaranth diet containing casein and
POPULATION GENETIC DIVERSITY OF FUSARIUM SOLANI THE CAUSAL AGENT OF SUGAR BEET ROOT ROT, USING VEGETATIVE COMPATIBILITY GROUPS (VCGS) AND ITS RELATIONSHIP TO VIRULENCE OF ISOLATES

هديكچ هورگ قيقحت نيا رد ه يشيور يراگزاس يا 27 هـيادج Fusarium solani دـنقردنغچ هـقوط و هـشير زا هـك ناتسا ه روشك فلتخم يا ناريا عمج آ تـين ناگتفاي شهج زا هدافتسا اب دوب هدش يرو (nit mutant) نيـيعت عومجم رد . دش زا 27 شيامزآ دروم هيادج 222 . دش لصاح تين تناتوم تين ناگتفاي شهج يپيتونف سلاك نآ هنگرپ يدشر تاصخشم ساسارب ه زا يكي يواح هك هياپ تشك طيحم يور ا راهچ نيـيعت دوب تزا عبنم . دش نومزآ ماجنا روظنم هب ه لمكم يا س هورگ نييعت و يزا ه ناگتفاي شهج هيلك يشيور راگزاس يا nitM اـب ناگتفاي شهج nit1 , nit3 اي و nit1 اب nit3 . دندش هداد رارق مه لباقم لـحم رد يراگزاـس دوـجو تروص رد هسير يقلات ه يا ود فلتخم تين , ورپ دـشر تروـص هـب نويراكورته ليكشت وت فورت كـي . دـش رهاـظ دـشر ورپ وت فورت كي نيب nitM و nit3 اي nit1 يوق ت ورپ دشر زا ر وت نيب فورت nit1 و nit3 رهاظ يم ش ساسا نيارب . د بيترت هب 44 ,دصرد 36 و دصرد 20 دصرد يپيتوـنف سلاك هب قلعتم هدمآ تسد هب تين ناگتفاي شهج زا
The role of psbA1 in Synechocystis sp. PCC 6803 under low-oxygen conditions

The transcriptional response of the model cyanobacterium Synechocystis sp. PCC 6803 to low-oxygen conditions includes the up-regulation of several clusters of genes related to photosynthesis and electron transport. One of these clusters includes genes for isoforms of the Rieske protein of the cytochrome b6f complex (encoded by petC2) and the D1 subunit of Photosystem II (PS II; encoded by psbA1). Low-oxygen induced psbA genes are found in the genomes of a number of cyanobacteria; however, their function is not understood. The aim of this project was to determine the roles of psbA1 and the genes of the low-oxygen cluster (LOC) in Synechocystis sp. PCC 6803 under low-oxygen conditions. The LOC genes were co-transcribed in response to fluctuating oxygen levels. None of the genes in the LOC were essential for growth under low-oxygen conditions; however, a psbA1 knockout strain displayed increased respiratory activity and perturbed variable chlorophyll a fluorescence induction. A petC2 knockout strain also displayed altered physiology, suggestive of modulation of quinone exchange by the cytochrome b6f complex. A series of psbA mutant strains were constructed, in which the D1ʹ-encoding psbA1 or the D1-encoding psbA2 were expressed from either the low-oxygen responsive psbA1 promoter or the constitutive psbA2 promoter. These strains were used to characterise the D1ʹor D1-containing PS II reaction centres in both low-oxygen and aerobic conditions, and revealed differences between the chlorophyll a fluorescence characteristics and electron transport capabilities of each type. D1ʹ-containing PS II reaction centre complexes were assembled to lower levels than D1-containing centres, probably due to decreased accumulation of the D1ʹ protein. Centres with D1ʹ were more sensitive to light-induced damage than those with D1, leading to an increased susceptibility to photoinhibition of D1ʹcontaining centres. In addition, a serendipitously discovered point mutation in the chlH gene, encoding part of the Mg-chelatase enzyme of chlorophyll a biosynthesis, was characterised. Introduction of the Gly195Glu substitution resulted in a ~40% decrease in the accumulation of chlorophyll a and altered photosystem stoichiometry. The reduced chlorophyll levels in the G195E background may serve as a tool to investigate the biogenesis and repair of the photosynthetic apparatus.
Advanced Respiratory Support in the Contemporary Cardiac ICU

Supplemental Digital Content is available in the text. Objectives: The medical complexity and critical care needs of patients admitted to cardiac ICUs are increasing, and prospective studies examining the underlying cardiac and noncardiac diagnoses, the management strategies, and the prognosis of cardiac ICU patients with respiratory failure are needed. Design: Prospective cohort study. Setting: The Critical Care Cardiology Trials Network is a research collaborative of cardiac ICUs across the United States and Canada. Patients: We included all medical cardiac ICU admissions at 25 cardiac ICUs during two consecutive months annually at each center from 2017 to 2019. Measurements: We evaluated the use of advanced respiratory therapies including invasive mechanical ventilation, noninvasive ventilation, and high-flow nasal cannula versus no advanced respiratory support across admission diagnoses and the association with in-hospital mortality. Main Results: Of 8,240 cardiac ICU admissions, 1,935 (23.5%) were treated with invasive mechanical ventilation, 573 (7.0%) with noninvasive ventilation, and 281 (3.4%) with high-flow nasal cannula. Admitting diagnoses among those with advanced respiratory support were diverse including general medical problems in patients with heart disease as well as primary cardiac problems. In-hospital mortality was higher in patients who received invasive mechanical ventilation (38.1%; adjusted odds ratio, 2.53; 2.02–3.16) and noninvasive ventilation or high-flow nasal cannula (8.8%; adjusted odds ratio, 2.25; 1.73–2.93) compared with patients without advanced respiratory support (4.6%). Reintubation rate was 7.6%. The most common variables associated with respiratory insufficiency included heart failure, infection, chronic obstructive pulmonary disease, and pulmonary vascular disease. Conclusions: One-third of cardiac ICU admissions receive respiratory support with associated increased mortality. These data provide benchmarks for quality improvement ventures in the cardiac ICU, inform cardiac critical care training and staffing patterns, and serve as foundation for future studies aimed at improving outcomes.
Comparison of the Difference in Quality of Walnut in Xinjiang and the Hinterland

【Objective】Through the comprehensive analysis of nutrition indexes of 11 different varieties of walnut in Xinjiang and the mainland,to explore the differences in nutrients among different varieties. Thus we could evaluate the superiority and inferiority of the quality,so as to provide necessary reference for exploring high quality walnut in Xinjiang. 【Method】Based on field sampling and indoor chemical analysis,the principal component analysis method was used. 【Result】7 principal components were selected,which could represent 94. 90% of high quality integrated information,and it was used to reflect high quality of the walnut. According to the score of principal component value and evaluation function of each sample,the comprehensive nutrition level of different varieties of walnut presented that Zhonglin 1 Pao Jinlong 1 Lvling Xiangling Liaoning 1 Liaohe 3 Wen 185 Luguang Liaohe 1 Xinxin 2. 【Conclusion】Compared with the walnut varieties in mainland,Xinxin 2 and Wen 185 of Xinjiang,the two varieties were relatively abundant in the content of protein,amino acids,tannins and other indexes. However,they were not dominating in the comprehensive index assessment.
Efficacy of insecticides and neem against bemisia tabaci genn and yellow mosaic virus in mung bean

The insecticides viz., dimethoate (0.03%), monocrotophos (0.04%) and carbofuran (0.5 kg a.i./ha) gave better response and were found most effective followed by neem based formulations as moderately effective. The neem based insecticides viz., NSKE (3%). achook (0.3%), neem gold (0.3%) and nimbecidin (0.3%) were found comparable to monocrotophos and dimethoate in all respects. All the insecticides were found economical but two sprays of dimethoate was found most effective and economical.
Age and size at maturity in a patchy environment: fitness maximization versus evolutionary stability

The evolution of age at maturity under exploitation competition in a patchy environment is modelled using both an analytical approach and computer simulations. Maturity is defined as the switch from allocating resources to growth to allocating them to reproduction, and fitness is measured as lifetime energy allocation to reproduction. Explicit consideration of resources and their exploitation brings about frequency dependence. As a consequence, whenever two of more individuals jointly exploit a patch, the ESS is to mature later and at larger size than at the age and size maximizing the fitness measure