Miracle-dz/UniFAR-FTUs huggingface dataset:
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation

A well-known limitation in pretrain-finetune paradigm lies in its inflexibility caused by the one-size-fits-all vocabulary.This potentially weakens the effect when applying pretrained models into natural language generation (NLG) tasks, especially for the subword distributions between upstream and downstream tasks with significant discrepancy. Towards approaching this problem, we extend the vanilla pretrain-finetune pipeline with an extra embedding transfer step. Specifically, a plug-and-play embedding generator is introduced to produce the representation of any input token, according to pre-trained embeddings of its morphologically similar ones.Thus, embeddings of mismatch tokens in downstream tasks can also be efficiently initialized.We conduct experiments on a variety of NLG tasks under the pretrain-finetune fashion. Experimental results and extensive analyses show that the proposed strategy offers us opportunities to feel free to transfer the vocabulary, leading to more efficient and better performed downstream NLG models.
The IMF and multiplicity of stars from gravity, turbulence, magnetic fields, radiation, and outflow feedback

We perform a series of three-dimensional, magnetohydrodynamical simulations of star cluster formation including gravity, turbulence, magnetic fields, stellar radiative heating, and outflow feedback. We observe that the inclusion of protostellar outflows (1) reduces the star formation rate by a factor of ∼2, (2) increases fragmentation, and (3) shifts the initial mass function (IMF) to lower masses by a factor of 2.0 ± 0.2, without significantly affecting the overall shape of the IMF. The form of the sink particle (protostellar objects) mass distribution obtained from our simulations matches the observational IMFs reasonably well. We also show that turbulence-based theoretical models of the IMF agree well with our simulation IMF in the high-mass and low-mass regime, but do not predict any brown dwarfs, whereas our simulations produce a considerable number of sub-stellar objects, which are produced by dynamical interactions (ejections). We find that these dynamical interactions also play a key role for the binary separation distribution and stellar kinematics in general. Our numerical model of star cluster formation also reproduces the observed mass dependence of multiplicity. Our multiplicity fraction estimates generally concur with the observational estimates for different spectral types. We further calculate the specific angular momentum of all the sink particles and find that the average value of $1.5 \times 10^{19}\, \mathrm{cm^2\, s^{-1}}$ is consistent with observational data. The specific angular momentum of our sink particles lies in the range typical of protostellar envelopes and binaries. We conclude that the IMF is controlled by a combination of gravity, turbulence, magnetic fields, radiation, and outflow feedback.
Many-gluon tree amplitudes on modern GPUs: A case study for novel event generators

The compute efficiency of Monte-Carlo event generators for the Large Hadron Collider is expected to become a major bottleneck for simulations in the high-luminosity phase. Aiming at the development of a full-fledged generator for modern GPUs, we study the performance of various recursive strategies to compute multi-gluon tree-level amplitudes. We investigate the scaling of the algorithms on both CPU and GPU hardware. Finally, we provide practical recommendations as well as baseline implementations for the development of future simulation programs. The GPU implementations can be found at: https://www.gitlab. com/ebothmann/blockgen-archive.
Automatic Risk Adaptation in Distributional Reinforcement Learning

The use of Reinforcement Learning (RL) agents in practical applications requires the consideration of suboptimal outcomes, depending on the familiarity of the agent with its environment. This is especially important in safety-critical environments, where errors can lead to high costs or damage. In distributional RL, the risk-sensitivity can be controlled via different distortion measures of the estimated return distribution. However, these distortion functions require an estimate of the risk level, which is difficult to obtain and depends on the current state. In this work, we demonstrate the suboptimality of a static risk level estimation and propose a method to dynamically select risk levels at each environment step. Our method ARA (Automatic Risk Adaptation) estimates the appropriate risk level in both known and unknown environments using a Random Network Distillation error. We show reduced failure rates by up to a factor of 7 and improved generalization performance by up to 14% compared to both risk-aware and risk-agnostic agents in several locomotion environments.
LocoProp: Enhancing BackProp via Local Loss Optimization

Second-order methods have shown state-of-the-art performance for optimizing deep neural networks. Nonetheless, their large memory requirement and high computational complexity, compared to first-order methods, hinder their versatility in a typical low-budget setup. This paper introduces a general framework of layerwise loss construction for multilayer neural networks that achieves a performance closer to second-order methods while utilizing first-order optimizers only. Our methodology lies upon a three-component loss, target, and regularizer combination, for which altering each component results in a new update rule. We provide examples using squared loss and layerwise Bregman divergences induced by the convex integral functions of various transfer functions. Our experiments on benchmark models and datasets validate the efficacy of our new approach, reducing the gap between first-order and second-order optimizers.
Well-Balanced Allocation on General Graphs

We study the graphical generalization of the 2-choice balls-into-bins process, where rather than choosing any two random bins, the bins correspond to vertices of an underlying graph, and only the bins connected by an edge can be chosen. For any k ( n ) edge-connected, d ( n ) -regular graph on n vertices and any number of balls, we give an allocation strategy which guarantees that the maximum gap between the bin loads is O (( d/k ) log 4 n log log n ) , with high probability. We further show that the dependence on k is tight and give an Ω(( d/k ) + log n ) lower bound on the gap achievable by any allocation strategy, for any graph G . In particular, our result gives polylogarithmic bounds for natural graphs such as cycles and tori, where the classical greedy allocation appears to result in a polynomial gap. Previously such a bound was known only for graphs with good expansion. The construction is based on deﬁning certain orthogonal ﬂows on cut-based Räcke decomposition of graphs. The allocation algorithm itself, however, is simple to implement and takes only O (log( n )) time per allocation, and can be viewed as a global version of the greedy strategy that compares average load on sets of vertices, rather than on individual vertices.
Roadmap on Atomtronics: State of the art and perspective

Atomtronics deals with matter-wave circuits of ultracold atoms manipulated through magnetic or laser-generated guides with different shapes and intensities. In this way, new types of quantum networks can be constructed in which coherent fluids are controlled with the know-how developed in the atomic and molecular physics community. In particular, quantum devices with enhanced precision, control, and flexibility of their operating conditions can be accessed. Concomitantly, new quantum simulators and emulators harnessing on the coherent current flows can also be developed. Here, the authors survey the landscape of atomtronics-enabled quantum technology and draw a roadmap for the field in the near future. The authors review some of the latest progress achieved in matter-wave circuits' design and atom-chips. Atomtronic networks are deployed as promising platforms for probing many-body physics with a new angle and a new twist. The latter can be done at the level of both equilibrium and nonequilibrium situations. Numerous relevant problems in mesoscopic physics, such as persistent currents and quantum transport in circuits of fermionic or bosonic atoms, are studied through a new lens. The authors summarize some of the atomtronics quantum devices and sensors. Finally, the authors discuss alkali-earth and Rydberg atoms as potential platforms for the realization of atomtronic circuits with special features.
MagNet: A Neural Network for Directed Graphs

The prevalence of graph-based data has spurred the rapid development of graph neural networks (GNNs) and related machine learning algorithms. Yet, despite the many datasets naturally modeled as directed graphs, including citation, website, and traffic networks, the vast majority of this research focuses on undirected graphs. In this paper, we propose MagNet, a GNN for directed graphs based on a complex Hermitian matrix known as the magnetic Laplacian. This matrix encodes undirected geometric structure in the magnitude of its entries and directional information in their phase. A "charge" parameter attunes spectral information to variation among directed cycles. We apply our network to a variety of directed graph node classification and link prediction tasks showing that MagNet performs well on all tasks and that its performance exceeds all other methods on a majority of such tasks. The underlying principles of MagNet are such that it can be adapted to other GNN architectures.
Measurement report: Regional characteristics of seasonal and long-term variations in greenhouse gases at Nainital, India and Comilla, Bangladesh

Abstract. Emissions of greenhouse gases (GHGs) from the Indian subcontinent have increased during the last 20 years along with rapid economic growth, however, there remains a paucity of GHG measurements for policy relevant research. In northern India and Bangladesh, agricultural activities are considered to play an important role on GHGs concentrations in the atmosphere. We performed weekly air sampling at Nainital (NTL) in northern India and Comilla (CLA) in Bangladesh from 2006 and 2012, respectively. Air samples were analyzed for dry-air gas mole fractions of CO2, CH4, CO, H2, N2O, and SF6, and carbon and oxygen isotopic ratios of CO2 (δ13C-CO2 and δ18O-CO2). Regional characteristics of these components over the Indo-Gangetic Plain are discussed compared to data from other Indian sites and Mauna Loa, Hawaii (MLO), which is representative of marine background air. We found that the CO2 mole fraction at both NTL and CLA had two seasonal minima in February‒March and September, corresponding to crop cultivation activities that depend on regional climatic conditions. The carbon isotopic signature also suggested that photosynthetic CO2 absorption by crops cultivated in each season contributes differently to lower CO2 mole fractions. The CH4 mole fraction of NTL and CLA in August‒October showed high values (i.e., sometimes over 4,000 ppb at CLA) due to the influence of CH4 emissions from the paddy fields in addition to the other sources due to the hot and humid climatic conditions. High CH4 mole fractions sustained over months at CLA were a characteristic feature in the Indo-Gangetic Plain. The CO mole fractions at NTL were also high and showed peaks in May and October, while CLA had much higher peaks in October‒March due to the influence of human activities such as emissions from biomass burning and brick production. The N2O mole fractions at NTL and CLA increased in June‒August and November‒February, which coincided with the application of nitrogen fertilizer and the burning of biomass such as the harvest residues and dung for domestic cooking. Based on H2 seasonal variation at both sites, it appeared that the emissions in this region were related to biomass burning in addition to production from the reaction of OH and CH4. The SF6 mole fraction was similar to that at MLO, suggesting that there were few anthropogenic emission sources in the district. The variability of CO2 growth rate at NTL was different from the variability in the CO2 growth rate at MLO, which is more closely linked with the El Niño Southern Oscillation (ENSO). In addition, the growth rates of the CH4 and SF6 mole fractions at NTL showed an anticorrelation with those at MLO, indicating that the frequency of southerly air masses strongly influenced these mole fractions. These finding showed that rather large regional climatic conditions considerably controlled interannual variations in GHGs, δ13C-CO2, and δ18O-CO2 through changes in precipitation and air mass.
Aortic Angiosarcoma in Association with Endovascular Aneurysm Repair: Case Report and Review of the Literature

Patient: Female, 82-year-old Final Diagnosis: Angiosarcoma of the aorta Symptoms: Fever Medication: — Clinical Procedure: — Specialty: Pathology Objective: Rare disease Background: Primary aortic sarcoma often poses diagnostic challenges for pathologists and clinicians because of a very low incidence and controversy over nomenclature and definition. We report a case of aortic angiosarcoma in association with a graft. We also conducted a clinicopathological review of cases of primary aortic sarcomas associated with implanted grafts. Case Report: The patient was an 82-year-old woman. She underwent thoracic endovascular aneurysm repair (TEVAR) at age 78 because of an aneurysm in the descending aorta. Approximately 4 years after the TEVAR, computed tomography revealed a type II endoleak and expansion of the aneurysm. Her c-reactive protein level rose to 34 mg/dL, and Ga scintigraphy showed 67Ga accumulation at the aneurysm. She had fever up to 39°C, and a stent graft infection was suspected. Despite administration of antibiotics, her condition deteriorated, and she died. Postmortem examination identified epithelioid aortic angiosarcoma at the aorta with aneurysm repair and the graft, and the aortic angiosarcoma invaded the left lower lobe of the lung. Conclusions: Our clinicopathological review revealed that the proper clinical diagnosis was very difficult owing to confusion of aortic sarcoma after the implantation with the infected graft, atypical endoleak, or pseudoaneurysm. The histological diagnosis was ambiguous because immunohistochemical and genetic studies were not adequately conducted. Overall prognosis of aortic sarcoma is poor as most patients die within a year, with no effective treatments. It is hoped that recent projects for genomic medicine will provide useful insights about the diagnosis and treatment of these cancers.
A CASE CONTROL STUDY TO EVALUATE THE RELATIONSHIP OF SERUM LIPID PROFILE, APO-LIPOPROTEINS, BODY MASS INDEX, WAIST HIP RATIO IN OCCURRENCE OF CHOLELITHIASIS

Introduction: The aim of this study was to evaluate the relationship of lipid profile, Apo-lipoprotein-A, Apo-lipoprotein-B, Body Mass Index, Waist Hip ratio with occurrence of gall stone disease. Materials and Methods: The study was conducted in the Department of Surgery in collaboration with Department of Biochemistry on 100 patients for a period of one year. The patients were divided in two groups: 50 cases (40 women, 10 men: mean age 39.98 years) and 50 controls (40 women, 10 men: mean age 38.50years). The study design was case control study. Blood was collected in fasting state and analyzed for Lipid profile (total cholesterol, high density lipoprotein cholesterol, low density lipoprotein cholesterol, total triglyceride, Apo-lipoprotein A, Apo-lipoprotein B). Anthropometric measurements were done to calculate body mass index and waist hip ratio. Results, Analysis and Discussion: Out of 100 patients, 80% were women and 20% were men. On lipid profile analysis in study group mean serum total cholesterol was 186.78±49.13 mg/dl, mean Triglyceride was 142.54±56.52 mg/dl, mean HDL-C was 39.46±27.97 mg/dl, LDL-C was 126.06±45.82 mg/dl, mean APO-A was 102.24±20.38 mg/dl, mean APO-B was 82.56±15.7 mg/dl. All above lipid profile parameter except HDL-C and APO-A were significantly higher in case group than control group p<0.001. While APO-A was significantly lower p<0.001 and HDL-C was lower but not significant p-0.179. The mean BMI was statistically higher in case group than control group (27.5±0.71 vs 24.31±0.32 kg/m2,p<0.001). The mean WHR was statistically higher in case group than control (0.87±0.39 vs 0.79±0.47,p<0.001). Conclusion: Elevated Triglyceride, Total Cholesterol, Low density lipoprotein cholesterol and it’s associated Apo lipoprotein-B(Apo-B) while decreased High density lipoprotein cholesterol and its associated Apo lipoprotein A (Apo-A) seems to play major contributing role in the pathogenesis of gall stone. Apo lipoproteins were more sensitive parameter than lipid profile in distinguishing patients with gall stone than without gall stones. Obesity and high Waist Hip Ratio (central obesity) were also associated with occurrence of cholelithiasis.
Engineered microenvironment for the study of myofibroblast mechanobiology

Myofibroblasts are mechanosensitive cells and a variety of their behaviours including differentiation, migration, force production and biosynthesis are regulated by the surrounding microenvironment. Engineered cell culture models have been developed to examine the effect of microenvironmental factors such as the substrate stiffness, the topography and strain of the extracellular matrix (ECM) and the shear stress on myofibroblast biology. These engineered models provide well‐mimicked, pathophysiologically relevant experimental conditions that are superior to those enabled by the conventional two‐dimensional (2D) culture models. In this perspective, we will review the recent advances in the development of engineered cell culture models for myofibroblasts and outline the findings on the myofibroblast mechanobiology under various microenvironmental conditions. These studies have demonstrated the power and utility of the engineered models for the study of microenvironment‐regulated cellular behaviours. The findings derived using these models contribute to a greater understanding of how myofibroblast behaviour is regulated in tissue repair and pathological scar formation.
Impact of Senior Team Shared Vision on Managerial Ambidexterity : Moderating Role of Transformational Leadership , in Banking Sector Lahore , Pakistan

Senior team members reconcile conflicting demands and facilitate, encourage, motivate the managers to achieve organizational goals. This study investigated the role of the senior team shared vision, middle-level manager’s exploration and exploitation activities and behavior of transformational leadership as a moderator in resolving conflicting interests among senior team members and middle-level managers for achieving managerial ambidexterity. Pearson’s Correlation and Hierarichal Regression have been employed to find the results. Findings indicate that a senior team shared vision are related with manager’s ability to combine the activities of exploration and exploitation while the role of transformational leadership behavior does not increase the effectiveness of senior
Transient Hyperbilirubinaemia and Sustained Elevation of Alkaline Phosphatase after the Ingestion of Lemongrass Tea

This study assessed the effect of lemongrass tea (LGT) on liver function indices in humans. One hundred and five participants ingested the LGT prepared from 2, 4, and 8g of LGL powder once daily for 30 days. Serum ALP level increased throughout the study period; although only the increase at day 30 reached statistical significance, while serum AST and ALT were not significantly different from baseline values. At days 10 and 30, serum total bilirubin significantly increased and decreased respectively. Ingestion of LGT may be associated with transient hyperbilirubinemia, and sustained elevation of ALP. © 2016 Elixir All rights reserved. Elixir Physio. & Anatomy 100 (2016) 43512-43516 Physiology and Anatomy Available online at www.elixirpublishers. com (Elixir International Journal) Tele: +2348023347719 E-mail address: chrisvon200@yahoo.com © 2016 Elixir All rights reserved Christopher E. Ekpenyong / Elixir Physio. & Anatomy 100 (2016) 43512-43516 43513 assessment, pregnancy or lactation, allergy to any lemongrass constituents, and use of drugs known to affect or to be metabolized primarily in the liver. Screening included determination of medical history, lifestyle assessment (such as smoking, drinking, physical activity, diet, and drug history), BP and heart rate (HR), weight, blood glucose level, full blood and platelet count, and urine and blood indices of renal and hepatic function. The participants were advised to avoid excessive physical activity and ingestion of drugs or alcohol, and to remain on their regular diet throughout the study period. The study protocol was approved by the Institutional Research Ethics Committee, and the study was conducted at the University of Uyo, Nigeria, according to the rules set forth in the Declaration of Helsinki governing the conduct of human research. Preparation of plant materials the Infusion of lemongrass leaves Fresh LG leaves were obtained from an agricultural farm in Uyo, Akwa Ibom State, Nigeria few days prior to utilization, in the month of May 2012. The leaves were identified and authenticated by a taxonomist in the department of Botany at the University of Uyo. Voucher specimen NO. UUH3276/UYO was deposited at the herbarium in the department of Botany of the University. The leaves were rinsed, sun-dried, and pulverized into powder using electric blender to give a gram weight of 200g. This was soaked in a container with 2 liters of hot water and allowed to stand for about 8hours. Thereafter the solution was filtered using No. 2 Whatman filter paper. The filtrate was evaporated by heating in water bath at 40 0 C to obtain the solid extract. The solid extract was weighed with an electric weighing balance (ACSZE14, Surgifriend Medicals Ltd, England) to obtain a yield of 70grams (35% w/w), which was stored in clean bottles at room temperature until required for use. Similar procedures were repeated using 2, 4 or 8g of LG powder and yields of 410mg, 810mg and 1570mg extract were obtained
Shining new light on sensory brain activation and physiological measurement in seals using wearable optical technology

Sensory ecology and physiology of free-ranging animals is challenging to study but underpins our understanding of decision-making in the wild. Existing non-invasive human biomedical technology offers tools that could be harnessed to address these challenges. Functional near-infrared spectroscopy (fNIRS), a wearable, non-invasive biomedical imaging technique measures oxy- and deoxyhaemoglobin concentration changes that can be used to detect localized neural activation in the brain. We tested the efficacy of fNIRS to detect cortical activation in grey seals (Halichoerus grypus) and identify regions of the cortex associated with different senses (vision, hearing and touch). The activation of specific cerebral areas in seals was detected by fNIRS in responses to light (vision), sound (hearing) and whisker stimulation (touch). Physiological parameters, including heart and breathing rate, were also extracted from the fNIRS signal, which allowed neural and physiological responses to be monitored simultaneously. This is, to our knowledge, the first time fNIRS has been used to detect cortical activation in a non-domesticated or laboratory animal. Because fNIRS is non-invasive and wearable, this study demonstrates its potential as a tool to quantitatively investigate sensory perception and brain function while simultaneously recording heart rate, tissue and arterial oxygen saturation of haemoglobin, perfusion changes and breathing rate in free-ranging animals. This article is part of the theme issue ‘Measuring physiology in free-living animals (Part I)’.