Miracle-dz/UniFAR-FTUs huggingface dataset:
Transformer with Depth-Wise LSTM

Increasing the depth of models allows neural models to model complicated functions but may also lead to optimization issues. The Transformer translation model employs the residual connection to ensure its convergence. In this paper, we suggest that the residual connection has its drawbacks, and propose to train Transformers with the depth-wise LSTM which regards outputs of layers as steps in time series instead of residual connections, under the motivation that the vanishing gradient problem suffered by deep networks is the same as recurrent networks applied to long sequences, while LSTM (Hochreiter and Schmidhuber, 1997) has been proven of good capability in capturing long-distance relationship, and its design may alleviate some drawbacks of residual connections while ensuring the convergence. We integrate the computation of multi-head attention networks and feed-forward networks with the depth-wise LSTM for the Transformer, which shows how to utilize the depth-wise LSTM like the residual connection. Our experiment with the 6-layer Transformer shows that our approach can bring about significant BLEU improvements in both WMT 14 English-German and English-French tasks, and our deep Transformer experiment demonstrates the effectiveness of the depth-wise LSTM on the convergence of deep Transformers. Additionally, we propose to measure the impacts of the layer's non-linearity on the performance by distilling the analyzing layer of the trained model into a linear transformation and observing the performance degradation with the replacement. Our analysis results support the more efficient use of per-layer non-linearity with depth-wise LSTM than with residual connections.
Multi-dialect Arabic BERT for Country-level Dialect Identification

Arabic dialect identification is a complex problem for a number of inherent properties of the language itself. In this paper, we present the experiments conducted, and the models developed by our competing team, Mawdoo3 AI, along the way to achieving our winning solution to subtask 1 of the Nuanced Arabic Dialect Identification (NADI) shared task. The dialect identification subtask provides 21,000 country-level labeled tweets covering all 21 Arab countries. An unlabeled corpus of 10M tweets from the same domain is also presented by the competition organizers for optional use. Our winning solution itself came in the form of an ensemble of different training iterations of our pre-trained BERT model, which achieved a micro-averaged F1-score of 26.78% on the subtask at hand. We publicly release the pre-trained language model component of our winning solution under the name of Multi-dialect-Arabic-BERT model, for any interested researcher out there.
Genetic analysis of economic traits in finger millet.

Continuous crop genetic improvement to mitigate dynamic production constraints driven by changing production environments, and to cater to ever changing preferences and requirements of the farmers and the endusers is necessary for adoption of a well conceived strategy that hinges on the sound knowledge on the nature of genetic control of economic traits (among others) in the working germplasm. Based on this premise, an investigation was carried out in the experimental fields of University of Agricultural Sciences (UAS), GKVK Campus, Bangalore, India during 1998–99 to estimate components of genotypic variability through analysis of half-sib and full-sib progeny family variances. The results revealed involvement of both additive and dominance genetic variation with a preponderance of the latter in the expression of time to 50% flower, plant height and dry fodder weight plant -1 while only dominance genetic variation was operative in the expression of number of tillers plant -1 , number of fingers ear -1 and grain weight plant -1 . These results are discussed in relation to the adoption of suitable breeding and selection strategy for genetic enhancement of economic traits in finger millet.
Quenching dynamics of the bright solitons and other localized states in spin–orbit coupled Bose–Einstein condensates

We study the dynamics of binary Bose–Einstein condensates made of ultracold and dilute alkali-metal atoms in a quasi-one-dimensional setting. Numerically solving the two coupled Gross–Pitaevskii equations which accurately describe the system dynamics, we demonstrate that the spin transport can be controlled by suitably quenching spin–orbit and Rabi coupling strengths. Moreover, we predict a variety of dynamical features induced by quenching: broken oscillations, breathers-like oscillating patterns, spin-mixing–demixing, miscible–immiscible transition, emerging dark–bright states, dark solitons, and spin-trapping dynamics. We also outline the experimental relevance of the present study in manipulating the spin states in 39K condensates.
Drum Beats and Where To Find Them: Sampling Drum Patterns from a Latent Space

This paper presents a large dataset of drum patterns and compares two different architectures of artificial neural networks that produce latent explorable spaces with some recognizable genre areas. Adversarially constrained autoencoder interpolations (ACAI) show better results in comparison with a standard variational autoencoder. To our knowledge, this is the first application of ACAI to drum-pattern generation.
High refractive index and extreme biaxial optical anisotropy of rhenium diselenide for applications in all-dielectric nanophotonics

Abstract We establish a simple quantitative criterium for the search of new dielectric materials with high values of refractive index in the visible range. It is demonstrated, that for light frequencies below the bandgap, the latter is determined by the dimensionless parameter η calculated as the ratio of the sum of the widths of conduction and valence bands and the bandgap. Small values of this parameter, which can be achieved in materials with almost flat bands, lead to dramatic increase of the refractive index. We illustrate this rule with a particular example of rhenium dichalcogenides, for which we perform ab initio calculations of the band structure and optical susceptibility and predict the values of the refractive index n>5$n{ >}5$ in a wide frequency range around 1 eV together with comparatively low losses. Our findings open new perspectives in search for the new high-index/low-loss materials for all-dielectric nanophotonics.
The influence of herbage water consumption on the nutritive value of Persian clover for dairy cows and sheep

Three experiments were done with lactating dairy cows and one with wether sheep to study the effects of adding water to, or removing water from, fresh Persian clover on its apparent digestion and utilization in ruminants. In these experiments, the dry matter content of freshly harvested herbage averaged 10%; this was extended by wilting herbage for 12-24 h, adding a small amount of dry feed to the diet or loading the rumen with additional water. This resulted in mean water consumption ranging from 62 to 173 L/day in lactating cows. Water consumption per se appeared to have no effect on apparent digestibility coefficients in the total gastrointestinal tract or milk production (P > 0.05) at either low or high levels of feeding. However, digestibility coefficients were significantly lower (P < 0.05) when wilted Persian clover herbage was fed to animals, with concomitant reductions in milk yield; most of this reduction was due to herbage respiration and enzymatic losses probably associated with the breakdown of non-structural carbohydrates. It has been suggested that digestibility coefficients may be reduced with forages of very high water content due to reduced mean retention times of digesta in the rumen. Chromium dilution rates in rumen fluid were fast and there was a tendency for these to be positively related to water consumption. Therefore, while there may have been reduced digestion of nutrients in the rumen with higher flow rates, this must have been countered-balanced by greater digestion in the intestines.
Adjoint-based variational method for constructing periodic orbits of high-dimensional chaotic systems

Chaotic dynamics in systems ranging from low-dimensional nonlinear differential equations to high-dimensional spatio-temporal systems including fluid turbulence is supported by non-chaotic, exactly recurring time-periodic solutions of the governing equations. These unstable periodic orbits capture key features of the turbulent dynamics and sufficiently large sets of orbits promise a framework to predict the statistics of the chaotic flow. Computing periodic orbits for high-dimensional spatio-temporally chaotic systems remains challenging as known methods either show poor convergence properties because they are based on time-marching of a chaotic system causing exponential error amplification; or they require constructing Jacobian matrices which is prohibitively expensive. We propose a new matrix-free method that is unaffected by exponential error amplification, is globally convergent and can be applied to high-dimensional systems. The adjoint-based variational method constructs an initial value problem in the space of closed loops such that periodic orbits are attracting fixed points for the loop-dynamics. We introduce the method for general autonomous systems. An implementation for the one-dimensional Kuramoto-Sivashinsky equation demonstrates the robust convergence of periodic orbits underlying spatio-temporal chaos. Convergence does not require accurate initial guesses and is independent of the period of the respective orbit.
When males are more inclined to stay at home: insights into the partial migration of a pelagic seabird provided by geolocators and isotopes

Partial migration has never been studied in pelagic seabirds, but investigating old unresolved questions in new contexts can provide useful fresh insights. We used geolocators and stable isotopes to investigate this phenomenon in a migratory pelagic seabird, the Cory’s shearwater (Calonectris diomedea). Although most birds migrated to the southern hemisphere, 8.1% of studied birds (N = 172) remained close to the breeding colony (Selvagem Grande, Madeira, Portugal), foraging within the Canary current. Almost all resident birds were males, while age or body size did not predict migratory status. Despite displaying a high repeatability (R = 0.72) in the choice of wintering area, residency was not a fixed strategy and individuals could switch between migrating and staying in the Canary current in different years. The predictions resulting from the "body size" and the "social dominance" hypotheses, in which larger individuals or dominant individuals, respectively, remain closer to the breeding areas, were not supported by our data. Resident males were able to occupy the nesting burrows much earlier than migratory males and arrival time in this species is known to affect the probability of engaging in a reproductive attempt. The selective pressure to arrive early at the colony is therefore the most likely explanation for the maintenance of this partial migration system.
Self-Lensing in Eclipsing X-ray Binary Systems

This project examines the feasibility of using gravitational lensing to measure the mass of compact objects in eclipsing X-ray binary (XRB) systems. We investigate which kind of XRB would be most conducive for viewing the effect, by modeling the amplification curves and determining if any feature of an XRB system could potentially hinder observation of such a signal. We examine the effect of accretion disks and stellar winds, as well as the compact object mass, binary separation, and companion spectral type. Generally speaking, the lensing signal is strongest for when the angular size subtended by the companion is small, favoring relatively compact companion stars (LMXBs) although evolved massive stars (such as certain WR stars) have signals that are feasibly detectable. Interestingly, the self-lensing signal is stronger in binaries with large separations, which is the exact opposite of the case for all other techniques. Thus, a dedicated self-lensing survey would complement X-ray and radial-velocity techniques, by extending the parameter space for discovery of compact objects. Simultaneously, a self-lensing survey offers the possibility of revealing the large population of non-accreting compact objects in galactic binary systems.
Automatic Debiased Machine Learning of Causal and Structural Effects

Many causal and structural effects depend on regressions. Examples include policy effects, average derivatives, regression decompositions, average treatment effects, causal mediation, and parameters of economic structural models. The regressions may be high‐dimensional, making machine learning useful. Plugging machine learners into identifying equations can lead to poor inference due to bias from regularization and/or model selection. This paper gives automatic debiasing for linear and nonlinear functions of regressions. The debiasing is automatic in using Lasso and the function of interest without the full form of the bias correction. The debiasing can be applied to any regression learner, including neural nets, random forests, Lasso, boosting, and other high‐dimensional methods. In addition to providing the bias correction, we give standard errors that are robust to misspecification, convergence rates for the bias correction, and primitive conditions for asymptotic inference for estimators of a variety of estimators of structural and causal effects. The automatic debiased machine learning is used to estimate the average treatment effect on the treated for the NSW job training data and to estimate demand elasticities from Nielsen scanner data while allowing preferences to be correlated with prices and income.
POPULATION GENETICS OF SKELETONEMA COSTATUM (BACILLARIOPHYCEAE) IN NARRAGANSETT BAY 1

During a two year period 457 clones of the diatom Skeletonema costatum were isolated prior to and during the summer‐fall and winter‐spring blooms of this species in Narragansett Bay, R.I. Their allozyme banding patterns were examined for 5 enzyme loci. Genotypic frequencies indicated that the winter bloom populations were genetically different from the prevalent summer bloom populations of the same species. Genetic differences between seasonal blooms are as great as those found between species of terrestrial organisms, but are not accompanied by morphological variation. Although blooms have distinct prevalent forms, they are not genetically homogeneous. No single clone is ever representative of all populations of S. costatum. The dynamics of these allochronic populations appear to be governed by a form of cyclic natural selection, and are probably a regular feature of the cycles of abundance of this species in this area. These results cast doubt on some of the assumptions often made in the “autecological approach” to phytoplankton ecology. This study comprises the first quantitative examination of the population genetics of a microalga.
Secondary Subcutaneous Rhizopus Infection in a Posttransplant Recipient with Calcific Uremic Arteriolopathy

Calcific uremic arteriolopathy is a rare condition affecting chronic kidney disease (CKD) patients on long-term dialysis. The clinical manifestations include subcutaneous skin necrosis and ulcers secondary to calcification of the subcutaneous blood vessels. The necrotic tissue often becomes a nidus of infection. The prognosis is often poor. We present a case of a renal allograft recipient who developed a subcutaneous necrotic lesion which was subsequently infected by Rhizopus spp. The patient underwent surgical debridement and antifungal therapy. The infection resolved completely. Our case represents agrave underlying condition predisposing a rare and serious posttransplant infection. The outcome was favourable because of early identification and treatment of the infection.
Duodenal perforation after percutaneous fluid drainage, a rare event: a case report

Abstract Duodenal perforations can be caused by surgical instruments during operations. These injuries can go initially unnoticed and lead to problematic complications. While uncommon, bowel perforation after percutaneous fluid drainage can severely impact the patient’s outcome. These can occur from equipment used for image-guided percutaneous drainage, a technique that has changed the way surgeons handle postoperative fluid collections and has become daily practice. Prompt recognition and timely treatment of these types of complications can minimize the consequences of this dreaded scenario. We present the case of a 29-year-old male, for whom an intra-abdominal collection was detected after laparoscopic cholecystectomy. CT-guided percutaneous drainage was performed, during which the catheter inadvertently punctured the duodenum. Surgical consultation was required and, since the patient remained asymptomatic, conservative management of the duodenal perforation was accomplished without complications. On follow-ups, the patient is doing well.
The effects of reducing population density on contact rates between brushtail possums: implications for transmission of bovine tuberculosis

Summary 1. Interactions during mating are thought to be an important mechanism for transmission of tuberculosis (Tb) Mycobacterium bovis in the brushtail possum Trichosurus vulpecula . However, little information is available on the frequency of contacts between males and females in oestrus during the breeding season, and the relationship between mating contacts and population density. 2. We used radio-telemetry to record contacts between male and oestrous and nonoestrous female possums, and determined paternity of offspring using DNA analysis. This was repeated following the removal of c . 70% of the resident possums to determine the effect of reducing density on the contact rate. 3. We could not detect any significant differences in the contact rate between oestrous and non-oestrous females and males, either before or after the density reduction, even when paternity was positively identified from DNA analysis. This suggests that actual mating contacts could not be distinguished from other agonistic or affiliative contact behaviours. 4. Despite this, the relationships between male‐female and male‐male contact rates and population density were non-linear convex-up, implying that the contact rate during the breeding season did not decrease in proportion to reductions in density. This appeared to be driven by the enlargement of male ranges and a corresponding increase in male overlap of female ranges following the density reduction. 5. The form of the contact rate function will influence predictions of disease spread in epidemiological models for Tb in wildlife. This has major implications for the development of tactical approaches to disease management based on such models.
Emulsifier type, metal chelation and pH affect oxidative stability of n‐3‐enriched emulsions

Recent research has shown that the oxidative stability of oil-in-water emulsions is affected by the type of surfactant used as emulsifier. The aim of this study was to evaluate the effect of real food emulsifiers as well as metal chelation by EDTA and pH on the oxidative stability of a 10% n-3-enriched oil-in-water emulsion. The selected food emulsifiers were Tween 80, Citrem, sodium caseinate and lecithin. Lipid oxidation was evaluated by determination of peroxide values and secondary volatile oxidation products. Moreover, the zeta potential and the droplet sizes were determined. Tween resulted in the least oxidatively stable emulsions, followed by Citrem. When iron was present, caseinate-stabilized emulsions oxidized slower than lecithin emulsions at pH 3, whereas the opposite was the case at pH 7. Oxidation generally progressed faster at pH 3 than at pH 7, irrespective of the addition of iron. EDTA generally reduced oxidation, as evaluated by volatiles formation in all emulsions, irrespective of pH and emulsifier type, except in the lecithin and caseinate emulsions where a pro-oxidative effect was observed for some volatiles. The different effects of the emulsifier types could be related to their ability to chelate iron, scavenge free radicals, interfere with interactions between the lipid hydroperoxides and iron as well as to form a physical barrier around the oil droplets.
Comparison of Two Percutaneous Atrial Septal Defect Occluders for Device Healing and Nickel Release in a Chronic Porcine Model

Aims To investigate the healing process and nickel release of the Hyperion occluder (Comed BV, Netherlands), as compared to the Amplatzer septal occluder (ASO) (St. Jude Medical Inc., St. Paul, MN, USA) in a chronic swine model. Background Some long-term complications occurring after percutaneous atrial septal defect (ASD) closure may be partially associated with an inappropriate healing of the device and increased nickel release. There is no direct comparative study of different occluders for healing and nickel release. Methods After percutaneous ASD creation, 12 pigs were implanted with 15 mm Hyperion (n = 6) and 15 mm ASO (n = 6) devices. After 1 month (n = 3 for each device) and 3 months (n = 3 for each device) of follow-up, device explantation was performed and healing was assessed using histopathological workup. Systemic and tissular nickel release was performed. Results Implantation was successful in 100% without complications. Device coverage was observed as early as 1 month after implantation and was almost complete after 3 months. A granulation tissue with a predominantly mononuclear inflammatory reaction was observed in contact with nitinol wires while an inflammatory reaction was seen in contact with textile fibers. We found no statistically significant difference between the 2 devices whether for histological grading scores or systemic nickel release, regardless to follow-up duration. Conclusions In this preclinical study, we demonstrated that Amplatzer septal occluder and Hyperion occluder were not significantly different for device healing and nickel release processes.
Are stored carbohydrates necessary for seed production in temperate deciduous trees?

Many tree species undergo large fluctuations from year to year in seed production, a phenomenon known as masting. The resource budget model, based on the assumption that abundant seeding in a masting year depends on the abundance of resources stored over several years, is a key hypothesis in explaining the mechanism of masting. But do masting species really need such long‐term storage to produce a large seed crop? To test this hypothesis, we studied the relationship between the carbon accumulation period for seed production, as estimated by radiocarbon (14C) analyses, and the coefficient of variation of annual seed production in 10 canopy tree species in a temperate deciduous forest. These species differ widely in their reproductive intervals. In all the species studied, the accumulation period was < 1.4 years before seed maturation. Moreover, without taking species or reproductive intervals into account, there was no significant correlation between the carbon accumulation period and the fluctuation of annual seed production; both remained at an even level. Synthesis. Our results suggest that temperate canopy trees used photosynthates produced in the current and/or the previous year for seed production, regardless of reproductive intervals. It might therefore be necessary to reconsider the importance of stored carbohydrate resources for masting.