Miracle-dz/UniFAR-FTUs huggingface dataset:
Making Coherence Out of Nothing At All: Measuring the Evolution of Gradient Alignment

We propose a new metric ($m$-coherence) to experimentally study the alignment of per-example gradients during training. Intuitively, given a sample of size $m$, $m$-coherence is the number of examples in the sample that benefit from a small step along the gradient of any one example on average. We show that compared to other commonly used metrics, $m$-coherence is more interpretable, cheaper to compute ($O(m)$ instead of $O(m^2)$) and mathematically cleaner. (We note that $m$-coherence is closely connected to gradient diversity, a quantity previously used in some theoretical bounds.) Using $m$-coherence, we study the evolution of alignment of per-example gradients in ResNet and Inception models on ImageNet and several variants with label noise, particularly from the perspective of the recently proposed Coherent Gradients (CG) theory that provides a simple, unified explanation for memorization and generalization [Chatterjee, ICLR 20]. Although we have several interesting takeaways, our most surprising result concerns memorization. Naively, one might expect that when training with completely random labels, each example is fitted independently, and so $m$-coherence should be close to 1. However, this is not the case: $m$-coherence reaches much higher values during training (100s), indicating that over-parameterized neural networks find common patterns even in scenarios where generalization is not possible. A detailed analysis of this phenomenon provides both a deeper confirmation of CG, but at the same point puts into sharp relief what is missing from the theory in order to provide a complete explanation of generalization in neural networks.
Soil organic carbon stocks of afforested peatlands in Ireland

Summary This paper quantified the soil organic carbon (SOC) concentration, bulk density, depth and carbon (C) stocks of 24 afforested peatlands. We found that the peat bulk density does not increase with depth, as has been previously noted in the literature. The depths of each different peat type were found to vary widely with means of 192 ± 100, 145 ± 130 and 127 ± 100 cm for raised bogs (RB), high-level blanket bog (HLB) and low-level blanket bog (LLB), respectively. Based on the full-surveyed depth, we estimated carbon densities of: 1160 ± 520 Mg C ha 21 for RB peat; 775 ± 590 Mg C ha 21 for HLB peat and 705 ± 420 Mg C ha 21 for LLB peat. We found peat depth and peat type to be significant predictors of peat carbon density and present pedo-transfer functions for carbon density based on these predictors that will help to improve future peat C stock estimates. We suggest that due to the similarities between the carbon densities of the HLB and LLB, they can be analysed as one group for accounting purposes and future C stock estimates.
Exploring the Mass-loss Histories of the Red Supergiants

We report mid- to far-infrared imaging and photometry from 7 to 37 μm with SOFIA/FORCAST and 2 μm adaptive optics imaging with LBTI/LMIRCam of a large sample of red supergiants (RSGs) in four Galactic clusters: RSGC1, RSGC2 = Stephenson 2, RSGC3, and NGC 7419. The RSGs in these clusters cover their expected range in luminosity and initial mass from ≈9 to more than 25 M⊙. The population includes examples of very late-type RSGs such as MY Cep, which may be near the end of the RSG stage, high-mass-losing maser sources, yellow hypergiants, and post-RSG candidates. Many of the stars and almost all of the most luminous have spectral energy distributions (SEDs) with extended infrared excess radiation at the longest wavelengths. To best model their SEDs, we use the DUSTY code with a variable radial density distribution function to estimate their mass-loss rates. Our –luminosity relation for 42 RSGs basically follows the classical de Jager curve, but at luminosities below 105 , we find a significant population of RSGs with below the de Jager relation. At luminosities above 105 L⊙, there is a rapid transition to higher mass-loss rates that approximates and overlaps the de Jager curve. We recommend that instead of using a linear relation or single curve, the empirical –luminosity relation is better represented by a broad band. Interestingly, the transition to much higher at about 105 L⊙ corresponds approximately to an initial mass of 18–20 M⊙, which is close to the upper limit for RSGs becoming Type II supernovae.
Factors involved in Cancer Screening Participation: Multilevel Mediation Model

In this paper, we identify the factors associated with cancer screening participation in Korea. We expand upon previous studies through a multilevel mediation model and a composite regional socioeconomic status index which combines education level and income level. Results of the model indicate that education level, nutritional education status and income level are significantly associated with cancer screening participation. With our findings in mind, we recommend health authorities to increase promotional health campaigns toward certain at-risk groups and expand the availability of nutrition education programs.
Prolactin Enhances Cell-to-Cell Communication Among β-Cells in Pancreatic Islets

To determine the role of prolactin in increasing junctional communication among islet β-cells, we studied dye coupling in pancreatic islets exposed to elevated levels of prolactin in vivo and in vitro. Islets were isolated from rats immediately after lactation or from rats bearing mammosomatotropic tumors (MtTW15), conditions involving high levels of prolactin (either 5-fold or 1000-fold control levels, respectively). When β-cells were microinjected with the gap junction permeant dye Lucifer yellow CH, the mean number of dye-coupled cells per injection was ∼10-fold greater than in islets from virgin control rats. As a more direct test of the effects of prolactin on β-cell coupling, islets isolated from virgin rats were treated for 90 min with 500 ng/ml rat prolactin in the presence of low glucose (2.8 mM) and were microinjected with dye. The mean number of dye-coupled cells per injection increased by 6.7-fold over controls with low glucose, demonstrating a direct effect of prolactin on β-cell coupling. In vitro treatment with high glucose (16.7 mM) resulted in a 2.7-fold increase in dye-coupled cells per injection. We discuss the possible relationship between the effects of glucose and of prolactin on coupling.
Deep Learning Techniques for Future Intelligent Cross-Media Retrieval

With the advancement in technology and the expansion of broadcasting, cross-media retrieval has gained much attention. It plays a significant role in big data applications and consists in searching and finding data from different types of media. In this paper, we provide a novel taxonomy according to the challenges faced by multi-modal deep learning approaches in solving cross-media retrieval, namely: representation, alignment, and translation. These challenges are evaluated on deep learning (DL) based methods, which are categorized into four main groups: 1) unsupervised methods, 2) supervised methods, 3) pairwise based methods, and 4) rank based methods. Then, we present some well-known cross-media datasets used for retrieval, considering the importance of these datasets in the context in of deep learning based cross-media retrieval approaches. Moreover, we also present an extensive review of the state-of-the-art problems and its corresponding solutions for encouraging deep learning in cross-media retrieval. The fundamental objective of this work is to exploit Deep Neural Networks (DNNs) for bridging the "media gap", and provide researchers and developers with a better understanding of the underlying problems and the potential solutions of deep learning assisted cross-media retrieval. To the best of our knowledge, this is the first comprehensive survey to address cross-media retrieval under deep learning methods.
Power variations for fractional type infinitely divisible random fields

This paper presents new limit theorems for power variation of fractional type symmetric infinitely divisible random fields. More specifically, the random field $X = (X(\boldsymbol{t}))_{\boldsymbol{t} \in [0,1]^d}$ is defined as an integral of a kernel function $g$ with respect to a symmetric infinitely divisible random measure $L$ and is observed on a grid with mesh size $n^{-1}$. As $n \to \infty$, the first order limits are obtained for power variation statistics constructed from rectangular increments of $X$. The present work is mostly related to Basse-O'Connor, Lachieze-Rey, Podolskij (2017), Basse-O'Connor, Heinrich, Podolskij (2019), who studied a similar problem in the univariate context. We will see, however, that the asymptotic theory in the random field setting is much richer compared to Basse-O'Connor, Lachieze-Rey, Podolskij (2017), Basse-O'Connor, Heinrich, Podolskij (2019) as it contains new limits, which depend on the precise structure of the kernel $g$. We will give some important examples including the Levy moving average field, the well-balanced symmetric linear fractional $\beta$-stable sheet, and the moving average fractional $\beta$-stable field, and discuss potential consequences for statistical inference.
Demonstrating Quantum Zeno Effect on IBM Quantum Experience

Quantum Zeno Effect (QZE) has been one of the most interesting phenomena in quantum mechanics ever since its discovery in 1977 by Misra and Sudarshan [J. Math. Phys. \textbf{18}, 756 (1977)]. There have been many attempts for experimental realization of the same. Here, we present the first ever simulation of QZE on IBM quantum experience platform. We simulate a two-level system for Rabi-driven oscillation and then disturb the time evolution by intermediate repetitive measurements using quantum gates to increase the survival probability of the qubit in the initial state. The circuits are designed along with the added intermediate measurements and executed on IBM quantum simulator, and the outcomes are shown to be consistent with the predictions. The increasing survival probability with the number of intermediate measurements demonstrates QZE. Furthermore, some alternative explanations for the obtained results are provided which leads to some ambiguity in giving the exact reasoning for the observed outcomes.
Peer-inspired Student Performance Prediction in Interactive Online Question Pools with Graph Neural Network

Student performance prediction is critical to online education. It can benefit many downstream tasks on online learning platforms, such as estimating dropout rates, facilitating strategic intervention, and enabling adaptive online learning. Interactive online question pools provide students with interesting interactive questions to practice their knowledge in online education. However, little research has been done on student performance prediction in interactive online question pools. Existing work on student performance prediction targets at online learning platforms with predefined course curriculum and accurate knowledge labels like MOOC platforms, but they are not able to fully model knowledge evolution of students in interactive online question pools. In this paper, we propose a novel approach using Graph Neural Networks (GNNs) to achieve better student performance prediction in interactive online question pools. Specifically, we model the relationship between students and questions using student interactions to construct the student-interaction-question network and further present a new GNN model, called R2GCN, which intrinsically works for the heterogeneous networks, to achieve generalizable student performance prediction in interactive online question pools. We evaluate the effectiveness of our approach on a real-world dataset consisting of 104,113 mouse trajectories generated in the problem-solving process of over 4,000 students on 1,631 questions. The experiment results show that our approach can achieve a much higher accuracy of student performance prediction than both traditional machine learning approaches and GNN models.
SMALL-SCALE STRUCTURE AND RANDOMNESS: THE SCENERY FLOW IN DYNAMICS, GEOMETRY AND PROBABILITY (DECEMBER, 2005)

We prove the existence of means λ on L∞(R) which are invariant with respect to translation, convolution, and an exponential change of scale, and are also measure-linear in the sense of Mokobodski. We show exp(x) can be replaced in this theorem by any chosen convex change of scale. We prove a related theorem for directed sets, in the family of all convex functions, with a partial ordering given by composition. We give two applications. (i.) (an “infinite space Monte-Carlo method”): For all f ∈ L∞, λ(f) = λ(f(B(t)) for almost every Brownian path B(t) (ii.) (a pathwise Central Limit Theorem for Brownian motion): For all intervals I ⊆ R, λ(χI(B(t)/ √ t)) = 1 √ 2π ∫
A Framework for Software Diversification with ISA Heterogeneity

Software diversiﬁcation is one of the most effective ways to defeat memory corruption based attacks. Traditional software diversiﬁcation such as code randomization techniques diversiﬁes program memory layout and makes it difﬁcult for attackers to pinpoint the precise location of a target vulnerability. Some recent work in the architecture community use diverse ISA conﬁgurations to defeat code injection or code reuse attacks, showing that dynamically switching the ISA on which a program executes is a promising direction for future security systems. However, most of these work either remain in a simulation stage or require extra efforts to write program. In this paper, we propose HeterSec, a framework to secure applications utilizing a heterogeneous ISA setup composed of real world machines . HeterSec runs on top of commodity x86_64 and ARM64 machines and gives the process the illusion that it runs on a multi-ISA chip multiprocessor (CMP) machine. With HeterSec, a process can dynamically select its underlying ISA environment. Therefore, a protected process would be capable of hiding the instruction set on which it executed or detecting abnormal program behavior by comparing execution results step-by-step from multiple ISA-diversiﬁed instances. To demonstrate the effectiveness of such a software framework, we implemented HeterSec on Linux and showcased its deployability by running it on a pair of x86_64 and ARM64 servers, connected over InﬁniBand. We then conducted two case studies with HeterSec. In the ﬁrst case, we implemented a multi-ISA moving target defense (MTD) system, which introduces uncertainty at the instruction set level. In the second case, we implemented a multi-ISA-based multi-version execution (MVX) system. The evaluation re-sults show that HeterSec brings security beneﬁts through ISA diversiﬁcation with a reasonable performance overhead.
UV treatment of ballast water – breaking down the barrier for implementation

This study investigates the extra UV fluence needed to meet the International Maritime Organisation's ballast water discharge standards for the 10–50 μm size-class using the approved vital stain (VS) method compared to the Most Probable Number (MPN) method for organism viability assessment. Lowand medium pressure UV collimated beam treatments were applied to natural algae collected in temperate and tropical water environments and analysed using both methods. About 10 times higher UV fluence was required to meet discharge standards when using VS compared to MPN. Implementing a dark-hold period after UV treatments decreased algal viability. Length of dark-hold period to meet discharge standards decreased with increasing UV fluence. No significant differences between temperate and tropical samples were observed. The results showed that UV treated algae assessed using the VS method could meet discharge standards by increasing fluence and/or introducing a dark-hold period.
THE YOUNGEST RECORD OF THE CRETACEOUS SNAKE GENUS DINILYSIA (SQUAMATA, SERPENTES)

Abstract We report the youngest record of the Cretaceous snake Dinilysia, from the Late Cretaceous (Campanian) Anacleto Formation (Campanian) of Neuquén province, Argentina. The specimen consists on twenty four articulated mid-posterior trunk vertebrae with the base of their respective ribs. The specimen is refered to Dinilysia on the basis of several morphological features, including a triangular shape of the vertebral body, straight posterior border of the neural arch, large craniocaudal extension of the neural spine, absence of parazygantral foramen, and arqual ridges. This represents the youngest record of the genus Dinilysia, thus extending its biochron up to the Campanian age.
Production performance comparison of lactating buffaloes on feeding of total mixed ration versus conventional feeding

Total mixed ration is a balanced feed mixture that improves feed utilization thus improving reproductive and productive performance of animals. In present study a total of 40 lactating buffaloes were selected and categorized into two groups having 20 buffaloes each. Control group (T0) animals were on conventional feeding practice and treatment group (T1) was fed with TMR in a early lactation period of 120 days. The average milk yield (kg/d) was found significantly higher (P<0.05) in T1 (7.90±0.14) than T0 (6.82±0.11) with average increase milk yield by 1.13 L/day. TMR fed buffaloes also showed increased milk protein content (3.15 Vs 3.3%). The milk fat %, SNF also found higher in T1 with no significant difference. Percent increase in milk yield found to be 14.3% by TMR feeding. Thus it can be concluded that TMR is cost effective and can serve as a potential balanced ration for the lactating buffaloes for the enhancement of productivity.
Molecular phylogeny, morphology and bioacoustics reveal five additional species of arboreal microhylid frogs of the genus Anodonthyla from Madagascar

We provide a partial revision of the microhylid frogs of the genus Anodonthyla, endemic to Madagascar, based on comprehensive molecular, bioacoustic and morphological data sets that include newly collected specimens from multiple localities. The molecular trees provide strong evidence for the polyphyly of several nominal species as they were previously defined, especially of Anodonthyla boulengeri and A. nigrigularis. As a consequence, we here resurrect the nomen Mantella pollicaris Boettger as Anodonthyla pollicaris from the synonymy of A. boulengeri, and we describe four new species, all with strong genetic divergences to other nominal species: Anodonthyla emilei from Ranomafana National Park, a comparatively medium-sized species characterized by a multi-note advertisement call with high note repetition rate; A. theoi from Manombo Special Reserve, a small species characterized by low note repetition rate, long note duration and high spectral call frequency; A. vallani, a medium-sized species from Ambohitantely Special Reserve, characterized by low note repetition rate, long note duration and low spectral call frequency; and A. jeanbai, a small species from Andohahela National Park, characterized by a long and narrow head, presence of short dorsolateral folds, a very short first finger, and a yellowish ventral colour. A further candi date species comprises populations previously assigned to A. boulengeri from the Ranomafana region, which we do not describe because the corresponding data set is too fragmentary, and we refer to it as A. sp. aff. boulengeri ‘Ranomafana’. The molecular phylogeny indicates recurrent shifts between high and low note repetition rates in calls, based mainly on three strongly supported sister groups: A. moramora with low repetition rate and A. nigrigularis with moderately low repetition rate; A. theoi with low repetition rate and A. pollicaris with high repetition rate; and A. vallani with low repetition rate and A. sp. aff. boulengeri ‘Ranomafana’ with high repetition rate. The two species with the northernmost ranges, A. hutchisoni and A. boulengeri, are phylogenetically nested within clades of species occurring further south, confirming that the center of origin of the genus Anodonthyla was most likely in the South East of Madagascar. Contents
The Strengths, Weaknesses, Opportunities and Threats (SWOT) Analysis of the Severe Acute Respiratory Syndrome Coronavirus 2 of COVID-19

Introduction: SARS-CoV-2 is the etiologic agent of Coron-avirus Disease 2019 (COVID-19), a highly contagious, emergent, acute, viral pneumonia that emanated sporadically in Wuhan, China, in December 2019. COVID-19 became a pandemic in February 2020, leading to 4,942,687 confirmed cases and over 321,987 deaths and grounding several economies around the world as of May 2020. Although global researchers, epidemiologists, virologists, and medical professionals rose steadily to contain the disease, in-depth knowledge of the virus and concerted efforts to combat it are still evolving. This research sought to elucidate the biological Strengths, Weaknesses, Opportunities, and Threats to SARS-CoV-2, with a view to understanding and devising holistic strategies to combat, mitigate, and overcome the scourge of COVID-19. Methods: This narrative review utilized PubMed, Google, the Directory of Open Access Journals, ProMed, and other databases to search for and finally select 98 publications on coronaviruses, 2019-nCoV, and COVID-19 disease, us-ing text word searches to generate the specific search terms. Relevant publications were reviewed and compared; findings were synthesized using a narrative method and presented qualitatively. Results: Some identified Strengths of SARS-CoV-2
A remarkable new asiracine delphacid planthopper from Ecuador (Hemiptera, Fulgoroidea, Delphacidae)

A new genus and species of the asiracine tribe Platysystatini (Hemiptera: Fulgoromorpha: Delphacidae), Pichinchana gilletti from Ecuador, are described. A key to the platysystatine genera is provided. The relationships of this species to other group members and its biology are discussed. (© 2013 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)
NLPDove at SemEval-2020 Task 12: Improving Offensive Language Detection with Cross-lingual Transfer

This paper describes our approach to the task of identifying offensive languages in a multilingual setting. We investigate two data augmentation strategies: using additional semi-supervised labels with different thresholds and cross-lingual transfer with data selection. Leveraging the semi-supervised dataset resulted in performance improvements compared to the baseline trained solely with the manually-annotated dataset. We propose a new metric, Translation Embedding Distance, to measure the transferability of instances for cross-lingual data selection. We also introduce various preprocessing steps tailored for social media text along with methods to fine-tune the pre-trained multilingual BERT (mBERT) for offensive language identification. Our multilingual systems achieved competitive results in Greek, Danish, and Turkish at OffensEval 2020.
LESSER: a catalogue of spectroscopically selected sample of Lyman-α emitters lensed by galaxies

We introduce the LEnSed laeS in the Eboss suRvey (LESSER) project, which aims to search for lensed Lyman-$\alpha$ Emitters (LAEs) in the Extended Baryon Oscillation Spectroscopic Survey (eBOSS). The final catalog contains 361 candidate lensing systems. The lens galaxies are luminous red galaxies (LRGs) at redshift $0.4 < z < 0.8$, and the source galaxies are LAEs at redshift $2 < z < 3$. The spectral resolution of eBOSS ($\sim$2000) allows us to further identify the fine structures of Lyman-$\alpha$ ($\rm Ly\alpha$) emissions. Among our lensed LAE candidates, 281 systems present single-peaked line profiles while 80 systems show double-peaked features. Future spectroscopic/imaging follow-up observations of the catalog may shed light on the origin of diverse $\rm Ly\alpha$ line morphology, and provide promising labs for studying low mass dark matter haloes/subhaloes.