Miracle-dz/UniFAR-FTUs huggingface dataset:
Habits, action sequences and reinforcement learning

It is now widely accepted that instrumental actions can be either goal‐directed or habitual; whereas the former are rapidly acquired and regulated by their outcome, the latter are reflexive, elicited by antecedent stimuli rather than their consequences. Model‐based reinforcement learning (RL) provides an elegant description of goal‐directed action. Through exposure to states, actions and rewards, the agent rapidly constructs a model of the world and can choose an appropriate action based on quite abstract changes in environmental and evaluative demands. This model is powerful but has a problem explaining the development of habitual actions. To account for habits, theorists have argued that another action controller is required, called model‐free RL, that does not form a model of the world but rather caches action values within states allowing a state to select an action based on its reward history rather than its consequences. Nevertheless, there are persistent problems with important predictions from the model; most notably the failure of model‐free RL correctly to predict the insensitivity of habitual actions to changes in the action–reward contingency. Here, we suggest that introducing model‐free RL in instrumental conditioning is unnecessary, and demonstrate that reconceptualizing habits as action sequences allows model‐based RL to be applied to both goal‐directed and habitual actions in a manner consistent with what real animals do. This approach has significant implications for the way habits are currently investigated and generates new experimental predictions.
Toxigenic Potential of Aspergillus Species Occurring on Maize Kernels from Two Agro-Ecological Zones in Kenya

Two agro-ecological zones in Kenya were selected to compare the distribution in maize of Aspergillus spp. and their toxigenicity. These were Nandi County, which is the main maize growing region in the country but where no human aflatoxicoses have been reported, and Makueni County where most of the aflatoxicosis cases have occurred. Two hundred and fifty-five households were sampled in Nandi and 258 in Makueni, and Aspergillus was isolated from maize. Aspergillus flavus and A. parasiticus isolates were tested for the presence of aflD and aflQ genes. Positive strains were induced to produce aflatoxins on yeast extract sucrose and quantified using liquid chromatography-tandem mass spectrometry (LCMSMS). Aspergillus flavus was the most common contaminant, and the incidence of occurrence in Nandi and Makueni was not significantly different (82.33% and 73.26%, respectively). Toxigenic strains were more prevalent than non-toxigenic strains. All the toxigenic strains from Makueni were of the S-type while those from Nandi belonged to the L-type. Quantitative differences in aflatoxin production in vitro between isolates and between strains were detected with S strains producing relatively larger amounts of total aflatoxins, B toxins and lower values for G toxins. This was in accord with the frequent aflatoxicosis outbreaks in Makueni. However some L strains produced considerable amounts of B toxins. Given the widespread distribution of toxigenic strains in both regions, the risk of aflatoxin poisoning is high when favorable conditions for toxin production occur.
Exotic E11 branes as composite gravitational solutions

A two-parameter group element is presented that interpolates between M-brane solutions. The group element is used to interpret a number of exotic branes related to the generators of the adjoint representation of E11 as non-marginal half-BPS bound states of M-branes. It is conjectured that the adjoint representation of E11 contains only generators related to bound states of fundamental M-branes which, in the limit, may be understood as membrane molecules.
Education and Labour Market Entry across Europe: The Impact of Institutional Arrangements in Training Systems and Labour Markets. Working Papers = Arbeitspapiere.

Education is the main resource of young people entering the labour market for securing employment, in competing for adequate employment contracts and to fulfill their occupational aspirations. As European countries differ widely in the institutional structure of their education and training systems and labour markets, different resources are provided to school-leavers entering into working life in different countries, who additionally face varying institutional and economic contexts in labour markets. The paper empirically addresses the crucial role of educational qualifications for successful labour market entry in twelve European countries in the mid-1990s, drawing on the 1992-1997 European Community Labour Force Survey. The main aim of the analyses is to gauge the extent to which cross-national differences in labour market outcomes for market entrants can be related to institutional differences between countries in terms of differences in qualification profiles of school leavers and differences in terms of the relationship between qualifications and early labour market outcomes. The analyses cover unemployment and occupational allocation as two major dimensions of early labour market outcomes, applying multilevel modelling to a database of repeated comparative cross-sectional surveys. The results indicate that institutional differences in both education and training systems and labour markets play a major role in explaining cross-national differences in the experiences of young people entering the labour market in EU countries, even allowing for the effects of variation in economic conditions and other unmeasured heterogeneity between countries and types of qualifications
kNN CF: a temporal social network

Recommender systems, based on collaborative filtering, draw their strength from techniques that manipulate a set of user-rating profiles in order to compute predicted ratings of unrated items. There are a wide range of techniques that can be applied to this problem; however, the k-nearest neighbour (kNN) algorithm has become the dominant method used in this context. Much research to date has focused on improving the performance of this algorithm, without considering the properties that emerge from manipulating the user data in this way. In order to understand the effect of kNN on a user-rating dataset, the algorithm can be viewed as a process that generates a graph, where nodes are users and edges connect similar users: the algorithm generates an implicit social network amongst the system subscribers. Temporal updates of the recommender system will impose changes on the graph. In this work we analyse user-user kNN graphs from a temporal perspective, retrieving characteristics such as dataset growth, the evolution of similarity between pairs of users, the volatility of user neighbourhoods over time, and emergent properties of the entire graph as the algorithm parameters change. These insights explain why certain kNN parameters and similarity measures outperform others, and show that there is a surprising degree of structural similarity between these graphs and explicit user social networks.
A neurochemical approach to valuation sensitivity over gains and losses

Prospect theory proposes the hypothesis that people have diminishing sensitivity in valuing increases in the size of monetary outcomes, for both gains and losses. For decision-making under risk, this implies a tendency to be risk-tolerant over losses while being generally risk averse over gains. We offer a neurochemistry-based model of the diminishing valuation sensitivity hypothesis. Specifically, we propose that dopamine tone modulates the sensitivity towards valuation of gains while serotonin tone modulates the sensitivity towards valuation of losses. Consequently, higher dopamine tone would yield a more concave valuation function over gains while higher serotonin tone would yield a more convex valuation function over losses. Using a neurogenetics strategy to test our neurochemical model, we find that subjects with the 9-repeat allele of DAT1 (lower DA tone) are more risk-tolerant over gains than subjects with the 10-repeat allele, and that subjects with the 10-repeat allele of STin2 (higher 5HT tone) are more risk-tolerant over losses than subjects with the 12-repeat allele. Overall, our results support the implications of our model and provide the first neurogenetics evidence that risk attitudes are partially hard-wired in differentiating between gain- and loss-oriented risks.
A Notion of Zero Dynamics for Linear, Time-delay System

Abstract The aim of this paper is to introduce a notion of zero dynamics for linear, time-delay systems. To this aim, we use the correspondence between time-delay systems and system with coefficients in a ring, so to exploit algebraic and geometric methods. By combining the algebraic notion of zero module and the geometric structure of the lattice of invariant submodules of the state module, we point out a natural way to define zero dynamics in particular situations. Then, we extend our approach, in order to encompass more general situations, and we provide a definition of zero dynamics which applies to a number of interesting cases, including that of time-delay systems with commensurable delays. Relations between this notion and fixed poles in closed loop control schemes, as well as with a concept of phase minimality, are discussed.
Initializing Convolutional Filters with Semantic Features for Text Classification

Convolutional Neural Networks (CNNs) are widely used in NLP tasks. This paper presents a novel weight initialization method to improve the CNNs for text classification. Instead of randomly initializing the convolutional filters, we encode semantic features into them, which helps the model focus on learning useful features at the beginning of the training. Experiments demonstrate the effectiveness of the initialization technique on seven text classification tasks, including sentiment analysis and topic classification.
Depression Without Sadness: Functional Outcomes of Nondysphoric Depression in Later Life

OBJECTIVES: We hypothesized that depressive symptoms not meeting full standard criteria for Major Depression would be associated with significant functional impairment among older adults over the course of a 13‐year follow‐up interval. Specifically, we developed criteria for a form of depression whose core symptoms did not include sadness or dysphoria.
Toward a Practical Dependency Grammar Theory of Discontinuities

The paper presents the major principles and concept s of a dependency grammar theory of discontinuities for English and German (and pres umably for many other languages as well). Discontinuities are identified in terms of t raditional projectivity violations. These violations are then reanalyzed according to the Rising Principle . This principle sees the relevant constituent attaching to a word that is no t its governor, but that dominates its governor. Perhaps the most innovative aspect of the account is the chain . By acknowledging the chain as the fundamental unit of syntax, the door opens to an efficient surface account of discontinuities and ma ny other phenomena of syntax. 1. Discontinuities
Role Play As An Approach In Developing Students’ Communicative Competence

This study was conducted to examine the outcome of role play as an approach in developing the communicative competence of freshmen. Moreover, the focus of this study was on how the role-play as an approach was conducted; hence, necessary enhancement should be offered if needed. The information were gathered through Focused Group Discussion (FGD). Guide questions were prepared and validated; interviews were recorded, transcribed, interpreted and analyzed. Results revealed that role play as a type of communicative activity was a valuable classroom approach to assist students in developing their communicative competence and to provide the students an opportunity to practice the English language with fluency and accuracy. It was also discovered that role play was beneficial in developing students’ communicative competence provided that it was not done too long. It encouraged students to express themselves; provided self-confidence and opportunity for practicing the rules of social behavior; and allowed learners to use their learned language.
Generalization analysis of listwise learning-to-rank algorithms

This paper presents a theoretical framework for ranking, and demonstrates how to perform generalization analysis of listwise ranking algorithms using the framework. Many learning-to-rank algorithms have been proposed in recent years. Among them, the listwise approach has shown higher empirical ranking performance when compared to the other approaches. However, there is no theoretical study on the listwise approach as far as we know. In this paper, we propose a theoretical framework for ranking, which can naturally describe various listwise learning-to-rank algorithms. With this framework, we prove a theorem which gives a generalization bound of a listwise ranking algorithm, on the basis of Rademacher Average of the class of compound functions. The compound functions take listwise loss functions as outer functions and ranking models as inner functions. We then compute the Rademacher Averages for existing listwise algorithms of ListMLE, ListNet, and RankCosine. We also discuss the tightness of the bounds in different situations with regard to the list length and transformation function.
Dishonest reporting in queue-based cross-layer network optimization

Queue-based cross-layer optimization algorithms have recently been a subject of intensive research in wireless networks. Their purpose is to guarantee stable operation and to achieve some form of fairness among users, whenever the traffic demand exceeds network capacity. Despite the plethora of work in this field, the scenario where one or more nodes declare false queue backlog values in order to gain throughput advantage remains unexplored. In this paper we examine this type of selfish misbehavior, concentrating on a specific class of algorithms, the so-called quadratic Lyapunov-function-based algorithms (QLA). In particular, the effect of backlog misreporting on a single-hop access network with contending stations is evaluated through simulations. A simple framework for the detection of misbehaving nodes is proposed, under the assumption that the access-point is aware of the utility functions of the stations. The detection approach exploits the fact that under QLA the throughput of a node must be approximately equal to an “expected” value, derived from the reported queue backlogs.
LONGITUDINAL HIGH-DIMENSIONAL DATA ANALYSIS

We develop a flexible framework for modeling high-dimensional functional and imaging data observed longitudinally. The approach decomposes the observed variability of high-dimensional observations measured at multiple visits into three additive components: a subject-specific functional random intercept that quantifies the cross-sectional variability, a subject-specific functional slope that quantifies the dynamic irreversible deformation over multiple visits, and a subject-visit specific functional deviation that quantifies exchangeable or reversible visit-to-visit changes. The proposed method is very fast, scalable to studies including ultra-high dimensional data, and can easily be adapted to and executed on modest computing infrastructures. The method is applied to the longitudinal analysis of diffusion tensor imaging (DTI) data of the corpus callosum of multiple sclerosis (MS) subjects. The study includes 176 subjects observed at 466 visits. For each subject and visit the study contains a registered DTI scan of the corpus callosum at roughly 30,000 voxels.
A Comparative Analysis of Genetic Diversity and Structure in Jaguars (Panthera onca), Pumas (Puma concolor), and Ocelots (Leopardus pardalis) in Fragmented Landscapes of a Critical Mesoamerican Linkage Zone

With increasing anthropogenic impact and landscape change, terrestrial carnivore populations are becoming more fragmented. Thus, it is crucial to genetically monitor wild carnivores and quantify changes in genetic diversity and gene flow in response to these threats. This study combined the use of scat detector dogs and molecular scatology to conduct the first genetic study on wild populations of multiple Neotropical felids coexisting across a fragmented landscape in Belize, Central America. We analyzed data from 14 polymorphic microsatellite loci in 1053 scat samples collected from wild jaguars (Panthera onca), pumas (Puma concolor), and ocelots (Leopardus pardalis). We assessed levels of genetic diversity, defined potential genetic clusters, and examined gene flow for the three target species on a countrywide scale using a combination of individual- and population-based analyses. Wild felids in Belize showed moderate levels of genetic variation, with jaguars having the lowest diversity estimates (HE = 0.57 ± 0.02; AR = 3.36 ± 0.09), followed by pumas (HE = 0.57 ± 0.08; AR = 4.20 ± 0.16), and ocelots (HE = 0.63 ± 0.03; AR = 4.16 ± 0.08). We observed low to moderate levels of genetic differentiation for all three target species, with jaguars showing the lowest degree of genetic subdivision across the country, followed by ocelots and pumas. Although levels of genetic diversity and gene flow were still fairly high, we detected evidence of fine-scale genetic subdivision, indicating that levels of genetic connectivity for wild felids in Belize are likely to decrease if habitat loss and fragmentation continue at the current rate. Our study demonstrates the value of understanding fine-scale patterns of gene flow in multiple co-occurring felid species of conservation concern, which is vital for wildlife movement corridor planning and prioritizing future conservation and management efforts within human-impacted landscapes.
Evaluation of Physicochemical Deterioration and Lipid Oxidation of Beef Muscle Affected by Freeze-thaw Cycles

This study was performed to explore the deterioration of physicochemical quality of beef hind limb during frozen storage at −20℃, affected by repeated freeze-thaw cycles. The effects of three successive freeze-thaw cycles on beef hind limb were investigated comparing with unfrozen beef muscle for 80 d by keeping at −20±1℃. The freeze-thaw cycles were subjected to three thawing methods and carried out to select the best one on the basis of deterioration of physicochemical properties of beef. As the number of repeated freeze-thaw cycles increased, drip loss decreased and water holding capacity (WHC) increased (p<0.05) till two cycles and then decreased. Cooking loss increased in cycle one and three but decreased in cycle two. Moreover, drip loss, WHC and cooking loss affected (p<0.05) by thawing methods within the cycles. However, pH value decreased (p<0.05), but peroxide value (p<0.05), free fatty acids value (p<0.05) and TBARS value increased (p<0.05) significantly as the number of repeated freeze-thaw cycles increased. Moreover, significant (p<0.05) interactive effects were found among the thawing methods and repeated cycles. As a result, freeze-thaw cycles affected the physicochemical quality of beef muscle, causing the degradation of its quality.
Adverse Childhood Experiences Among Immigrants to the United States

A growing number of studies have examined the “immigrant paradox” with respect to health behaviors in the United States. However, little research attention has been afforded to the study of adverse childhood experiences (ACE; neglect, physical and sexual abuse, and witnessing violence) among immigrants in the United States. The present study, using Waves I and II data from the National Epidemiologic Survey of Alcohol and Related Conditions (NESARC), aims to address these gaps by comparing forms of ACE of first- and second-generation immigrants with native-born American adults in the United States. We also examined the latent structure of ACE among immigrants and conducted analyses to assess the psychiatric correlates of identified latent classes. With the exception of neglect, the prevalence of ACE was markedly higher among native-born Americans and second-generation immigrants compared with first-generation immigrants. Four latent classes were identified—limited adverse experience (n = 3,497), emotional and physical abuse (n = 1,262), family violence (n = 358), and global adversity (n = 246). The latter three classes evinced greater likelihood of being diagnosed with a mood, anxiety, personality, and substance use disorder, and to report violent and non-violent antisocial behavior. Consistent with prior research examining the associations between the immigrant paradox and health outcomes, results suggest that first-generation immigrants to the United States are less likely to have experienced physical and sexual abuse and witness domestic violence. However, likely due to cultural circumstances, first-generation immigrants were more likely to report experiences that are deemed neglectful by Western standards.
The Probable and the Provable.

The book was planned and written as a single, sustained argument. But earlier versions of a few parts of it have appeared separately. The object of this book is both to establish the existence of the paradoxes, and also to describe a non-Pascalian concept of probability in terms of which one can analyse the structure of forensic proof without giving rise to such typical signs of theoretical misfit. Neither the complementational principle for negation nor the multiplicative principle for conjunction applies to the central core of any forensic proof in the Anglo-American legal system. There are four parts included in this book. Accordingly, these parts have been written in such a way that they may be read in different orders by different kinds of reader.
Ketorolac But Not Morphine Exerts Inflammatory and Metabolic Effects in Synovial Membrane After Knee Arthroscopy: A Double-Blind Randomized Prospective Study Using the Microdialysis Technique

Objective: Our aim was to study local synovial metabolism, inflammation, and subjective pain scoring after intra-articular injection of morphine, ketorolac, or placebo in knee arthroscopy. Methods: Sixty patients undergoing knee arthroscopy were randomized into 3 groups receiving morphine, ketorolac, or placebo before surgery. Microdialysis of the synovial membrane was performed in 10 patients in each group 4 hrs postoperatively. Lactate, glucose, glycerol, glutamate, and prostaglandin E2 (PGE2) were monitored regarding biochemical compounds and visual analog scale regarding perceived postoperative pain. Results: Ketorolac effectively attenuated postoperative PGE2 levels. Glycerol increased over time in the ketorolac group. Glutamate showed a decrease over time in both the morphine and ketorolac groups. Differences in PGE2 in the reference tissue indicated a systemic effect of ketorolac. There were no effects on subjective pain scoring (visual analog scale). Conclusions: To our knowledge, this is the first study on the local metabolic and inflammatory effect of intra-articularly administered morphine or ketorolac. For the first time, glutamate was studied in synovial tissue, and our results suggest that local release of glutamate may be important for nociception and inflammation. The effects of ketorolac on PGE2 implicates a local effect on inflammation and possibly, also nociception, but it should be remembered that 60 mg of ketorolac given intra-articularly also has a systemic effect. Release of glycerol after administration of ketorolac may indicate a toxicity of nonsteroidal anti-inflammatory drugs that must be further evaluated.