Miracle-dz/UniFAR-FTUs huggingface dataset:
Learning to Factor Policies and Action-Value Functions: Factored Action Space Representations for Deep Reinforcement learning

Deep Reinforcement Learning (DRL) methods have performed well in an increasing numbering of high-dimensional visual decision making domains. Among all such visual decision making problems, those with discrete action spaces often tend to have underlying compositional structure in the said action space. Such action spaces often contain actions such as go left, go up as well as go diagonally up and left (which is a composition of the former two actions). The representations of control policies in such domains have traditionally been modeled without exploiting this inherent compositional structure in the action spaces. We propose a new learning paradigm, Factored Action space Representations (FAR) wherein we decompose a control policy learned using a Deep Reinforcement Learning Algorithm into independent components, analogous to decomposing a vector in terms of some orthogonal basis vectors. This architectural modification of the control policy representation allows the agent to learn about multiple actions simultaneously, while executing only one of them. We demonstrate that FAR yields considerable improvements on top of two DRL algorithms in Atari 2600: FARA3C outperforms A3C (Asynchronous Advantage Actor Critic) in 9 out of 14 tasks and FARAQL outperforms AQL (Asynchronous n-step Q-Learning) in 9 out of 13 tasks.
Chitosan Enriched Three-Dimensional Matrix Reduces Inflammatory and Catabolic Mediators Production by Human Chondrocytes

This in vitro study investigated the metabolism of human osteoarthritic (OA) chondrocytes encapsulated in a spherical matrix enriched of chitosan. Human OA chondrocytes were encapsulated and cultured for 28 days either in chitosan-alginate beads or in alginate beads. The beads were formed by slowly passing dropwise either the chitosan 0.6%–alginate 1.2% or the alginate 1.2% solution through a syringe into a 102 mM CaCl2 solution. Beads were analyzed histologically after 28 days. Interleukin (IL)-6 and -8, prostaglandin (PG) E2, matrix metalloproteinases (MMPs), hyaluronan and aggrecan were quantified directly in the culture supernatant by specific ELISA and nitric oxide (NO) by using a colorimetric method based on the Griess reaction. Hematoxylin and eosin staining showed that chitosan was homogeneously distributed through the matrix and was in direct contact with chondrocytes. The production of IL-6, IL-8 and MMP-3 by chondrocytes significantly decreased in chitosan-alginate beads compared to alginate beads. PGE2 and NO decreased also significantly but only during the first three days of culture. Hyaluronan and aggrecan production tended to increase in chitosan-alginate beads after 28 days of culture. Chitosan-alginate beads reduced the production of inflammatory and catabolic mediators by OA chondrocytes and tended to stimulate the synthesis of cartilage matrix components. These particular effects indicate that chitosan-alginate beads are an interesting scaffold for chondrocytes encapsulation before transplantation to repair cartilage defects.
Comparing gray and white mineral trioxide aggregate as a repair material for furcation perforation: an in vitro dye extraction study.

INTRODUCTION Furcation perforation can have a negative impact on the prognosis of the affected tooth by compromising the attached apparatus. Hence these perforations require immediate repair. A variety of materials have been suggested for repair, of that MTA is the most promising material. The purpose of this study was to compare the ability of Gray and White MTA to seal furcation perforations using a dye extraction method under spectrophotometer. MATERIALS AND METHODS A total of 60 permanent mandibular molars were randomly divided into four experimental groups of 15 samples each as follows: Group A: Perforation repaired with White MTA. Group B: Perforation repaired with Gray MTA. Group C: Perforation left unsealed (positive). Group D: without perforation (negative). Dye extraction was performed using full concentration nitric acid. Dye absorbance was measured at 550 nm using spectrophotometer. The data analyzed using one-way-Anova Ratio and Unpaired t-test showing statistically significance difference among the groups. RESULT It was seen that Group D samples without perforation showed least absorbance followed by Group A (perforation repaired with White MTA) and Group B (perforation repaired with Gray MTA). Group C (perforation left unsealed) showed highest absorbance. CONCLUSION The White and Gray Mineral Trioxide Aggregate performed similarly as a furcation perforation repair material. There was no significant difference between the Gray MTA and White MTA.
Incidence rate of ovarian cancer cases in Saudi Arabia: an observational descriptive epidemiological analysis of data from Saudi Cancer Registry 2001–2008

Purpose This study provides descriptive epidemiological data, such as the percentage of cases diagnosed, crude incidence rate (CIR), and age-standardized incidence rate (ASIR) of ovarian cancer in Saudi Arabia from 2001–2008. Patients and methods A retrospective descriptive epidemiological analysis of all ovarian cancer cases recorded in the Saudi Cancer Registry (SCR) from January 2001–December 2008 was performed. The data were analyzed using descriptive statistics, analysis of variance tests, Poisson regression, and simple linear modeling. Results A total of 991 ovarian cancer cases were recorded in the SCR from January 2001–December 2008. The region of Riyadh had the highest overall ASIR at 3.3 cases per 100,000 women, followed by the Jouf and Asir regions at 3.13 and 2.96 cases per 100,000 women. However, Hail and Jazan had the lowest rates at 1.4 and 0.6 cases per 100,000 women, respectively. Compared to Jazan, the incidence rate ratio for the number of ovarian cancer cases was significantly higher (P<0.001) in the Makkah region at 6.4 (95% confidence interval [CI]: 4.13–9.83), followed by Riyadh at 6.3 (95% CI: 4.10–9.82), and the eastern region of Saudi Arabia at 4.52 (95% CI: 2.93–6.98). The predicted annual CIR and ASIR for ovarian cancer in Saudi Arabia could be defined by the equations 0.9 + (0.07× years) and 1.71 + (0.09× years), respectively. Conclusion We observed a slight increase in the CIRs and ASIRs for ovarian cancer in Saudi Arabia from 2001–2008. Riyadh, Jouf, and Asir had the highest overall ASIR, while Jazan and Hail had the lowest rates. Makkah, Riyadh, and the eastern region of Saudi Arabia had the highest incidence rate ratio for the number of ovarian cancer cases. Further analytical studies are required to determine the potential risk factors of ovarian cancer among Saudi women.
Murder Markets : Group Conflict , Network Contagion and the Social Structure of Gang Homicide

Note to Workshop: This draft is still largely unedited. I apologize for any errors. The discussion/conclusion section is still being written. " The gang, in short, is life, often rough and untamed, yet rich in elemental social processes significant to the student of society and human nature " – Frederic Thrasher (1927, pg. iii).
Neutrophil Recruitment and Activation in Decidua with Intra-Amniotic IL-1beta in the Preterm Rhesus Macaque1

ABSTRACT Chorioamnionitis, an infection/inflammation of the fetomaternal membranes, is frequently associated with preterm delivery. The mechanisms of inflammation in chorioamnionitis are poorly understood. We hypothesized that neutrophils recruited to the decidua would be the major producers of proinflammatory cytokines. We injected intra-amniotic (IA) interleukin 1beta (IL-1beta) at ∼80% gestation in rhesus macaque monkeys, Macaca mulatta, delivered the fetuses surgically 24 h or 72 h after IA injections, and investigated the role of immune cells in the chorion-amnion decidua. IA IL-1beta induced a robust infiltration of neutrophils and significant increases of proinflammatory cytokines in the chorioamnion decidua at 24 h after exposure, with a subsequent decrease at 72 h. Neutrophils in the decidua were the major source of tumor necrosis factor alpha (TNFalpha) and IL-8. Interestingly, IA IL-1beta also induced a significant increase in anti-inflammatory indoleamine 2,3-dioxygenase (IDO) expression in the decidua neutrophils. The frequency of regulatory T cells (Tregs) and FOXP3 mRNA expression in the decidua did not change after IA IL-1beta injection. Collectively, our data demonstrate that in this model of sterile chorioamnionitis, the decidua neutrophils cause the inflammation in the gestational tissues but may also act as regulators to dampen the inflammation. These results help to understand the contribution of neutrophils to the pathogenesis of chorioamnionitis-induced preterm labor.
How large can the first eigenvalue be on a surface of genus two

AbstractSharp upper bounds for the ﬁrst eigenvalue of the Laplacian on asurface of a ﬁxed area are known only in genera zero and one. Weinvestigate the genus two case and conjecture that the ﬁrst eigenvalue ismaximized on a singular surface which is realized as a double branchedcovering over a sphere. The six ramiﬁcation points are chosen in sucha way that this surface has a complex structure of the Bolza surface.We prove that our conjecture follows from a lower bound on the ﬁrsteigenvalue of a certain mixed Dirichlet-Neumann boundary value problemon a half-disk. The latter can be studied numerically, and we presentconclusive evidence supporting the conjecture. Keywords: Laplacian, ﬁrst eigenvalue, surface of genus two, mixed boundaryvalue problem. ∗ Department of Mathematics and Statistics, McGill University, 805 Sherbrooke Str. West,Montreal, QC H3A 2K6, Canada; e-mail jakobson@math.mcgill. ca † Department of Mathematics, Heriot-Watt University, United Kingdom; e-mailM.Levitin@ma.hw. ac.uk
Neurofeedback of Slow Cortical Potentials in Children with Attention-Deficit/Hyperactivity Disorder: A Multicenter Randomized Trial Controlling for Unspecific Effects

Background: Neurofeedback (NF) in children with attention-deficit/hyperactivity disorder (ADHD) has been investigated in a series of studies over the last years. Previous studies did not unanimously support NF as a treatment in ADHD. Most studies did not control for unspecific treatment effects and did not demonstrate that self-regulation took place. The present study examined the efficacy of NF in comparison to electromyographic (EMG) feedback to control for unspecific effects of the treatment, and assessed self-regulation of slow cortical potentials (SCPs). Methods: A total of 150 children aged 7–9 years diagnosed with ADHD (82% male; 43% medicated) were randomized to 25 sessions of feedback of SCPs (NF) or feedback of coordination of the supraspinatus muscles (EMG). The primary endpoint was the change in parents’ ratings of ADHD core symptoms 4 weeks after the end of treatment compared to pre-tests. Results: Children in both groups showed reduced ADHD-core symptoms (NF 0.3, 95% CI -0.42 to -0.18; EMG 0.13, 95% CI -0.26 to -0.01). NF showed a significant superiority over EMG (treatment difference 0.17, 95% CI 0.02–0.3, p = 0.02). This yielded an effect size (ES) of d = 0.57 without and 0.40 with baseline observation carried forward (BOCF). The sensitivity analysis confirmed the primary result. Successful self-regulation of brain activity was observed only in NF. As a secondary result teachers reported no superior improvement from NF compared to EMG, but within-group analysis revealed effects of NF on the global ADHD score, inattention, and impulsivity. In contrast, EMG feedback did not result in changes despite more pronounced self-regulation learning. Conclusions: Based on the primary parent-rated outcome NF proved to be superior to a semi-active EMG feedback treatment. The study supports the feasibility and efficacy of NF in a large sample of children with ADHD, based on both specific and unspecific effects. Trial Register: Current controlled trials ISRCTN76187185, registered 5 February 2009.
Intergeneric Transfer of Conjugative and Mobilizable Plasmids Harbored by Escherichia coli in the Gut of the Soil Microarthropod Folsomia candida(Collembola)

ABSTRACT The gut of the soil microarthropod Folsomia candidaprovides a habitat for a high density of bacterial cells (T. Thimm, A. Hoffmann, H. Borkott, J. C. Munch, and C. C. Tebbe, Appl. Environ. Microbiol. 64:2660–2669, 1998). We investigated whether these gut bacteria act as recipients for plasmids from Escherichia coli. Filter mating with E. coli donor cells and collected feces of F. candida revealed that the broad-host-range conjugative plasmid pRP4-luc (pRP4 with a luciferase marker gene) transferred to fecal bacteria at estimated frequencies of 5.4 × 10−1 transconjugants per donor. The mobilizable plasmid pSUP104-luc was transferred from the IncQ mobilizing strain E. coli S17-1 and less efficiently from the IncF1 mobilizing strain NM522 but not from the nonmobilizing strain HB101. When S17-1 donor strains were fed to F. candida, transconjugants of pRP4-luc and pSUP104-luc were isolated from feces. Additionally, the narrow-host-range plasmid pSUP202-luc was transferred to indigenous bacteria, which, however, could not maintain this plasmid. Inhibition experiments with nalidixic acid indicated that pRP4-luc plasmid transfer took place in the gut rather than in the feces. A remarkable diversity of transconjugants was isolated in this study: from a total of 264 transconjugants, 15 strains belonging to the alpha, beta, or gamma subclass of the class Proteobacteriawere identified by DNA sequencing of the PCR-amplified 16S rRNA genes and substrate utilization assays (Biolog). Except forAlcaligenes faecalis, which was identified by the Biolog assay, none of the isolates was identical to reference strains from data banks. This study indicates the importance of the microarthropod gut for enhanced conjugative gene transfer in soil microbial communities.
Using Bayesian Networks to Identify and Prevent Split Purchases in Brazil

To cope with society's demand for transparency and corruption prevention, the Brazilian Office of the Comptroller General (CGU) has carried out a number of actions, including: awareness campaigns aimed at the private sector; campaigns to educate the public; research initiatives; and regular inspections and audits of municipalities and states. Although CGU has collected information from various different sources – Revenue Agency, Federal Police, and others –, going through all the data in order to find suspicious transactions has proven to be really challenging. In this paper, we present a Data Mining study applied on real data – government purchases – for finding transactions that might become irregular before they are considered as such in order to act proactively. Moreover, we compare the performance of various Bayesian Network (BN) learning algorithms with different parameters in order to fine tune the learned models and improve their performance. The best result was obtained using the Tree Augmented Network (TAN) algorithm and oversampling the minority class in order to balance the data set. Using a 10-fold cross-validation, the model correctly classified all split purchases, it obtained a ROC area of . 999, and its accuracy was 99.197%.
Specific Chemopreventive Agents Trigger Proteasomal Degradation of G1 Cyclins: Implications for Combination Therapy

Purpose: There is a need to identify cancer chemoprevention mechanisms. We reported previously that all-trans-retinoic acid (RA) prevented carcinogenic transformation of BEAS-2B immortalized human bronchial epithelial cells by causing G1 arrest, permitting repair of genomic DNA damage. G1 arrest was triggered by cyclin D1 proteolysis via ubiquitin-dependent degradation. This study investigated which chemopreventive agents activated this degradation program and whether cyclin E was also degraded. Experimental Design: This study examined whether: (a) cyclin E protein was affected by RA treatment; (b) cyclin degradation occurred in derived BEAS-2B-R1 cells that were partially resistant to RA; and (c) other candidate chemopreventive agents caused cyclin degradation. Results: RA treatment triggered degradation of cyclin E protein, and ALLN, a proteasomal inhibitor, inhibited this degradation. Induction of the retinoic acid receptor β, growth suppression, and cyclin degradation were each inhibited in BEAS-2B-R1 cells. Transfection experiments in BEAS-2B cells indicated that RA treatment repressed expression of wild-type cyclin D1 and cyclin E, but ALLN inhibited this degradation. Mutation of threonine 286 stabilized transfected cyclin D1, and mutations of threonines 62 and 380 stabilized transfected cyclin E, despite RA treatment. Specific chemopreventive agents triggered cyclin degradation. Nonclassical retinoids (fenretinide and retinoid X receptor agonists) and a synthetic triterpenoid (2-cyano-3,12-dioxooleana-1,9-dien-28-oic acid) each suppressed BEAS-2B growth and activated this degradation program. However, a vitamin D3 analog (RO-24–5531), a cyclooxygenase inhibitor (indomethacin), and a peroxisome proliferator-activated receptor γ agonist (rosiglitazone) each suppressed BEAS-2B growth, but did not cause cyclin degradation. BEAS-2B-R1 cells remained responsive to nonclassical retinoids and to 2-cyano-3,12-dioxooleana-1,9-dien-28-oic acid. Conclusions: Specific chemopreventive agents activate cyclin proteolysis. Yet, broad resistance did not occur after acquired resistance to a single agent. This provides a therapeutic rationale for combination chemoprevention with agents activating non-cross-resistant pathways.
Energies, structures, and electronic properties of molecules in solution with the C‐PCM solvation model

The conductor‐like solvation model, as developed in the framework of the polarizable continuum model (PCM), has been reformulated and newly implemented in order to compute energies, geometric structures, harmonic frequencies, and electronic properties in solution for any chemical system that can be studied in vacuo. Particular attention is devoted to large systems requiring suitable iterative algorithms to compute the solvation charges: the fast multipole method (FMM) has been extensively used to ensure a linear scaling of the computational times with the size of the solute. A number of test applications are presented to evaluate the performances of the method. © 2003 Wiley Periodicals, Inc. J Comput Chem 24: 669–681, 2003
Cognitive function and brain structure after recurrent mild traumatic brain injuries in young-to-middle-aged adults

Recurrent mild traumatic brain injuries (mTBIs) are regarded as an independent risk factor for developing dementia in later life. We here aimed to evaluate associations between recurrent mTBIs, cognition, and gray matter volume and microstructure as revealed by structural magnetic resonance imaging (MRI) in the chronic phase after mTBIs in young adulthood. We enrolled 20 young-to-middle-aged subjects, who reported two or more sports-related mTBIs, with the last mTBI > 6 months prior to study enrolment (mTBI group), and 21 age-, sex- and education matched controls with no history of mTBI (control group). All participants received comprehensive neuropsychological testing, and high resolution T1-weighted and diffusion tensor MRI in order to assess cortical thickness (CT) and microstructure, hippocampal volume, and ventricle size. Compared to the control group, subjects of the mTBI group presented with lower CT within the right temporal lobe and left insula using an a priori region of interest approach. Higher number of mTBIs was associated with lower CT in bilateral insula, right middle temporal gyrus and right entorhinal area. Our results suggest persistent detrimental effects of recurrent mTBIs on CT already in young-to-middle-aged adults. If additional structural deterioration occurs during aging, subtle neuropsychological decline may progress to clinically overt dementia earlier than in age-matched controls, a hypothesis to be assessed in future prospective trials.
Human Exposure to Cyanotoxins and their Effects on Health

Cyanotoxins are secondary metabolites produced by cyanobacteria. They pose a threat to human health and the environment. This review summarises the existing data on human exposure to cyanotoxins through drinking water, recreational activities (e.g., swimming, canoeing or bathing), the aquatic food web, terrestrial plants, food supplements, and haemodialysis. Furthermore, it discusses the tolerable daily intake and guideline values for cyanotoxins (especially microcystins) as well as the need to implement risk management measures via national and international legislation. Sažetak Cijanotoksini su sekundarni metaboliti potencijalno opasni za ljudsko zdravlje i okoliš, koje proizvode cijanobakterije. Ovaj pregledni rad donosi prikaz postojećih podataka o izloženosti ljudi cijanotoksinima putem vode za piće, rekreacije, vodenog hranidbenog lanca, kopnenih biljaka i nekih drugih specifičnih puteva (dodaci prehrani i intravenozni put). Nadalje, u njemu se raspravlja o dopuštenom dnevnom unosu (TDI) i preporučenim vrijednostima za cijanotoksine (naročito mikrocistine) i nužnost provedbe mjera upravljanja rizicima putem nacionalnih i međunarodnih zakona. To su mjere od najveće važnosti za očuvanje okoliša i ljudskog zdravlja.
Working Memory Mediates the Relationship between Intellectual Enrichment and Long-Term Memory in Multiple Sclerosis: An Exploratory Analysis of Cognitive Reserve

Abstract Some individuals with multiple sclerosis (MS) show decrements in long-term memory (LTM) while other individuals do not. The theory of cognitive reserve suggests that individuals with greater pre-morbid intellectual enrichment are protected from disease-related cognitive decline. How intellectual enrichment affords this benefit remains poorly understood. The present study tested an exploratory meditational hypothesis whereby working memory (WM) capacity may mediate the relationship between intellectual enrichment and verbal LTM decline in MS. Intellectual enrichment, verbal LTM, and WM capacity were estimated with the Wechsler Test of Adult Reading and Peabody Picture Vocabulary Test, delayed recall of the Hopkins Verbal Learning Test-Revised and Logical Memory of the Wechsler Memory Scale, and Digit Span Total, respectively. Intellectual enrichment predicted LTM (B=.54; p=.003) and predicted WM capacity (B=.91; p<.001). WM capacity predicted LTM, (B=.44; p<.001) and fully mediated the relationship between intellectual enrichment (B=.24; p=.27) and LTM (B=.33, p=.03), Sobel test, Z=3.31, p<. 001. These findings implicate WM capacity as an underlying mechanism of cognitive reserve and are an initial first step in understanding the relationship between intellectual enrichment, WM, and LTM in MS. (JINS, 2014, 20, 1–5)