Miracle-dz/UniFAR-FTUs huggingface dataset:
Monte Carlo Q-learning for General Game Playing

Recently, the interest in reinforcement learning in game playing has been renewed. This is evidenced by the groundbreaking results achieved by AlphaGo. General Game Playing (GGP) provides a good testbed for reinforcement learning, currently one of the hottest fields of AI. In GGP, a specification of games rules is given. The description specifies a reinforcement learning problem, leaving programs to find strategies for playing well. Q-learning is one of the canonical reinforcement learning methods, which is used as baseline on some previous work (Banerjee & Stone, IJCAI 2007). We implement Q-learning in GGP for three small board games (Tic-Tac-Toe, Connect-Four, Hex). We find that Q-learning converges, and thus that this general reinforcement learning method is indeed applicable to General Game Playing. However, convergence is slow, in comparison to MCTS (a reinforcement learning method reported to achieve good results). We enhance Q-learning with Monte Carlo Search. This enhancement improves performance of pure Q-learning, although it does not yet out-perform MCTS. Future work is needed into the relation between MCTS and Q-learning, and on larger problem instances.
Mostly Exploration-Free Algorithms for Contextual Bandits

The contextual bandit literature has traditionally focused on algorithms that address the exploration–exploitation tradeoff. In particular, greedy algorithms that exploit current estimates without any exploration may be suboptimal in general. However, exploration-free greedy algorithms are desirable in practical settings where exploration may be costly or unethical (e.g., clinical trials). Surprisingly, we find that a simple greedy algorithm can be rate optimal (achieves asymptotically optimal regret) if there is sufficient randomness in the observed contexts (covariates). We prove that this is always the case for a two-armed bandit under a general class of context distributions that satisfy a condition we term covariate diversity. Furthermore, even absent this condition, we show that a greedy algorithm can be rate optimal with positive probability. Thus, standard bandit algorithms may unnecessarily explore. Motivated by these results, we introduce Greedy-First, a new algorithm that uses only observed contexts and rewards to determine whether to follow a greedy algorithm or to explore. We prove that this algorithm is rate optimal without any additional assumptions on the context distribution or the number of arms. Extensive simulations demonstrate that Greedy-First successfully reduces exploration and outperforms existing (exploration-based) contextual bandit algorithms such as Thompson sampling or upper confidence bound. This paper was accepted by J. George Shanthikumar, big data analytics.
Quantifying the variability of scene‐selective regions: Interindividual, interhemispheric, and sex differences

Scene‐selective regions (SSRs), including the parahippocampal place area (PPA), retrosplenial cortex (RSC), and transverse occipital sulcus (TOS), are among the most widely characterized functional regions in the human brain. However, previous studies have mostly focused on the commonality within each SSR, providing little information on different aspects of their variability. In a large group of healthy adults (N = 202), we used functional magnetic resonance imaging to investigate different aspects of topographical and functional variability within SSRs, including interindividual, interhemispheric, and sex differences. First, the PPA, RSC, and TOS were delineated manually for each individual. We then demonstrated that SSRs showed substantial interindividual variability in both spatial topography and functional selectivity. We further identified consistent interhemispheric differences in the spatial topography of all three SSRs, but distinct interhemispheric differences in scene selectivity. Moreover, we found that all three SSRs showed stronger scene selectivity in men than in women. In summary, our work thoroughly characterized the interindividual, interhemispheric, and sex variability of the SSRs and invites future work on the origin and functional significance of these variabilities. Additionally, we constructed the first probabilistic atlases for the SSRs, which provide the detailed anatomical reference for further investigations of the scene network. Hum Brain Mapp 38:2260–2275, 2017. © 2017 Wiley Periodicals, Inc.
Exploring the Relationship Between Emotional Intelligence and Health-Related Quality of Life in Patients with Cancer

This study examined the association between emotional intelligence (EI), personality, and its relation to health-related quality of life in 62 patients with cancer. Specially, the predictive and incremental validity of EI for predicting health-related quality of life beyond the level attributable to personality was examined. Emotional intelligence showed unique and significant variance in prediction of different health-related quality of life dimensions. These findings provide preliminary evidences that EI abilities are useful additions in the field of psycho-oncology. The potential value of including EI programs to complement current psychoeducational approaches aimed at preserving or improving cancer patient health-related quality of life is discussed.
Effects of correcting missing daily feed intake values on the genetic parameters and estimated breeding values for feeding traits in pigs

Abstract Daily feed intake (DFI) is an important consideration for improving feed efficiency, but measurements using electronic feeder systems contain many missing and incorrect values. Therefore, we evaluated three methods for correcting missing DFI data (quadratic, orthogonal polynomial, and locally weighted (Loess) regression equations) and assessed the effects of these missing values on the genetic parameters and the estimated breeding values (EBV) for feeding traits. DFI records were obtained from 1622 Duroc pigs, comprising 902 individuals without missing DFI and 720 individuals with missing DFI. The Loess equation was the most suitable method for correcting the missing DFI values in 5–50% randomly deleted datasets among the three equations. Both variance components and heritability for the average DFI (ADFI) did not change because of the missing DFI proportion and Loess correction. In terms of rank correlation and information criteria, Loess correction improved the accuracy of EBV for ADFI compared to randomly deleted cases. These findings indicate that the Loess equation is useful for correcting missing DFI values for individual pigs and that the correction of missing DFI values could be effective for the estimation of breeding values and genetic improvement using EBV for feeding traits.
NANOINDENTATION OF A ZINC METAL SOAP MIXTURE FOR USE IN A LASER PRINTER

OF THESIS NANOINDENTATION OF A ZINC METAL SOAP MIXTURE FOR USE IN A LASER PRINTER At the start of this project, the possible choices of metal soaps had already been narrowed to include some of the zinc soaps used in this project. These zinc soaps are mixtures of zinc stearate and zinc palmitate of varying ratios purchased from a supplier. Zinc soap was chosen as result of its common use in various industries as a lubricant and mold release, which implied potential benefits in an electrophotographic printing system. These potential benefits include, but are not limited to, a more efficient transfer from a photoconductive drum and protection of the drum from mechanical and chemical degradation. Nanoindentation of these soaps was implemented in an effort to characterize each soap mixture and compare how the soap types differed from one another. Each sample was indented under a variety of different maximum loads and at different holding times to observe effects on the modulus, hardness, and, creep. The mechanical properties measured were then used to help distinguish differences between each type and provide an insight as to how or why one mixture may be preferable over another. The data could be utilized in conjunction with further testing to be used in a simulation of an interface of interest.
Malignant Pericardial Effusion

OBJECTIVE To examine the frequency and diagnostic implications of malignant pericardial effusions. STUDY DESIGN The clinical and histologic records of pericardial effusions diagnosed cytologically as malignant were reviewed. We investigated the relationship between malignancy and type of tumor, interval between diagnosis of the primary tumor and development of the pericardial effusion, and length of survival after the onset of the effusion. RESULTS There were 375 pericardial effusions among 23,592 effusions studied over 24 years; 65 of them were diagnosed as malignant. The mean age at onset was 53.6 years. In 92% of the cases the primary tumor was epithelial, lung the most frequent in males and breast in females. In 48% of cases the pericardial effusion constituted the first sign of malignancy. CONCLUSION Diagnosis of a pericardial effusion as malignant carried an ominous prognosis: 86% of patients died within the first year and nearly one-third within the first month. Breast carcinomas were linked with the longest survival and longest interval of latency prior to the onset of the pericardial effusion. There were two effusions associated with lymphoblastic lymphomas; they have had no recurrence 10 and 17 years after the effusion, and the patients can be considered cured.
Brain regions that show repetition suppression and enhancement: A meta‐analysis of 137 neuroimaging experiments

Repetition suppression and enhancement refer to the reduction and increase in the neural responses for repeated rather than novel stimuli, respectively. This study provides a meta‐analysis of the effects of repetition suppression and enhancement, restricting the data used to that involving fMRI/PET, visual stimulus presentation, and healthy participants. The major findings were as follows. First, the global topography of the repetition suppression effects was strikingly similar to that of the “subsequent memory” effects, indicating that the mechanism for repetition suppression is the reduced engagement of an encoding system. The lateral frontal cortex effects involved the frontoparietal control network regions anteriorly and the dorsal attention network regions posteriorly. The left fusiform cortex effects predominantly involved the dorsal attention network regions, whereas the right fusiform cortex effects mainly involved the visual network regions. Second, the category‐specific meta‐analyses and their comparisons indicated that most parts of the alleged category‐specific regions showed repetition suppression for more than one stimulus category. In this regard, these regions may not be “dedicated cortical modules,” but are more likely parts of multiple overlapping large‐scale maps of simple features. Finally, the global topography of the repetition enhancement effects was similar to that of the “retrieval success” effects, suggesting that the mechanism for repetition enhancement is voluntary or involuntary explicit retrieval during an implicit memory task. Taken together, these results clarify the network affiliations of the regions showing reliable repetition suppression and enhancement effects and contribute to the theoretical interpretations of the local and global topography of these two effects. Hum Brain Mapp 38:1894–1913, 2017. © 2017 Wiley Periodicals, Inc.
Influence of Bathing or Washing on Skin Barrier Function in Newborns during the First Four Weeks of Life

Background and Objectives: After birth, skin barrier function is in state of flux and at risk of dysfunction. In a prospective clinical study, we compared the effects of 2 standard cleansing procedures on skin barrier function in newborns. Methods: Fifty-seven healthy full-term neonates aged ≤48 h were randomly assigned to either a bathing group (group B; n = 29), who were bathed with clear water twice weekly, or to a washing group (group W; n = 28), who were washed with a washcloth moistened with clear water twice weekly. Transepidermal water loss (TEWL), skin pH, stratum corneum hydration (SCH) and sebum production were measured at days 2, 7 and 28 of life on the forehead, abdomen, upper leg and buttock. Results: Group B showed significantly lower TEWL on the buttock and higher SCH on the abdomen and forehead compared to group W at day 28. Conclusions: Both skin care regimens do not harm the adaptation of the skin barrier in healthy neonates within the first 4 weeks of life. Skin barrier function differentiates after birth in a regionally specific fashion.
Differentiating Large Cell Lymphoma from Indolent Small B-Cell Lymphoma in Fine Needle Aspirates Using p53, PCNA and Transformed Lymphocyte Count

OBJECTIVE To determine the usefulness of proliferating cell nuclear antigen (PCNA), p53 protein expression and transformed lymphocyte count (TLC) as adjunctive tests to differentiate indolent small B-cell lymphoma from large cell lymphoma in fine needle aspiration biopsies. STUDY DESIGN Aspirates of lymphoproliferative disorders from April 1993 to January 1997 were reviewed. The percentage of TLCs was determined on the Papanicolaou smear. The percentage and intensity of p53 and PCNA immunocytochemical staining was evaluated on cell block sections. These results were compared and correlated with the final diagnoses based on available morphology, flow cytometry and clinical history. RESULTS There were 40 cases of non-Hodgkin's lymphoma and 12 reactive lymph nodes. Adequate cell blocks were available on 16 large cell lymphomas, 7 grade 1-2 follicular center cell lymphomas, 6 mucosal associated lymphoid tissue lymphomas, 2 small lymphocytic lymphomas and 2 mantle cell lymphomas. Average TLC and p53 nuclear staining was highest in large cell lymphomas (57% TLC and 24% p53), followed by grades 1 and 2 follicular lymphomas (14% TLC and 15% p53) and lowest in other indolent lymphomas (< 10% TLC and < 1% p53). Average PCNA staining was highest in large cell lymphomas (46%) and lowest in small lymphocytic lymphomas (7%); however, TLC was the best parameter for differentiating large cell lymphoma from indolent small B-cell lymphoma. CONCLUSION TLC differentiated large cell lymphoma from indolent small B-cell lymphoma better than either p53 or PCNA alone or in combination. Significant overlap between categories limits usefulness of these immunocytochemical stains for differentiating these entities.
Association of Antioxidant Supplement Use and Dementia in the Prevention of Alzheimer’s Disease by Vitamin E and Selenium Trial (PREADViSE)

Importance Oxidative stress is an established dementia pathway, but it is unknown if the use of antioxidant supplements can prevent dementia. Objective To determine if antioxidant supplements (vitamin E or selenium) used alone or in combination can prevent dementia in asymptomatic older men. Design, Setting, and Participants The Prevention of Alzheimer’s Disease by Vitamin E and Selenium (PREADViSE) trial began as a double-blind randomized clinical trial in May 2002, which transformed into a cohort study from September 2009 to May 2015. The PREADViSE trial was ancillary to the Selenium and Vitamin E Cancer Prevention Trial (SELECT), a randomized clinical trial of the same antioxidant supplements for preventing prostate cancer, which closed in 2009 owing to findings from a futility analysis. The PREADViSE trial recruited 7540 men, of whom 3786 continued into the cohort study. Participants were at least 60 years old at study entry and were enrolled at 130 SELECT sites, and Cox proportional hazards models were used in a modified intent-to-treat analysis to compare hazard rates among the study arms. Interventions Participants were randomized to vitamin E, selenium, vitamin E and selenium, or placebo. While taking study supplements, enrolled men visited their SELECT site and were evaluated for dementia using a 2-stage screen. During the cohort study, men were contacted by telephone and assessed using an enhanced 2-stage cognitive screen. In both phases, men were encouraged to visit their physician if the screen results indicated possible cognitive impairment. Main Outcomes and Measures Dementia case ascertainment relied on a consensus review of the cognitive screens and medical records for men with suspected dementia who visited their physician for an evaluation or by review of all available information, including a functional assessment screen. Results The mean (SD) baseline age of the 7540 participants was 67.5 (5.3) years, with 3936 (52.2%) reporting a college education or better, 754 (10.0%) reporting black race, and 505 (6.7%) reporting Hispanic ethnicity. Dementia incidence (325 of 7338 men [4.4%]) was not different among the 4 study arms. A Cox model, which adjusted incidence for participant demographic information and baseline self-reported comorbidities, yielded hazard ratios of 0.88 (95% CI, 0.64-1.20) for vitamin E, 0.83 (0.60-1.13) for selenium, and 1.00 (0.75-1.35) for the combination compared with placebo. Conclusions and Relevance Neither supplement prevented dementia. To our knowledge, this is the first study to investigate the long-term association of antioxidant supplement use and dementia incidence among asymptomatic men.
Responses of phenology and biomass production of boreal fens to climate warming under different water‐table level regimes

Climate change affects peatlands directly through increased air temperatures and indirectly through changes in water‐table level (WL). The interactions of these two still remain poorly known. We determined experimentally the separate and interactive effects of temperature and WL regime on factors of relevance for the inputs to the carbon cycle: plant community composition, phenology, biomass production, and shoot:root allocation in two wet boreal sedge‐dominated fens, “southern” at 62°N and “northern” at 68°Ν. Warming (1.5°C higher average daily air temperature) was induced with open‐top chambers and WL drawdown (WLD; 3–7 cm on average) by shallow ditches. Total biomass production varied from 250 to 520 g/m2, with belowground production comprising 25%–63%. Warming was associated with minor effects on phenology and negligible effects on community composition, biomass production, and allocation. WLD clearly affected the contribution of different plant functional types (PFTs) in the community and the biomass they produced: shrubs benefited while forbs and mosses suffered. These responses did not depend on the warming treatment. Following WLD, aboveground biomass production decreased mainly due to reduced growth of mosses in the southern fen. Aboveground vascular plant biomass production remained unchanged but the contribution of different PFTs changed. The observed changes were also reflected in plant phenology, with different PFTs showing different responses. Belowground production increased following WLD in the northern fen only, but an increase in the contributions of shrubs and forbs was observed in both sites, while sedge contribution decreased. Moderate warming alone seems not able to drive significant changes in plant productivity or community composition in these wet ecosystems. However, if warming is accompanied by even modest WL drawdown, changes should be expected in the relative contribution of PFTs, which could lead to profound changes in the function of fens. Consequently, hydrological scenarios are of utmost importance when estimating their future function.
New challenges in therapeutic vaccines against HIV infection

ABSTRACT Introduction: There is a growing interest in developing curative strategies for HIV infection. Therapeutic vaccines are one of the most promising approaches. We will review the current knowledge and the new challenges in this research field. Areas covered: PubMed and ClinicalTrial.gov databases were searched to review the progress and prospects for clinical development of immunotherapies aimed to cure HIV infection. Dendritic cells (DC)-based vaccines have yielded the best results in the field. However, major immune-virologic barriers may hamper current vaccine strategies. We will focus on some new challenges as the antigen presentation by DCs, CTL escape mutations, B cell follicle sanctuary, host immune environment (inflammation, immune activation, tolerance), latent reservoir and the lack of surrogate markers of response. Finally, we will review the rationale for designing new therapeutic vaccine candidates to be used alone or in combination with other strategies to improve their effectiveness. Expert commentary: In the next future, the combination of DCs targeting candidates, inserts to redirect responses to unmutated parts of the virus, adjuvants to redirect responses to sanctuaries or improve the balance between activation/tolerance (IL-15, anti-PD1 antibodies) and latency reversing agents could be necessary to finally achieve the remission of HIV-1 infection.
Why artificial light at night should be a focus for global change research in the 21st century

The environmental impacts of artificial light at night have been a rapidly growing field of global change science in recent years. Yet, light pollution has not achieved parity with other global change phenomena in the level of concern and interest it receives from the scientific community, government and nongovernmental organizations. This is despite the globally widespread, expanding and changing nature of night‐time lighting and the immediacy, severity and phylogenetic breath of its impacts. In this opinion piece, we evidence 10 reasons why artificial light at night should be a focus for global change research in the 21st century. Our reasons extend beyond those concerned principally with the environment, to also include impacts on human health, culture and biodiversity conservation more generally. We conclude that the growing use of night‐time lighting will continue to raise numerous ecological, human health and cultural issues, but that opportunities exist to mitigate its impacts by combining novel technologies with sound scientific evidence. The potential gains from appropriate management extend far beyond those for the environment, indeed it may play a key role in transitioning towards a more sustainable society.
Real-Time Location-Based Rendering of Urban Underground Pipelines

The concealment and complex spatial relationships of urban underground pipelines present challenges in managing them. Recently, augmented reality (AR) has been a hot topic around the world, because it can enhance our perception of reality by overlaying information about the environment and its objects onto the real world. Using AR, underground pipelines can be displayed accurately, intuitively, and in real time. We analyzed the characteristics of AR and their application in underground pipeline management. We mainly focused on the AR pipeline rendering procedure based on the BeiDou Navigation Satellite System (BDS) and simultaneous localization and mapping (SLAM) technology. First, in aiming to improve the spatial accuracy of pipeline rendering, we used differential corrections received from the Ground-Based Augmentation System to compute the precise coordinates of users in real time, which helped us accurately retrieve and draw pipelines near the users, and by scene recognition the accuracy can be further improved. Second, in terms of pipeline rendering, we used Visual-Inertial Odometry (VIO) to track the rendered objects and made some improvements to visual effects, which can provide steady dynamic tracking of pipelines even in relatively markerless environments and outdoors. Finally, we used the occlusion method based on real-time 3D reconstruction to realistically express the immersion effect of underground pipelines. We compared our methods to the existing methods and concluded that the method proposed in this research improves the spatial accuracy of pipeline rendering and the portability of the equipment. Moreover, the updating of our rendering procedure corresponded with the moving of the user’s location, thus we achieved a dynamic rendering of pipelines in the real environment.