Miracle-dz/UniFAR-FTUs huggingface dataset:
Efficient and Noise-Tolerant Reinforcement Learning Algorithms via Theoretical Analysis of Gap-Increasing and Softmax Operators

E cient and Noise-Tolerant Reinforcement Learning Algorithms via Theoretical Analysis of Gap-Increasing and Softmax Operators Model-free deep Reinforcement Learning (RL) algorithms, a combination of deep learning and model-free RL algorithms, have attained remarkable successes in solving complex tasks such as video games. However, theoretical analyses and recent empirical results indicate its proneness to various types of value update errors including but not limited to estimation error of updates due to nite samples and function approximation error. Because real-world tasks are inherently complex and stochastic, such errors are inevitable, and thus, the development of error-tolerant RL algorithms are of great importance for applications of RL to real problems. To this end, I propose two error-tolerant algorithms for RL called Conservative Value Iteration (CVI) and Gap-increasing RetrAce for Policy Evaluation (GRAPE). CVI uni es value-iteration-like single-stage-lookahead algorithms such as soft value iteration, advantage learning and Ψ-learning, all of which are characterized by the use of a gap-increasing operator and/or softmax operator in value updates. We provide detailed theoretical analysis of CVI that not only shows CVI's advantages but also contributes to the theory of RL in the following two points: First, it elucidates pros and cons of gap-increasing and softmax operators. Second, it provides an actual example in which performance of algorithms with max operator is worse than that of algorithms with softmax operator demonstrating the limitation of traditional greedy value updates. GRAPE is a policy evaluation algorithm extending advantage learning (AL) and retrace, both of which have di erent advantages: AL is noise-tolerant as shown through our theoretical analysis of CVI, while retrace is e cient in that it is o -policy and allows the control of bias-variance trade-o . Theoretical analysis of GRAPE shows that it enjoys the merits of both algorithms. In experiments, we demonstrate the bene t of GRAPE combined with a variant of trust region policy optimization and its superiority to previous algorithms. Through these studies, I theoretically elucidated the bene ts of gap-increasing and softmax operators in both policy evaluation and control settings. While some open problems remain as explained in the nal chapter, the results presented in this thesis are an important step towards a deep understanding of RL algorithms.
Utility of 7 Tesla Magnetic Resonance Imaging in Patients With Epilepsy: A Systematic Review and Meta-Analysis

Objective: 7 Tesla magnetic resonance imaging (MRI) enables high resolution imaging and potentially improves the detection of morphologic abnormalities in patients with epilepsy. However, its added value compared with conventional 1.5T and 3.0T MRI is unclear. We reviewed the evidence for the use of 7 Tesla MRI in patients with epilepsy and compared the detection rate of focal lesions with clinical MRI. Methods: Clinical retrospective case studies were identified using the indexed text terms “epilepsy” AND “magnetic resonance imaging” OR “MR imaging” AND “7T” OR “7 Tesla” OR “7T” in Medline (2002-September 1, 2020) and Embase (1999-September 1, 2020). The study setting, MRI protocols, qualitative, and quantitative assessment were systematically reviewed. The detection rate of morphologic abnormalities on MRI was reported in each study in which surgery was used as the reference standard. Meta-analyses were performed using a univariate random-effects model in diagnostic performance studies with patients that underwent both 7T MRI and conventional MRI. Results: Twenty-five articles were included (467 patients and 167 healthy controls) consisting of 10 case studies, 10 case-control studies, 4 case series, and 1 cohort study. All studies included focal epilepsy; 12 studies (12/25, 48%) specified the disease etiology and 4 studies reported focal but non-lesional (MRI-negative on 1.5/3.0T) epilepsy. 7T MRI showed superior detection and delineation of morphologic abnormalities in all studies. In nine comparative studies, 7T MRI had a superior detection rate of 65% compared with the 22% detection rate of 1.5T or 3.0T. Significance: 7T MRI is useful for delineating morphologic abnormalities with a higher detection rate compared with conventional clinical MRI. Most studies were conducted using a case series or case study; therefore, a cohort study design with clinical outcomes is necessary. Classification of Evidence: Class IV Criteria for Rating Diagnostic Accuracy Studies.
Spatio-temporal variations of fluorescence properties of dissolved organic matter along the River Têt (Pyrénées-Orientales, France)

Fluorescence excitation-emission matrices showed the spectral signature of dissolved organic matter (DOM) downstream in the River Têt at all seasons corresponding to humic substances with maximum fluorescence emission λem=420–460 nm for excitations of λex=340–360 nm and the occasional presence of tryptophan, tracer of anthropogenic pressure, spectroscopically identified by λex/λem=310/350 nm. A factorial discriminant analysis, performed using the parameters selected (λex/λem pairs of wavelength), succeeded in a better discrimination of seasons than stations, and clearly showed the presence of two fluorophores. Fluorophore 1, with two absorption bands: λex=260–320 nm and 330–390 nm for λem=440–500 nm, and Fluorophore 2, with one absorption band: λex=300–360 nm for λem=410 nm, which are attributed to humic acid (HA) and fulvic acid (FA), respectively. Variations of DOM relative contents downstream in the River Têt, according to seasons and stations, showed high amounts of DOM (pedogenic character) along the river in the humid period, with the highest value obtained in the mountain section. In contrast, in summer, the DOM contents were low (aquagenic character). Moreover, DOM presents a relatively constant composition with a percentage of FA ranging from 40% at the mountain station to 48% at the mouth river, whatever the season.
Optimization of Transesterification Parameters of Melon Seed Oil

Melon seed oil was successfully converted into biodiesel fuels via alkali catalyzed transesterification. Transesterification parameters such as base concentration, methanol to oil molar ratio, reaction time, reaction temperature, catalyst type, and step multiplicity were investigated. The results indicated that (0.75% KOH w/w of oil, a 6: 1 methanol to oil molar ratio, reaction temperature of 60°C, and a duration of 1 h) where the optimal experimental conditions for the transesterification. The Fourier transform infra red spectra of the biodiesel was also specified and found differs greatly from that of the parent oil confirming the formation of biodiesel. Properties of the produced fuels were determined and found enhanced compared to those of the parent oil. Besides, the optimal biodiesel sample was blended with petro diesel in various volume percentages. However, the results showed that biodiesel had slight influence on the original properties of petro diesel.
Discipline in Stages: Regulating CD8+ Resident Memory T Cells

Resident memory CD8+ T (TRM) cells are a lymphocyte lineage distinct from circulating memory CD8+ T cells. TRM lodge within peripheral tissues and secondary lymphoid organs where they provide rapid, local protection from pathogens and control tumor growth. However, dysregulation of CD8+ TRM formation and/or activation may contribute to the pathogenesis of autoimmune diseases. Intrinsic mechanisms, including transcriptional networks and inhibitory checkpoint receptors control TRM differentiation and response. Additionally, extrinsic stimuli such as cytokines, cognate antigen, fatty acids, and damage signals regulate TRM formation, maintenance, and expansion. In this review, we will summarize knowledge of CD8+ TRM generation and highlight mechanisms that regulate the persistence and responses of heterogeneous TRM populations in different tissues and distinct microenvironments.
An Introduction to Heat Transfer

The importance of heat transfer in food processing is obvious; the changes in food safety and palatability on heating are so marked that many food processes are built around heat transfer. The physical principles which underlie these processes are introduced here. Two modes of heat transfer are discussed: thermal conduction through a stationary medium, and thermal convection through a moving fluid. In the latter case, mixing of hot and cold fluids is the main mechanism of heat transfer, which is usually more rapid than thermal conduction.
Equation‐of‐state data for molecular hydrogen and deuterium at shock pressures in the range 2–76 GPa (20–760 kbar)a)

Dynamic equation‐of‐state data for D2 and H2 were measured in the pressure range 2–76 GPa (20–760 kbar) using a two‐state light‐gas gun. Liquid specimens were shocked from initial states near the saturation curve at 20 K. Maximum compression was sixfold over initial liquid density at a calculated temperature of 7000 K for D2. The data is discussed in terms of the theory of Ross et al., which includes an effective intermolecular pair potential, molecular vibration, free molecular rotation, and molecular dissociation.
Sulfonation and sulfation on reaction of 1,4‐dihydroxybenzene and its methyl ethers in concentrated sulfuric acid

The homogeneous reactions of 1,4-dihydroxybenzene (1), its monomethyl (2) and dimethyl ether (3) and 2-3-sulfonic acid in 68-105% H2SO4 at 25°C have been studied and isomer distributions and rate coefficients for the various subsequent sulfonations, as well as the equilibrium data for the sulfation (-OH⇌ -OSO3H), are reported. For 2, the ratio of 2- to 3-sulfonation decreases upon increasing the sulfuric acid concentration from 68-98.5% H2SO4, due to a gradual change-over in the effective sulfonating entity from H3SO4+ to H2S2O7. For 1-2-sulfonic acid (1-2-S), 2-2-S and 2-3-S, the ratios of 5- to 6-sulfonation are all ca. 25:75, whereas 3-2-S only yields the 5-sulfonic acid. Demethylation of the sulfonic acids of 2 and 3 in ≤98.5% H2SO4 is of minor importance, but plays a major role in 105.0% H2SO4, the eventual products being the bis(hydrogen sulfate)s 10 and 15, the tricyclic bis(sulfate sulfonate anhydride) 11 and the bicyclic hydrogen sulfate 16. Mechanisms for the sulfodemethylation and for the cyclization of the 2-sulfophenyl hydrogen sulfate moiety to the 1,3,2,4-benzodioxadithiin 2,2,4,4-tetraoxide system are proposed.
Distribution model for properties of hydrocarbon-plus fractions

A versatile equation is used to describe the cumulative weight, mole, or volume fraction (x) with various properties (P) of petroleum fractions (eq 1), with P* = (P {minus} P{sub 0})/P{sub 0}, where P denotes the boiling point (T{sub b}), specific gravity (S), refractive index parameter (I), or molecular weight (M). For a given property, the value of B is approximately constant for most crude oil and gas condensate samples: T{sub b}(B{sub t}{approx}1.5), S(B{sub s}{approx}3), I(B{sub I}{approx}3), and M(B{sub M}{approx}1). Therefore, only two unknowns must be determined for a given property distribution: A and P{sub o}. The fitting procedure is straightforward and can be performed with linear regression of the form Y = C{sub 1} + C{sub 2}X where Y = In P* and X = In In (1/(1 {minus} x)). The proposed procedure has been tested on more than 80 crude oil and condensate samples from around the world. Once the fit has been made, the eq 1 can be applied as a continuous distribution in terms of a probability density function.
Electrokinetic Separation of Heavy Metals from Wastewater Treatment Sludge

In the study, a preliminary experiment on the removal of heavy metals from industrial wastewater sludge was carried out to evaluate the feasibility of electrokinetic separation. Four different types of processing fluid—tap water, ethylenediaminetetraacetic acid (EDTA), citric acid (CA), and 0.1 M nitric acid—were tested. EDTA was found to be the most effective agent within the set of chemicals tested for removing heavy metals from sludge because of its strong chelating ability with metals. The removal efficiency of Pb and Cu was higher than that of Zn and Ni for all fluids. In tap water, EDTA, and CA, the metals moved toward the anode, implying that they existed as complexes with EDTA and CA or organic matter in the processing fluid. In nitric acid, the metals moved toward the cathode because nitric acid effectively desorbed the metal from the sludge; however, the removal efficiency was very low. The results indicated that electrokinetic technology effectively separated Cu and Pb, but not Zn and Ni.
Ultrasonic Wave Propagation in Californium Monopnictides

In this paper, we have investigated the temperature dependence of the ultrasonic parameters like ultrasonic velocities and Gruneisen parameters in californium monopnictides CfY (Y: N, As and Sb) for longitudinal and shear waves along , and crystallographic directions in the temperature range 100–500K. For the same evaluation the second- and third- order elastic constants have also been computed for these monopnictides using Coulomb and Born-Mayer potential upto second nearest neighborhood. The mechanical properties and stability of CfN is best, because of its high valued elastic constants. Ultrasonic velocity is found to be highest for CfAs along all chosen directions, so CfAs will be most suitable compound for wave propagation. The obtained results of present investigation are discussed in along with identified thermophysical properties.
CHITIN AND CHITOSAN FOR VERSATILE APPLICATIONS

ABSTRACT Chitin and chitosan are versatile polymers, where the interest in chitosan is due to the large variety of useful forms that are commercially available or can be made available. Chitin basically is obtained from prawn/crab shells; chemical treatment of chitin produces chitosan. This article surveys applications of chitin and chitosan in various industrial and biomedical fields.
Low-barrier hydrogen bonds in proteins

Hydrogen bonding interactions are one of the most important chemical interactions among materials, especially biological materials, which help confer specificity, which is crucial for their efficient functioning. Recently, low-barrier hydrogen bonds (LBHBs) have been proposed to play a critical role in enzyme catalysis. In this review, tools to identify LBHBs are described, along with analyses of neutron crystal structures of small molecules to identify geometric parameters characteristic of LBHBs, which are assumed to be characterized by dynamic disorder along the hydrogen bond (H-bond) of the bonding hydrogen atom. The analysis of protein structures determined by neutron diffraction indicates that LBHBs are found to occur in both active site and non-active site regions of a protein. Moreover, very short H-bonds are observed in the vicinity of folding cores identified through nuclear magnetic resonance studies on two proteins, SUMO-1 and HIV-1 protease. This observation suggests that LBHBs may also be important in the context of folding of proteins.
Time-resolved fluorescence spectroscopy of tetrasulfonated aluminum phthalocyanine in solution and cells

Tetrasulphonated aluminum phthalocyanine (AlPcS4) is one of the extensively studied second generation sensitizers for photodynamic therapy of cancer. We've applied picosecond fluorescence spectroscopy to study the fluorescence decay lifetimes of AlPcS4 in phosphate buffer at different pH values and in monolayers of cultured cells incubated in photosensitizer solution. The decay time for the cells in the buffer is closer to the one obtained for acidic aqueous solution indicating that at least part of the phthalocyanine could be found in the acidic microenvironment (lysosomes, etc.).
Self-Efficacy of Early Career Agriculture Teachers and Its Relationship to Career Commitment and Job Satisfaction

2 Acknowledgments. 2 List of Tables . 4 List of Abbreviations . 5 Chapter 1: INTRODUCTION. 8 Chapter 2: LITERATURE REVIEW. 14 Chapter 3: METHODOLOGY . 44 Chapter 4: FINDINGS . 51 Chapter 5: CONCLUSIONS, IMPLICATIONS, AND RECOMMENDATIONS . 74 References . 85 Appendix 1: IRB Approval Documentation . 107 Appendix 2: E-Mail Invitation for Online Survey . 113 Appendix 3: IRB Approved Information Letter . 114 Appendix 4: Research Instrument . 116
Catalytic oxidation of CO on Pt(335): A study of the active site

The catalytic reaction CO(a)+O(a)→CO2(g) has been studied on Pt(335) using infrared reflection absorption spectroscopy (IRAS) and temperature programmed reaction (TPR) methods. Both dissociative O2 adsorption and CO adsorption occur preferentially on the step sites. It has been found that chemisorbed CO on the (111) terrace sites is more reactive than chemisorbed CO on the (100) step sites. In contrast, chemisorbed O on the step sites is more reactive at high CO coverages than chemisorbed O on the terrace sites. The results indicate that at high CO coverages the most reactive geometry involves step site O[O(S)] interacting with terrace sites CO [CO(T)]. This new information provides a conceptual basis for understanding the interplay between geometrical and energetic factors influencing the CO oxidation reaction.
Why has the equal weight portfolio underperformed and what can we do about it?

It is widely noted that market capitalisation weighted portfolios are inefficient and underperform an equal weighted portfolio over the long-term. However, at least since 2016, an equal weighted portfolio of stocks in the S&P500 has significantly underperformed the market capitalisation weighted portfolio. In this paper, we analyse this underperformance using stochastic portfolio theory. We show that the equal weighted portfolio does appear to outperform the market capitalisation weighted portfolio over the long-term but with periods of significant short-term underperformance. In addition, we find that concentration in the market capitalisation weighted portfolio has increased in recent years and has contributed to the recent underperformance together with a significantly lower level of diversification benefits. Furthermore, we highlight an approach to improve the performance of a portfolio by dynamically selecting a market cap or an equal weighting using a rudimentary linear regression model.
On the interplay of gas dynamics and the electromagnetic field in an atmospheric Ar/H2 microwave plasma torch

A complementary simulation and experimental study of an atmospheric pressure microwave torch operating in pure argon or argon/hydrogen mixtures is presented. The modelling part describes a numerical model coupling the gas dynamics and mixing to the electromagnetic field simulations. Since the numerical model is not fully self-consistent and requires the electron density as an input, quite extensive spatially resolved Stark broadening measurements were performed for various gas compositions and input powers. In addition, the experimental part includes Rayleigh scattering measurements, which are used for the validation of the model. The paper comments on the changes in the gas temperature and hydrogen dissociation with the gas composition and input power, showing in particular that the dependence on the gas composition is relatively strong and non-monotonic. In addition, the work provides interesting insight into the plasma sustainment mechanism by showing that the power absorption profile in the plasma has two distinct maxima: one at the nozzle tip and one further upstream.
Heat and Moisture Transfer Model for Onion Drying

Abstract Onion slices of 3 mm thick were dried in an atmospheric batch tray dryer in order to investigate the influence of air temperature and drying time on parameters such as sample moisture content and drying rate. A model is proposed which takes into account both moisture and temperature distributions in the sample and is in a fair agreement with the experimental data. The models suggested so far by other workers take only the moisture distributions into account for onion drying.
Integrated Fault Detection and Fault-Tolerant Control Architectures for Distributed Processes

This paper presents an integrated fault detection (FD) and fault-tolerant control (FTC) architecture for spatially distributed processes described by quasi-linear parabolic partial differential equations (PDEs) with control constraints and control actuator faults. Under full state feedback conditions, the architecture integrates model-based fault detection, spatially distributed feedback, and supervisory control to orchestrate switching between different actuator configurations in the event of faults. The various components are designed on the basis of appropriate reduced-order models that capture the dominant dynamics of the distributed process. The fault detection filter replicates the dynamics of the fault-free reduced-order model and uses its behavioral discrepancy from that of the actual system as a residual for fault detection. Owing to the inherent approximation errors in the reduced-order model, appropriate fault detection and control reconfiguration criteria are derived for the implementation of .
Time‐Dependent Morphology Evolution by Annealing Processes on Polymer:Fullerene Blend Solar Cells

Changes in the nanoscale morphologies of the blend films of poly (3‐hexylthiophene) (P3HT) and [6,6]‐phenyl‐C61‐butyric acid methyl ester (PCBM), for high‐performance bulk‐heterojunction (BHJ) solar cells, are compared and investigated for two annealing treatments with different morphology evolution time scales, having special consideration for the diffusion and aggregation of PCBM molecules. An annealing condition with relatively fast diffusion and aggregation of the PCBM molecules during P3HT crystallization results in poor BHJ morphology because of prevention of the formation of the more elongated P3HT crystals. However, an annealing condition, accelerating PCBM diffusion after the formation of a well‐ordered morphology, results in a relatively stable morphology with less destruction of crystalline P3HT. Based on these results, an effective strategy for determining an optimized annealing treatment is suggested that considers the effect of relative kinetics on the crystallization of the components for a blend film with a new BHJ materials pair, upon which BHJ solar cells are based.
Improved mathematical model for a falling film sulfonation reactor

Le modele s'applique a tout procede ou le transfert de matiere liquide ou gazeux ainsi que la vitesse de reaction affectent la vitesse du procede. Le modele permet de determiner les profils de temperature (radiaux, longitudinaux.) dans le reacteur. Une etude experimentale est effectuee pour la reaction de sulfatation du dodecylbenzene en acide dodecylbenzenesulfonique dans un reacteur ayant differentes longueurs