gebhart/patrepeval huggingface dataset:
Residual Q-Learning: Offline and Online Policy Customization without Value (2023)

Imitation Learning (IL) is a widely used framework for learning imitative behavior from demonstrations. It is especially appealing for solving complex real-world tasks where handcrafting reward function is difficult, or when the goal is to mimic human expert behavior. However, the learned imitative policy can only follow the behavior in the demonstration. When applying the imitative policy, we may need to customize the policy behavior to meet different requirements coming from diverse downstream tasks. Meanwhile, we still want the customized policy to maintain its imitative nature. To this end, we formulate a new problem setting called policy customization. It defines the learning task as training a policy that inherits the characteristics of the prior policy while satisfying some additional requirements imposed by a target downstream task. We propose a novel and principled approach to interpret and determine the trade-off between the two task objectives. Specifically, we formulate the customization problem as a Markov Decision Process (MDP) with a reward function that combines 1) the inherent reward of the demonstration; and 2) the add-on reward specified by the downstream task. We propose a novel framework, Residual Q-learning, which can solve the formulated MDP by leveraging the prior policy without knowing the inherent reward or value function of the prior policy. We derive a family of residual Q-learning algorithms that can realize offline and online policy customization, and show that the proposed algorithms can effectively accomplish policy customization tasks in various environments. Demo videos and code are available on our website: https://sites.google.com/view/residualq-learning.
Study on Phase Diagram of Ca<sub>3</sub>NbGa<sub>3</sub>Si<sub>2</sub>O<sub>14</sub> Piezoelectric Material by Differential Thermal Analysis and X-Ray Diffraction Measurement (2012)

Ca 3 NbGa 3 Si 2 O 14 (CNGS) Is One of the Langasite-Type Crystals and it Is Known as a Piezoelectric Material. We Have Successfully Grown the Shaped CNGS Crystal Using Micro-Pulling-down (μ-PD) Method with Shape Control. However, the Impurity Phases such as Ca-Nb-O Related Compounds Were Detected in the Grown Crystals. The Creation of the Impurity Phases Is Related to Difference in Stoichiometric and Congruent Compositions. Therefore, the Detailed Investigation of Phase Diagram on CNGS Was Carried Out to Prevent the Impurity Phases Creation. It Follows from the TG-DTA Measurements that the Melting Point Systematically Changed with the Ca/Ga Ratio in the Ca 3-x NbGa 3+x Si 2 O 14±δ Cmpositions. The CNGS Phase with Ca/Ga = 1.02 Indicated the Maximum Melting Point which Suggests that the Stoichiometric Composition of CNGS Is Different in the Congruent Composition. Furthermore, in the DTA Measurements the Peaks of Impurity Phases Were Detected around 1550 °C for the CNGS Sample with Ca/Ga = 1.02.
Superiorized Adaptive Projected Subgradient Method with Application to MIMO Detection (2022)

In this paper, we show that the adaptive projected subgradient method (APSM) is bounded perturbation resilient. To illustrate a potential application of this result, we propose a set-theoretic framework for MIMO detection, and we devise algorithms based on a superiorized APSM. Various low-complexity MIMO detection algorithms achieve excellent performance on i.i.d. Gaussian channels, but they typically incur high performance loss if realistic channel models (e.g., correlated channels) are considered. Compared to existing low-complexity iterative detectors such as individually optimal large-MIMO approximate message passing (IO-LAMA), the proposed algorithms can achieve considerably lower symbol error ratios over correlated channels. At the same time, the proposed methods do not require matrix inverses, and their complexity is similar to IO-LAMA.
Genomic profiling of Richter's syndrome: recurrent lesions and differences with de novo diffuse large B‐cell lymphomas (2009)

Richter's syndrome (RS) represents the transformation of chronic lymphocytic leukaemia (CLL) to aggressive lymphoma and is mostly represented by diffuse large B-cell lymphoma (DLBCL), with a post-germinal centre (GC) phenotype, clonally related to the pre-existing CLL. RS has a very poor prognosis and its pathogenetic mechanisms are poorly understood. In order to gain additional hints in RS pathogenesis, we performed a genome-wide DNA profiling study of 13 RS phases and eight matched CLL phases using the Affymetrix Human Mapping 250K NspI SNP arrays. Individual genomic profiles were heterogeneous, with no individual lesions occurring in more than half of the cases. However, several observations suggest that MYC pathway might be involved in RS. The 13q13.3-qter region containing MIRHG1 (MIR-17-92), a cluster of microRNA interacting with c-MYC, was acquired at the time of transformation. The 13q gain was coupled with the gain of c-MYC and loss of TP53. Translocation of c-MYC was acquired at transformation in a fraction of cases and this event appeared mutually exclusive with gain of MIRHG1. MYCN, a c-MYC homologue, was also recurrently gained. By comparing RS with 48 de novo DLBCL, RS presented a significantly lower prevalence of deletions affecting the PRDM1 and TNFAIP3, genes on 6q, known to be associated with a post-GC phenotype. In conclusion, the genomic profile of RS seems to differ from what observed in de novo DLBCL and in other transformed DLBCL. Genomic lesions occurring in RS are heterogeneous suggesting the existence of different RS subsets, possibly due to different transforming mechanisms. A deregulation of MYC pathway might represent one of the main transformation events in the pathogenesis of a subset of RS clonally related to the previous CLL.
Clinical Trials with Oncolytic Measles Virus: Current Status and Future Prospects (2017)

Attenuated Edmonston lineage measles virus (MV-Edm) vaccine strains can preferentially infect and lyse a wide variety of cancer cells. Oncolytic MV-Edm derivatives are genetically engineered to express the human carcinoembryonic antigen (MV-CEA virus) or the human sodium iodide symporter (MV-NIS virus) and are currently being tested in clinical trials against ovarian cancer, glioblastoma multiforme, multiple myeloma, mesothelioma, head and neck cancer, breast cancer and malignant peripheral nerve sheath tumors. This review describes the basic and preclinical data that facilitated the clinical translation of MV-Edm strains, and summarizes the clinical results of this oncolytic platform to date. Furthermore, we discuss the latest clinically relevant MV-Edm vector developments and creative strategies for future translational steps.
Biological materials studied with dynamic force microscopy (1994)

Biological materials such as hexagonal packed intermediate (HPI) layers, DNA, tobacco mosaic virus and collagen deposited on various substrates with noncontact dynamic force microscopy under ambient conditions were investigated. This method is highly suited for the investigation of soft organic matter where a minimized interaction between tip and sample is needed for nondestructive and reliable operation. Hence, additional anchoring of the biological specimens was no longer found to be crucial. The vertical and lateral resolution limits of this gentle method were determined to be &amp;lt;0.1 nm and 1–2 nm, respectively, allowing very stable and high resolution results on all investigated systems. By taking approach curves and monitoring the dynamic properties of the cantilever (resonance frequency and Q value) during the experiment, the interaction mechanism between tip and sample was found to be dominated by attractive van der Waals interaction and capillary forces. Furthermore, initial results from a HPI layer imaged with noncontact dynamic force microscopy in a water environment are presented.
Measurements of ${}^3_\Lambda \rm{H}$ and ${}^4_\Lambda \rm{H}$ Lifetimes and Yields in Au+Au Collisions in the High Baryon Density Region. (2021)

We report precision measurements of hypernuclei ${}^3_\Lambda \rm{H}$ and ${}^4_\Lambda \rm{H}$ lifetimes obtained from Au+Au collisions at \snn = 3.0\,GeV and 7.2\,GeV collected by the STAR experiment at RHIC, and the first measurement of ${}^3_\Lambda \rm{H}$ and ${}^4_\Lambda \rm{H}$ mid-rapidity yields in Au+Au collisions at \snn = 3.0\,GeV. The lifetimes are measured to be $221\pm15(\rm stat.)\pm19(\rm syst.)$\,ps for ${}^3_\Lambda \rm{H}$ and $218\pm6(\rm stat.)\pm13(\rm syst.)$\,ps for ${}^4_\Lambda \rm{H}$. The $p_T$-integrated yields of ${}^3_\Lambda \rm{H}$ and ${}^4_\Lambda \rm{H}$ are presented in different centrality and rapidity intervals. It is observed that the shape of the rapidity distribution of ${}^4_\Lambda \rm{H}$ is different for 0--10\% and 10--50\% centrality collisions. Thermal model calculations, using the canonical ensemble for strangeness, describes the ${}^3_\Lambda \rm{H}$ yield well, while underestimating the ${}^4_\Lambda \rm{H}$ yield. Transport models, combining baryonic mean-field and coalescence (JAM) or utilizing dynamical cluster formation via baryonic interactions (PHQMD) for light nuclei and hypernuclei production, approximately describe the measured ${}^3_\Lambda \rm{H}$ and ${}^4_\Lambda \rm{H}$ yields.
Multi-Antenna Testbeds for Wireless Communications (2018)

This chapter provides insight into the development process of wireless communications testbeds, starting with the classification of testbeds to deployment and field measurements with them. The research goal itself may range from plain Bit Error Rate measurements to entire networking experiments, other parameters such as desired throughput, form factor, configurability, testbed mobility, development time, and cost are equally relevant. The performance loss, often called implementation loss, is usually a result of hardware imperfections, but can also be relates to implementation issues such as fixed–point processing at baseband. The metrics measure the quality of the wireless channel to sustain multiple-input-multiple-output communications, and others measure the performance of the communication system. The chapter focuses on a series of experiments whose goal is to evaluate the impact of antenna separation on code performance for each of these lines of work. The two types of signaling are considers: multiplexing type schemes and space–time codes designes to harvest diversity or performance.
Population Pharmacokinetics and Exposure‐Response Modeling of Daratumumab Subcutaneous Administration in Patients With Light‐Chain Amyloidosis (2021)

The purpose of this study is to characterize the population pharmacokinetics (popPK) of subcutaneous (SC) daratumumab in combination with bortezomib, cyclophosphamide, and dexamethasone and explore the relationship between daratumumab systemic exposure and selected efficacy and safety end points in patients with newly diagnosed systemic amyloid light-chain amyloidosis. The popPK analysis included pharmacokinetic and immunogenicity data from patients receiving daratumumab SC in combination with bortezomib, cyclophosphamide, and dexamethasone in the ANDROMEDA study (AMY3001; safety run-in, n = 28; randomized phase, n = 183). Nonlinear mixed-effects modeling was used to characterize the popPK and quantify the impact of potential covariates. The exposure-response (E-R) analysis included data from all patients in the randomized phase of ANDROMEDA (n = 388). Logistic regression and survival analysis were used to evaluate the relationships between daratumumab systemic exposure and efficacy end points. The E-R analysis on safety was conducted using quartile comparison and logistic regression analysis. The observed concentration-time data of daratumumab SC were well described by a 1-compartment popPK model with first-order absorption and parallel linear and nonlinear Michaelis-Menten elimination pathways. None of the investigated covariates were determined to be clinically meaningful. Daratumumab systemic exposure was generally similar across subgroups that achieved different levels of hematologic response, and there was no apparent relationship between daratumumab systemic exposure and the investigated safety end points. In conclusion, the popPK and E-R analyses supported the selected 1800-mg flat dose of daratumumab SC in combination with the bortezomib, cyclophosphamide, and dexamethasone regimen for the treatment of light-chain amyloidosis. No dose adjustment was recommended for investigated covariates.
Identification and functional characterization of a novel cationic amino acid transporter CAT5 specifically expressed in placenta (2006)

We identified a novel Na + ‐independent cationic amino cid transporter (CAT) with distinct characteristics in substrate selectivity and transport property. The encoded protein designated CAT5 that belongs to SLC7 family shows highest amino acid sequence similarity to the CAT3 with 59% identity. When expressed in Xenopus oocytes, CAT5 transported cationic amino acids (CAA) at high affinity, consistent with the properties of system y + . We found that an artificial CAA (H‐L‐Dab‐OH) was the shortest chain CAA recognized by CAT5. CAT5 showed particularly high affinity to arginine (km=2.7 microM). Distinct from already known system y + isoforms, CAT5 also mediate Na + ‐ independent transport of large neutral amino acids (NAA) at low affinity. CAT5‐mediated [ 14 C]arginine uptake was also inhibited by large NAA and the artificial NAA (H‐Nva‐OH and H‐Nle‐OH). NAA uptake but not CAA uptake was affected by H + and fit to the two‐component kinetics. Therefore it was proposed that there are two distinct substrate recognition modes in CAT5. CAT5‐mediated uptake was inhibited by the pretreatment with N‐ethylmaleimide (NEM). Cyteine 391 was found to be the main target of inactivation by NEM. Northern blot and Western blot show that CAT5 specifically expressed in the mouse placenta. Immunofluorescence analysis revealed that CAT5 is co‐localized with eNOS. CAT5 is proposed to be involved in the placental barrier permeation and NO production in placenta.
Results from Pilot Tests Prove the Potential of Advanced Mud Logging (2011)

Abstract While traditional mudlogging techniques provide largely qualitative data, the objective of Advanced Mud Logging (AML) is to provide quantitative real time measurements and information in aid of drilling and a complete formation evaluation. Hence, during the past few years, various techniques which before were limited to laboratories, have been adapted for well site usage. Also, the whole surface logging system, from sensors to computer operating systems, have been enhanced. A systematic comparison of results between laboratory instrument and field version instruments proved that the quality of results does not need to be given up when applying these techniques at the wellsite. At present AML well site techniques thus include (i) enhanced monitoring of drilling parameters, (ii) sophisticated mud gas analysis capabilities, (iii) enhanced cuttings image acquisition and processing, and (iv) several direct petrophysical measurements on cuttings. We present some results of several field tests done in Saudi Arabia with a dedicated AML unit, where all these new techniques have been integrated. In this unit, next to conventional techniques, such as calcimetry, measurements on cuttings include X-ray diffraction (XRD), X-ray fluorescence (XRF), Nuclear Magnetic Resonance (NMR), spectral GR, grain density and porosity. Examples in each of the four areas mentioned above confirm the potential of AML. AML mud gas analysis gives quantitative compositional HC analysis which perfectly matches results from PVT tests done on subsequent wireline fluid sampling. Also: while the depth resolution of mudlogging measurements, typically several feet, is less than of especially wireline logging, normally sampled at half foot increments, the latest AML NMR measurements have the potential for very high resolution measurements, making it possible to establish the petrophysical properties of very thinly laminated sequences, where normally neither conventional wireline logs nor core plug measurements can resolve those.
Aqueous‐Phase Organometallic Catalysis (2004)

Basic Aqueous Chemistry. Catalysts for Aqueous Catalysis. Catalyses in Water as a Special Unit Operation. Aqueous Catalysts for Environment and Safety. Typical Reactions. Other Biphasic Concepts. Aqueous-Phase Catalysis: What Should be Done in the Future. Index.
Fast, Long-Wavelength Scintillators and Waveshifters (2006)

Studies are presented of new blue-green to red emitting scintillator and waveshifter materials for tracking and calorimetry applications for the detection of ionizing radiation. Materials include plastic scintillators, liquid scintillators, and plastic scintillating and waveshifting fibers. Program goals are to develop faster and more efficient detection media for a variety of experimental applications
A novel fairness criterion for input queued switches (2002)

In this paper, we propose a new fairness criterion-queue proportional fairness (QPF)- that employs the cell loss ratio as the fairness metric to improve the utilization of switch resources. In QPF, bandwidth allocation is implemented by considering both available bandwidths and buffer occupancies of competing best effort traffic.
Reproductive Biology of Heterospilus megalopus (Hymenoptera: Braconidae), a Parasitoid of Anthonomus grandis (1993)

Journal Article Reproductive Biology of Heterospilus megalopus (Hymenoptera: Braconidae), a Parasitoid of Anthonomus grandis Get access Juan A. Morales-Ramos, Juan A. Morales-Ramos 1USDA-ARS Subtropical Agriculture Research Laboratory, Biological Pest Control Research Unit, Weslaco, TX 78596. Search for other works by this author on: Oxford Academic Google Scholar James R. Cate James R. Cate 2USDA-CSRS, Aerospace Building, Suite 330, Washington, DC 20250-2200. Search for other works by this author on: Oxford Academic Google Scholar Annals of the Entomological Society of America, Volume 86, Issue 6, 1 November 1993, Pages 734–739, https://doi.org/10.1093/aesa/86.6.734 Published: 01 November 1993 Article history Received: 11 March 1993 Accepted: 01 June 1993 Published: 01 November 1993
LTV Circuit Modelling Techniques for System Simulation. Application to a MMIC K-Band I-Q Signal-Modulator (2002)

A technique for modelling LTV circuits with frequency-translation such as mixers and signal modulators is presented. The time and frequency-domain simulations of these comp lex circuits can be very expensive in terms of computational resources. A black-box reduced modelling approach for system simulation is proposed. The model consists of an equivalent linearized low-pass filter followed by a memoryless multiplication. The reduced model provides a noticeable decrease of simulation time, with a slight loss of accuracy. The modelling technique has been applied to a MMIC QPSK signal-modulator in K band and implemented in a standard simulation tool. The simulation results of the reduced model and the complete modulator equivalent circuit have been compared, obtaining good agreement.
Autonomic and Redox States Modulate The Moxonidine‐Cyclosporine Hemodynamic And Baroreflex Interactions (2011)

Baroreflex dysfunction and hypertension are among the most troublesome cardiovascular effects of cyclosporine (CSA). This study investigated whether these detrimental consequences of CSA can be circumvented upon simultaneous exposure to the sympatholytic drug moxonidine in rats. CSA (25 mg/kg/day for 7 days) increased blood pressure (BP) and blunted reflex chronotropic responses to peripherally-mediated pressor (phenylephrine) and depressor (sodium nitroprusside) responses. These effects of CSA disappeared in rats treated concomitantly with moxonidine (2 mg/kg/day). Studies involving pharmacologic autonomic blockade of muscarinic or β-adrenergic receptors with atropine or propranolol (1 mg/kg each), respectively, showed that moxonidine abolished the CSA-induced impairment of reflex cardiac autonomic control. Moxonidine also eliminated the CSA-evoked increases in aortic and brainstem nitrite/nitrate and the lipid peroxidation product malondialdehyde. Moxonidine, however, produced tissue-dependent effects on CSA-induced decreases in reduced glutathione and failed to reverse the reduction in aortic superoxide dismutase caused by CSA. In conclusion, moxonidine protects against the deleterious BP and baroreflex effects of CSA in rats via preserving the autonomic and redox profiles. Supported by Faculty of Pharmacy, Alexandria University, Egypt.
A new concept of UHF RFID tag for metallic object tracking with embedded cavity (2014)

This paper presents a new solution for labeling metallic items like boxes and cavities. The proposed tag is based on the use of electromagnetic properties of cavities and the passive loop AKTAG RFID tag. Moreover the design avoids the physical connection between the RFID chip and the antenna. Simulation and measurement results are in good agreement. The feasibility of performing hidden tag using existing metallic cavity embedded in the object structure is demonstrated. When the tag is inside the cavity, a read-range of 5.5 m was measured in anechoic chamber, and a read-range of 7.7 m is reached when the loop tag is directly coupled to the slot.
SiO 2 coatings on glass containing copper colloids using the sol-gel technique (1994)

A sol-gel method for the preparation of transparent copper nano particle-containing SiO<SUB>2</SUB> coatings on glass has been developed. The sol is synthesized from alkoxysilanes and tetra ethyl orthosilicate with copper ammine complexes, prepared from Cu<SUP>2+</SUP> salts and amino alkoxy silanes. Glass substrates are coated by dipping and layers up to 1 micrometers in thickness are obtained after thermal densification at temperatures between 200 degree(s) - 500 degree(s)C. The Cu colloid formation can be achieved using a reducing atmosphere during densification. Thus reddish-brown colored coatings on glass with optical densities between 0.5 and 2 are obtained. Under ambient air the color turns from reddish-brown to dark green. This process is reversible and by re-heating under reducing conditions the reddish-brown color can be re- established. UV-VIS absorbance measurements and structural investigations by WAXS, TEM, ESCA and SNMS show that the green color is due to an oxide layer at the colloidal interface.
18Gb/s Optical IO: VCSEL Driver and TIA in 90nm CMOS (2007)

An 18 Gb/s optical data rate is achieved with a commercial GaAs VCSEL by applying rising and falling edge pre-emphasis with a 90 nm CMOS driver. The pre-emphasis pulse shape can be digitally adjusted with time resolution less than one bit period. The TIA receiver has cross-coupled cascodes to increase the amplifier gain/bandwidth and operates at 12.5 Gb/s to 18 Gb/s depending on the input capacitance.
Tracking neighboring quasi-satellite orbits around Phobos (2020)

We consider the orbital maintenance problem on a quasi-satellite orbit about the Martian moon, Phobos. The orbit is computed using a high-fidelity ephemeris model so that the major sources of disturbances are due to measurement error. Two types of orbit maintenance schemes are considered. The first is based on asymptotically tracking the desired trajectory and the second is based on stabilizing to the manifold of trajectories that share the same Jacobi constant as the reference trajectory. The latter can be done because trajectories with the same Jacobi constant are in the neighborhood of one another. The results show that the trajectory-tracking scheme has lower fuel consumption when tracking must be precise and that the approach of stabilizing to a manifold has better fuel consumption at the expense of tracking.