gebhart/patrepeval huggingface dataset:
On the Sample Complexity of Reinforcement Learning with a Generative Model (2012)

We consider the problem of learning the optimal action-value function in the discounted-reward Markov decision processes (MDPs). We prove a new PAC bound on the sample-complexity of model-based value iteration algorithm in the presence of the generative model, which indicates that for an MDP with N state-action pairs and the discount factor γ\in[0,1) only O(N\log(N/δ)/((1-γ)^3ε^2)) samples are required to find an ε-optimal estimation of the action-value function with the probability 1-δ. We also prove a matching lower bound of Θ(N\log(N/δ)/((1-γ)^3ε^2)) on the sample complexity of estimating the optimal action-value function by every RL algorithm. To the best of our knowledge, this is the first matching result on the sample complexity of estimating the optimal (action-) value function in which the upper bound matches the lower bound of RL in terms of N, ε, δand 1/(1-γ). Also, both our lower bound and our upper bound significantly improve on the state-of-the-art in terms of 1/(1-γ).
Get Out of the Valley: Power-Efficient Address Mapping for GPUs (2018)

GPU memory systems adopt a multi-dimensional hardware structure to provide the bandwidth necessary to support 100s to 1000s of concurrent threads. On the software side, GPU-compute workloads also use multi-dimensional structures to organize the threads. We observe that these structures can combine unfavorably and create significant resource imbalance in the memory subsystem - causing low performance and poor power-efficiency. The key issue is that it is highly application-dependent which memory address bits exhibit high variability. To solve this problem, we first provide an entropy analysis approach tailored for the highly concurrent memory request behavior in GPU-compute workloads. Our window-based entropy metric captures the information content of each address bit of the memory requests that are likely to co-exist in the memory system at runtime. Using this metric, we find that GPU-compute workloads exhibit entropy valleys distributed throughout the lower order address bits. This indicates that efficient GPU-address mapping schemes need to harvest entropy from broad address-bit ranges and concentrate the entropy into the bits used for channel and bank selection in the memory subsystem. This insight leads us to propose the Page Address Entropy (PAE) mapping scheme which concentrates the entropy of the row, channel and bank bits of the input address into the bank and channel bits of the output address. PAE maps straightforwardly to hardware and can be implemented with a tree of XOR-gates. PAE improves performance by 1.31X and power-efficiency by 1.25X compared to state-of-the-art permutation-based address mapping.
A wide-tuning quasi-type-I PLL with voltage-mode frequency acquisition aid (2011)

A wide-tuning low-cost PLL architecture with negligible loop filter area is presented. To overcome the static phase error or reference spur problem of the conventional type-I PLL over broad frequency tuning range, a Δ-Σ DAC based real- time frequency acquisition aid method is employed in the PLL voltage domain. Different from other Δ-Σ based frequency acquisition methods mainly used for the type-II all-digital PLL (ADPLL), the proposed method provides inherent quantization noise reduction by the PLL loop filter. Simulation results verify that significant reference spur reduction as well as Δ-Σ noise reduction can be achieved with the proposed architecture.
Impact of extrinsic capacitances on FinFETs RF performance (2012)

Triple-Gate FinFETs have been demonstrated to be promising to push further the down scaling of the CMOS technology, thanks to their high immunity against the so-called short channel effects. However, due to their three-dimensional (3-D) architecture, strong degradation of their analog characteristics has been reported, basically due to large extrinsic resistances and capacitances. In this paper, based on measurements and 3-D numerical simulations we analyze the impact of the extrinsic gate capacitance on the RF behavior of FinFETs. It observes that the extrinsic capacitances are larger than the intrinsic counterparts for sub-100 nm devices. Furthermore, the reduction of the fin spacing as well as the increase of the fin geometrical aspect ratio (height/width) can improve significantly the FinFETs RF behavior.
A Protected 5-Hydroxypentanal Synthon (1975)

In connection with other work, we needed a synthon which corresponded to 5-hydroxypentanal (2) separately protected at each end. To some extent this requirement is met by dihydropyran (1), but in the reactions of this compound both of the masked functional groups are released at the same time. Obviously, it would be an advantage to use this readily available compound as our starting material for the preparation of a protected derivative of the hydroxyaldehyde (2). We now report that a simple solution to the problem is the one-pot preparation of the crystalline acetal tosylate (3), and we illustrate one way in which such a derivative can be used in synthesis.
New Approaches to Monitoring Sleep-Related Breathing Disorders (1996)

Conventional approaches to the analysis of sleep and sleep apnea do not describe all of the critical events that result from upper airway narrowing during sleep. The hypersomnolence that drives treatment is mainly due to microarousals, but these are poorly documented with conventional epoch-based sleep staging. The counting of apneas and hypopneas also fails to document other equally important events, such as the arousals due to increased respiratory effort in response to partial upper airway narrowing that may not cause significant hypopnea, hypoxemia, or even snoring. Modifications of conventional polysomnography, such as microarousal detection and analysis of the ribcage/abdominal paradox, may be an improvement. However, no system has been shown to be better than any other at identifying the critical events that produce symptoms of sleep-related breathing disorders, and thus be likely to respond to effective treatment. The time is right to explore innovative ways to characterize sleep-related breathing disorders, such as those derived from the cardiovascular change related to upper airway obstruction and arousal, without the shackles of conventional polysomnography. New monitoring techniques need to identify patients with events that will respond to treatment, not mimic the flawed gold standard of polysomnography.
Acetylcholine and bradykinin trigger preconditioning in the heart through a pathway that includes Akt and NOS (2004)

In the rabbit heart, bradykinin and ACh trigger preconditioning by a mechanism involving ATP-sensitive potassium channel-dependent production of reactive oxygen species (ROS). Recent evidence indicates that the pathway by which bradykinin causes ROS generation includes nitric oxide synthase (NOS) and protein kinase G (PKG). On the other hand, Akt was shown to be essential for ACh to generate ROS. This study determines whether these two G-coupled receptor agonists indeed have similar signaling targets, i.e., whether Akt is involved in bradykinin's pathway and whether NOS is involved in ACh's pathway. Isolated adult rabbit cardiomyocytes were incubated for 15 min in reduced MitoTracker red, which becomes fluorescent only after exposure to ROS. Bradykinin (400 nM) and ACh (250 microM) caused a 51.4 +/- 14.8% and 39.8 +/- 11.7% increase, respectively, in ROS production (P <0.005). Coincubation of either agonist with Akt inhibitor (20 microM) or infection of cells with an adenovirus containing dominant negative Akt abolished this increase. The NO donor S-nitroso-N-acetyl penicillamine (SNAP, 1 microM) also increased the ROS signal by 40.8 +/- 15.7%, but this increase was unaffected by Akt inhibitor (39.0 +/- 6.4%), implying that Akt is upstream of NOS. ACh-induced ROS production could be abolished by either of the NOS inhibitors Nomega-monomethyl-L-arginine monoacetate (100 microM) and L-N5-(1-iminoethyl)ornithine hydrochloride (L-NIO, 5 microM). L-NIO also blocked the anti-infarct effect of ACh (550 microM) in isolated rabbit hearts exposed to 30 min of regional ischemia. We conclude that both bradykinin and ACh trigger ROS generation by sequentially activating Akt and NOS.
Serological techniques (2009)

Very often it is difficult to make a clinical diagnosis of a specific viral infection, as many viruses have clinically similar presentation (e.g. hepatitis viruses,Chapter 38) and the same virus can have many different clinical presentations (e.g. enteroviruses, Chapter 5). It is therefore essential to seek specific laboratory diagnosis to enable correct management of the patient. This may be important from an epidemiological perspective as well. It has been shown that even experienced clinicians are not able to clinically diagnose cases of rubella or measles correctly. A specific diagnosis of a viral rash is important, not only to the clinical management of the patient, but essential for control of infection, outbreak control and the public health perspective of continuing to ensure the efficacy of vaccination programmes.
Different Pathways Are Involved in Phosphate and Iron Stress-Induced Alterations of Root Epidermal Cell Development (2001)

Low bioavailability of phosphorus (P) and iron (Fe) induces morphogenetic changes in roots that lead to a higher surface-to-volume ratio. In Arabidopsis, an enlargement in the absorptive surface area is achieved by an increase in the length and frequency of hairs in roots of Fe- and P-deficient plants. The extra root hairs are often located in positions that are occupied with non-hair cells under normal conditions, i.e. over a tangential wall of underlying cortical cells. An involvement of auxin and ethylene in root epidermis cell development of Fe- and P-deficient plants was inferred from phenotypical analysis of hormone-related Arabidopsis mutants and from the application of substances that interfere with either synthesis, transport, or perception of the hormones. Application of the ethylene precursor 1-aminocyclopropane-1-carboxylic acid or the auxin analog 2,4-D caused a marked increase in root hair density in plants of all growth types and confers a phenotype characteristic of ethylene-overproducing mutants. Hormone insensitivity and application of hormone antagonists inhibited the initiation of extranumerary root hairs induced by Fe deficiency, but did not counteract the formation of extra hairs in response to P deprivation. A model is presented summarizing putative pathways for alterations in root epidermal cell patterning induced by environmental stress.
Toward energy harvesting using active materials and conversion improvement by nonlinear processing (2005)

This paper presents a new technique of electrical energy generation using mechanically excited piezoelectric materials and a nonlinear process. This technique, called synchronized switch harvesting (SSH), is derived from the synchronized switch damping (SSD), which is a nonlinear technique previously developed to address the problem of vibration damping on mechanical structures. This technique results in a significant increase of the electromechanical conversion capability of piezoelectric materials. Comparatively with standard technique, the electrical harvested power may be increased above 900%. The performance of the nonlinear processing is demonstrated on structures excited at their resonance frequency as well as out of resonance.
Template meta-programming for Haskell (2002)

We propose a new extension to the purely functional programming language Haskell that supports compile-time meta-programming . The purpose of the system is to support the algorithmic construction of programs at compile-time.The ability to generate code at compile time allows the programmer to implement such features as polytypic programs, macro-like expansion, user directed optimization (such as inlining), and the generation of supporting data structures and functions from existing data structures and functions.Our design is being implemented in the Glasgow Haskell Compiler, ghc.
<title>Slot-vee antenna-coupled electro-optic modulator</title> (1998)

We have demonstrated slot vee antenna-coupled electro-optic modulators at 24 GHz. The lost vee antenna design allows for a more robust microwave signal feed into the LiNbO<SUB>3</SUB> chip, where the modulator itself acts as a slab waveguide for the microwave signal. The antenna-coupled design overcomes the velocity mismatch problems inherent in LiNbO<SUB>3</SUB> traveling-wave electro-optic modulators.
Technical Advance: caspase-1 activation and IL-1β release correlate with the degree of lysosome damage, as illustrated by a novel imaging method to quantify phagolysosome damage (2010)

In addition to the lysosome's important roles in digestion, antigen processing, and microbial destruction, lysosome damage in macrophages can trigger cell death and release of the inflammatory cytokine IL-1β. To examine the relationship among endocytosis, lysosome damage, and subsequent events, such as caspase-1 activation and IL-1β secretion, we developed a method for measuring lysosome disruption inside individual living cells, which quantifies release of Fdx from lysosomes. Unperturbed, cultured BMM exhibited low levels of lysosome damage, which were not increased by stimulation of macropinocytosis. Lysosome damage following phagocytosis differed with different types of ingested particles, with negligible damage after ingestion of sRBC ghosts, intermediate damage by polystyrene (PS) beads, and high levels of damage by ground silica. Pretreatment with LPS decreased the amount of lysosome damage following phagocytosis of PS beads, silica microspheres, or ground silica. Activation of caspase-1 and subsequent release of IL-1β were proportional to lysosome damage following phagocytosis. The low level of damage following PS bead phagocytosis was insufficient to activate caspase-1 in LPS-activated macrophages. These studies indicate that lysosome damage following phagocytosis is dependent on particle composition and dose and that caspase-1 activation and IL-1β secretion correlate with the extent of lysosome damage.
Flexible photonic components in glass substrates (2015)

This paper demonstrates the fabrication and measurements of flexible photonic lightwave circuits in glass substrates. Using temporally and spatially shaped ultrafast laser pulses, highly symmetrical and low-loss optical waveguides were written in flexible glass substrates with thicknesses ranging from 25 µm to 100 µm. The waveguide propagation loss, measured by optical frequency domain reflectometry, was 0.11 dB/cm at 1550 nm telecommunication wavelength. The bend loss of the waveguide is negligible at a radius of curvature of 1.5 cm or greater. Additionally, the waveguides are thermally stable up to 400°C. This paper presents alternatives to fabricating flexible photonics in traditionally used polymeric materials.
InGaAs (110) Surface Cleaning Using Atomic Hydrogen (2014)

A major obstacle facing III-V semiconductor based metal oxide semiconductor field effect transistors (MOSFETs) is the large density of trap states that exist at the semiconductor/oxide interface.[1] These trap states can pin the Fermi level preventing the MOSFET from acting as a switch in logic devices. Several sources of Fermi level pinning have been proposed including oxidation of the III-V substrate.[2, 3] In order to minimize the presence of III-V oxides it is crucial to employ either an ex-situ etch or to use an in-situ method such as atomic hydrogen cleaning.[4, 5] Although atomic H cleaning of III-V surfaces is well known, it has never been demonstrated on InGaAs (110) crystallographic faces. Furthermore, tri-gate field effect transistors (finFETs) have recently been employed in commercially available logic chips.[6] This unique device architecture allows for a reduction in short channel effects, minimization of the subthreshold swing, and a higher transconductance.[7] The InGaAs (110) surface would be the sidewalls of a vertically aligned (001) based finFETs.[8] Therefore, it is essential to find an in-situ method to efficiently remove any oxides or contamination from the (110) surfaces that is also compatible with the (001) surface. In this study, STM was employed to determine if atomic hydrogen can be used to remove the native oxide from air exposed InGaAs (110) samples. A post clean anneal was used to restore the surface to molecular beam epitaxy (MBE) levels of cleanliness.
Detecting Seasonal Trends and Cluster Motion Visualization for Very High Dimensional Transactional Data (2001)

1 Introduction Real life transactional data often poses challenges such as very large size, high dimensionality, skewed distribution, sparsity, seasonal variations and market-drift or migration [1, 2]. Most studies have taken a static view of the data while making predictions about a customer's buying behavior, market segmentation, etc. [3, 4]. A notable exception is recent work on temporal association rule mining, dealing with incremental characteristics and change, for example, see [5, 6]. This paper focusses on the problem of segmenting customers visiting a rapidly growing e-tailer. The segments are dynamic and seasonal, so preprocessing and trend characterization is key. We use a real-life data belonging to an e-commerce business and referred to as Horizon data in this paper, provided by KD1 (since then acquired by Net Perceptions) to illustrate the issues. In Section 2, the Horizon data is summarized. Section 3 quantifies market migration for choosing the appropriate period of data. Based on seasonal variations in purchasing behavior, a novel seasonality detection and partitioning scheme is described. Some of the market migration and oscillation results on Horizon data are also presented. Section 4 describes a new concept called Cluster Space for converting this high dimensional (> 10, 000) data into a continuous low dimensional space using a graph based clustering called VBACC [7] on the seasonally partitioned data. Motion detection and visualization schemes are introduced, and some interesting trends found in the Horizon data are described.
Detection of soluble HLA‐G molecules in plasma and amniotic fluid (1999)

Although the cDNA sequence of HLA-G antigens is compatible with their expression as soluble molecules (sHLA-G), the determination of native sHLA-G levels in body fluids has not yet been described. The lack of this information is likely to reflect the difficulties in developing an assay suitable to measure sHLA-G antigens in the presence of soluble HLA-A, -B and -C (sHLA-I) antigens, since most of the available anti-HLA-G mAb do not detect soluble beta2-m associated HLA-G antigens or crossreact with sHLA-I antigens. Therefore, we have developed a two-step assay which eliminates the interference of classical HLA class I antigens. In the first step, the sample is depleted of sHLA-I antigens and of HLA-E antigens with mAb TP25.99. Then, HLA-G antigens are captured with mAb W6/32 and detected with anti-beta2-m mAb in ELISA. Utilizing this assay, sHLA-G antigen levels were measured in EDTA plasma from 92 controls with known HLA types, 28 women at delivery and the corresponding cord bloods and in 50 amniotic fluids. Mean sHLA-G plasma levels did not differ between males (24.9+/-3.0 SEM ng/ml; n=42) and females (20.1+/-2.1 SEM ng/ml; n = 50). However, sHLA-G levels in HLA-A11 positive probands (mean: 13.0+/-4.4 SEM ng/ml; n=12) were significantly (P<0.05) lower than in HLA-A11 negative ones (mean: 24.5+/-2.0 SEM ng/ml; n=80). sHLA-G levels in women at delivery (mean: 22.9+/-2.2 SEM ng/ml; n=28) were in the range of controls but were significantly (P<0.001) reduced in the corresponding cord bloods (mean: 13.8+/-1.5 SEM ng/ml; n=28). sHLA-G levels in amniotic fluids (mean: 15.5 + 1.0 SEM ng/ml; n=50) were significantly (P<0.001) lower than in plasma. sHLA-G levels were 5 and 11% of those of sHLA-I antigens in plasmas and amniotic fluids, respectively. Individual sHLA-G levels were not correlated with sHLA-I levels. SDS-PAGE analysis of plasma sHLA-G antigens revealed two molecular variants with a 35 kD and a 27 kD MW corresponding to the sizes of sHLA-G1 and -G2 isoforms. In conclusion, our study has shown that the two-step assay we have developed is reliable in measuring sHLA-G antigen levels. This assay will facilitate the analysis of the biological and clinical significance of sHLA-G antigens in plasma.
The State of High Performance Computing in the Cloud (2012)

HPC applications have been gaining lot of attention in the cloud computing world. Most of these applications are scientific applications that require large CPU capabilities and are also data intensive requiring large data storage. Traditionally they have always required large number of computers inter-connected in a network such as clusters or supercomputers. These clusters are difficult to setup and maintain both technically and financially. With the advent of cloud computing and benefits of Infrastructure as a Service (IaaS) and Platform as a Service (PaaS), scientists and researchers are able to deploy their HPC applications in the cloud without worrying about the costs associated with the infrastructure and other costs involved. They also give guarantees on the quality of service (QoS). This paper focuses on documenting some of the research already done in the field of HPC applications and their current state in cloud computing.
Efficient topology-aware overlay network (2003)

Peer-to-peer (P2P) networking has become a household word in the past few years, being marketed as a work-around for server scalability problems and "wonder drug" to achieve resilience. Current widely-used P2P networks rely on central directory servers or massive message flooding, clearly not scalable solutions. Distributed Hash Tables (DHT) are expected to eliminate flooding and central servers, but can require many long-haul message deliveries. We introduce Mithos, an content-addressable overlay network that only uses minimal routing information and is directly suitable as an underlay network for P2P systems, both using traditional and DHT addressing. Unlike other schemes, it also efficiently provides locality-aware connectivity, thereby ensuring that a message reaches its destination with minimal overhead. Mithos provides for highly efficient forwarding, making it suitable for use in high-throughput applications. Paired with its ability to have addresses directly mapped into a subspace of the IPv6 address space, it provides a potential candidate for native deployment. Additionally, Mithos can be used to support third-party triangulation to quickly select a close-by replica of data or services.
Automation and Extension of LDV (Laser-Doppler Velocimetry) Measurements of Off-Design Flow in a Subsonic Cascade Wind Tunnel (1989)

Abstract : A two-component laser-Doppler velocimetry system was successfully automated to speed the data acquisition and reduction process for flow measurements in a subsonic linear cascade wind tunnel. A three-axis traverse table was installed for computer controlled positioning of the LDV probe volume and a modification was made to permit measurements close to test blade surfaces. Commercial software was used for control and acquisition of the LDV data. Software was generated in-house to record tunnel conditions and to reduce and present the survey data. Detailed measurements were made of the flow through a controlled diffusion compressor cascade at an inlet flow angle of 48 degrees (8 degrees above design) to extend a database for viscous code validation. Test conditions were held nominally at M=0.25 and Rec=720000. The flow was shown to remain attached at the blade trailing edge but the measurements also indicated the presence of a less stable flow field in the blade passage when compared with previous observations at lower inlet flow angles. (kr)