gebhart/patrepeval huggingface dataset:
Near-Optimal Representation Learning for Hierarchical Reinforcement Learning (2018)

We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning. In such hierarchical structures, a higher-level controller solves tasks by iteratively communicating goals which a lower-level policy is trained to reach. Accordingly, the choice of representation -- the mapping of observation space to goal space -- is crucial. To study this problem, we develop a notion of sub-optimality of a representation, defined in terms of expected reward of the optimal hierarchical policy using this representation. We derive expressions which bound the sub-optimality and show how these expressions can be translated to representation learning objectives which may be optimized in practice. Results on a number of difficult continuous-control tasks show that our approach to representation learning yields qualitatively better representations as well as quantitatively better hierarchical policies, compared to existing methods (see videos at https://sites.google.com/view/representation-hrl).
A 2× Blind Oversampling FSE Receiver with Combined Adaptive Equalization and Infinite-Range Timing Recovery (2018)

A 2× blind-oversampling, fractionally-spaced equalizer (FSE) receiver is presented as an effective way to combine adaptive equalization and infinite-range timing recovery. A FSE can perform equalization as well as timing adjustment via data-interpolation and the presented work demonstrates an infinite-range timing recovery using a set of two half-UI-spaced, 4-tap FSEs that seamlessly switch across the UI boundaries. A current-integrating summer and multi-input regenerative latch help the 4-tap FSEs and 4-tap DFEs achieve low power dissipation, respectively. A prototype receiver fabricated in a 28nm CMOS consumes 3.5pJ/bit and 0.10mm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> at 9Gb/s while compensating a 22-dB channel loss and a 100 <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ppm</sub> frequency offset between the transmitted data and blind sampling clocks.
SOME OBSERVATIONS ON THE LIFE HISTORY OF <i>ASELLUS AQUATICUS</i> (L.) AND <i>ASELLUS MERIDIANUS</i> RACOVITZA (CRUSTACEA: ISOPODA) (1961)

The object of this research was to discover details of the life history and breeding biology of the two species of Asellus found in the surface waters of the British Isles. Data were obtained from monthly samples taken from two habitats. Analysis revealed that the species are similar in most aspects that were investigated but that the life histories show slight differences in timing.
Approximate entropy: Statistical properties and applications (1992)

ApEn, approximate entropy, is a recently developed family of parameters and statistics quantifying regularity (complexity) in data, providing an information-theoretic quantity for continuous-state processes. We provide the motivation for ApEn development, and indicate the superiority of ApEn to the K-S entropy for statistical application, and for discrimination of both correlated stochastic and noisy deterministic processes. We study the variation of ApEn with input parameter choices, reemphasizing that ApEn is a relative measure of regularity. We study the bias in the ApEn statistic, and present evidence for asymptotic normality in the ApEn distributions, assuming weak dependence. We provide a new test for the hypothesis that an underlying time-series is generated by i.i.d. variables, which does not require distribution specification. We introduce randomized ApEn, which derives an empirical significance probability that two processes differ, based on one data set from each process.
Markov channel-based feedback schemes for adaptive modulation systems (2005)

In adaptive modulation systems, it is widely assumed that the feedback channel is error-free by employing sophisticated error-control codes and ARQ signaling. However, since feedback is sent over a wireless channel, a heavy price may be paid to justify this assumption. In this paper, we first analyze system performance, given additive noise and fading on the feedback channel. Then, by utilizing the finite-state Markov channel model for a slowly fading Rayleigh channel, we design differential and full-state feedback schemes to correct most of the errors caused by an AWGN channel. For a fading feedback channel, a Markov-based scheme is designed with a threshold level, below which feedback decisions are deemed unreliable. The resulting system performance in terms of the spectral efficiency and bit error rate (BER) is comparable to the ideal case of an error-free feedback channel.
Electronic Health Records as Sources of Research Data (2016)

Furthermore, as we reported, the proportional hazards regression analysis for mortality by treatment assignment indicated no significant difference (P = .54).The time in the therapeutic range for international normalized ratio in the CATCH trial, although low, is consistent with results in previous studies and a reflection of the high degree of difficulty regulating international normalized ratio in patients with active cancer. 1,2If anything, this is an argument against using warfarin as standard therapy in this setting.We therefore disagree with Maruyama and colleagues that tinzaparin should not be considered over warfarin.Multiple prior studies included in a 2014 Cochrane systematic review found the use of low-molecular-weight heparin over vitamin K antagonists was associated with a significant reduction in venous thromboembolism (hazard ratio [HR], 0.47 [95% CI 0.32-0.71]). 3Even in the CATCH trial alone, the cumulative incidence of recurrent venous thromboembolism in the per-protocol analysis was 8.3% for tinzaparin compared with 12.7% for warfarin (HR, 0.62 [95% CI, 0.38-1.00];P = .05).In the intention-to-treat analysis, tinzaparin was associated with significant reductions in symptomatic deep vein thrombosis (HR, 0.48; P = .04)and clinically relevant nonmajor bleeding (HR, 0.58; P = .004).Therefore, there is clear benefit to patients receiving tinzaparin monotherapy.We note that the latest update of the American Society of Clinical Oncology guidelines is concordant with our stance and continues to recommend low-molecular-weight heparin as the preferred therapy for acute venous thromboembolism in malignancy.
Simultaneous double waveform synthesis with a single programmable Josephson voltage standard (2016)

We have recently demonstrated new 2 V PJVS devices configured with two voltage outputs and two sets of least significant bits in order to simultaneously generate two independent stepwise output waveforms. This development improves upon our previous alternating dual waveform method in that the two voltage waveforms can now be measured simultaneously, and the sampler overload condition that existed in the previous configuration has been eliminated. Applications such as the NIST Quantum Watt for ac power calibrations will benefit from these developments through reduced measurement uncertainties and improved flexibility.
<sup>13</sup>C‐kernresonanzspektren von ligninen, 1. Chemische verschiebungen bei monomeren und dimeren modellsubstanzen (1974)

Abstract Die 13 C‐chemischen Verschiebungen bei 14 monomeren ( 1–3 ) und 25 dimeren 4‐Hydroxy‐alkylbenzol‐Derivaten ( 4–12 ) werden mitgeteilt. Der Einfluß von ein oder zwei Methoxygruppen in ortho ‐Stellung zur Phenolgruppe auf die chemischen Verschiebungen der aromatischen Kohlenstoffatome wird untersucht. Die Verbindungen enthalten ferner am Benzolring und an der Propylseitenkette Substituenten, die für die Struktureinheit des hochmolekularen Lignins typisch sind, und dienen der Zuordnung der Signale der 13 C‐Spektren von Angio‐ und Gymnospermen‐Ligninen.
Sequence variants of human T-cell lymphotropic virus type I from patients with tropical spastic paraparesis and adult T-cell leukemia do not distinguish neurological from leukemic isolates (1990)

We have amplified and sequenced DNA in the envelope (env) and long terminal repeat (LTR) regions of human T-cell lymphotropic virus type I (HTLV-I) proviruses from the peripheral blood of 10 HTLV-I-seropositive patients with tropical spastic paraparesis (TSP) and two patients with adult T-cell leukemia. The aim was to examine variation in these regions and to test the hypothesis that the sequences of leukemogenic HTLV-I isolates differ from those causing the neurological disease TSP. In 5 of the 12 HTLV-I-seropositive patients, more than one HTLV-I sequence variant was identified in the same individual. No two individuals shared identical sequences in either env or LTR U3. Sequence variations were found at 73 positions in 1,416 bases amplified in env. Sequence variability was found throughout the LTR-U3 region, including the sequences of two transcriptional enhancers. Several nucleotide changes common to both Caribbean and Japanese HTLV-I isolates allowed us to identify a consensus sequence that differs from the HTLV-I prototype sequence (M. Seiki, S. Hattori, Y. Hirayama, and M. Yoshida, Proc. Natl. Acad. Sci. USA 80:3618-3622, 1983). No sequence in the env or LTR U3 region was found to be characteristic of isolates from TSP patients. Although each isolate was distinct at the nucleotide level, the predicted protein sequence of HTLV-I env is less variable than that of human immunodeficiency virus env, suggesting that these lymphotropic retroviruses use different strategies to evade host immune responses.
Intermingled cAMP, cGMP and calcium spatiotemporal dynamics in developing neuronal circuits (2014)

cAMP critically modulates the development of neuronal connectivity. It is involved in a wide range of cellular processes that require independent regulation. However, our understanding of how this single second messenger achieves specific modulation of the signaling pathways involved remains incomplete. The subcellular compartmentalization and temporal regulation of cAMP signals have recently been identified as important coding strategies leading to specificity. Dynamic interactions of this cyclic nucleotide with other second messenger including calcium and cGMP are critically involved in the regulation of spatiotemporal control of cAMP. Recent technical improvements of fluorescent sensors facilitate cAMP monitoring, whereas optogenetic tools permit spatial and temporal control of cAMP manipulations, all of which enabled the direct investigation of spatiotemporal characteristics of cAMP modulation in developing neurons. Focusing on neuronal polarization, neurotransmitter specification, axon guidance, and refinement of neuronal connectivity, we summarize herein the recent advances in understanding the features of cAMP signals and their dynamic interactions with calcium and cGMP involved in shaping the nervous system.
Anti‐neutrophil cytoplasm antibodies (ANCA) (1990)

Circulating antibodies directed against cytoplasmic constituents of granulocytes and monocytes (anti-neutrophil cytoplasm antibodies, ANCA) are found in about 80% of active cases of Wegener's granulomatosis and microscopic polyarteritis. Antibodies are detected by indirect immunofluorescence on normal peripheral blood leucocytes, or by ELISA or radio-immunoassay using a neutrophil cytoplasm extract. There are 2 patterns of staining seen on indirect immunofluorescent examination of leucocytes and a number of different molecules recognised on Western blots. In Wegener's granulomatosis diffusely granular cytoplasmic staining (cANCA) is associated with a 29KD molecule that has recently been identified as neutrophil proteinase 3. A finely granular pattern may also be seen in microscopic polyarteritis. A perinuclear pattern (pANCA) is present in some other cases of segmental necrotising glomerulonephritis and occasionally in rheumatoid arthritis but almost never in Wegener's granulomatosis. This pattern is often associated with the presence of anti-myeloperoxidase and anti-elastase antibodies. Levels of anti-neutrophil cytoplasm antibodies usually reflect disease activity but a pathogenetic role for these antibodies in the development of small vessel vasculitides is, as yet, unproven.
Macrophage Factor Controlling Differentiation of B Cells (1979)

Peritoneal macrophages of the mouse produce, in response to cell wall components of Gram-negative bacteria (lipopolysaccharide and lipoproteins), a factor that causes antigen-stimulated B cells of differentiate into antibody-producing cells. Unlike lipopolysaccharide, this factor is not mitogenic for B cells. Production of the macrophage factor does not depend on participation of T cells or other accessory cells since it is readily produced by several cloned macrophage cell lines as well as by peritoneal macrophages of athymic nude mice. The factor is active only in conjunction with antigen. T cells, although apparently not necessary, amplify its effect. The factor induces phenotypic differentiation of B cell precursors as selectively as thymopoietin induces differentiation of prothymocytes.
AlGaN Deep-Ultraviolet Light-Emitting Diodes Grown on SiC Substrates (2020)

The disinfection industry would greatly benefit from efficient, robust, high-power deep-ultraviolet light-emitting diodes (UV–C LEDs). However, the performance of UV–C AlGaN LEDs is limited by poor light-extraction efficiency (LEE) and the presence of a large density of threading dislocations. We demonstrate high power AlGaN LEDs grown on SiC with high LEE and low threading dislocation density. We employ a crack-free AlN buffer layer with low threading dislocation density and a technique to fabricate thin-film UV LEDs by removing the SiC substrate, with a highly selective SF6 etch. The LEDs (278 nm) have a turn-on voltage of 4.3 V and a CW power of 8 mW (82 mW/mm2) and external quantum efficiency (EQE) of 1.8% at 95 mA. KOH submicron roughening of the AlN surface (nitrogen-polar) and improved p-contact reflectivity are found to be effective in improving the LEE of UV light. We estimate the improved LEE by semiempirical calculations to be 33% (without encapsulation). This work establishes UV LEDs grown on SiC substrates as a viable architecture to large-area, high-brightness, and high-power UV LEDs.
Anti-VEGF Compounds in the Treatment of Neovascular Age Related Macular Degeneration (2011)

Age-related macular degeneration (AMD) is the leading cause of blindness among elderly patients in developed countries. Although the pathogenesis of AMD is still largely unknown, it is now well known that vascular endothelial growth factor (VEGF) plays a pivotal role in the growth of the abnormal blood vessels (i.e. choroidal neovascularization, CNV) which characterizes the "wet form" of this ocular disease. Therefore, inhibiting VEGF has turned out to be a good way of more effectively controlling neovascular AMD. VEGF is a heparin-binding glycoprotein with potent angiogenic, mitogenic and vascular permeability-enhancing activities specific for endothelial cells. Currently two anti-VEGF compounds have been approved by the US Food and Drug Administration (FDA) for the treatment of neovascular AMD: pegaptanib and ranibizumab. Off-label usage of bevacizumab, an anti-VEGF agent similar to ranibizumab, has also become fairly common. The substantial improvement of visual acuity noticed in patients treated with ranibizumab has made this drug the gold standard for AMD therapy. However, as with many new therapies, there are unresolved issues, including safety, cost, and dosing frequency. This review describes in details the properties and efficacy of the three anti-VEGF agents in use in clinical practice. Promising emerging anti-VEGF strategies (VEGF-trap, small interfering RNA, tyrosine kinase inhibitors) which aim to improve outcomes, safety and treatment burden through novel mechanisms of action are also discussed.
Design reviews (2003)

The best design engineers are adept at accepting valid criticisms of their ideas and proposals.
Neurobehavioral toxicity of carbon disulfide. (1981)

Carbon disulfide is an exceptionally potent neurotoxicant. In industrial settings its effects are pernicious, producing symptoms and behavioral alterations in the absence of frank poisoning; affective disorders are common, and exposure is associated with an elevated incidence of suicide. With more severe exposure, sensory disturbances are commonplace, as are alterations in sensory and motor nerve function. Alterations in behavior and central nervous system function can be readily produced in the laboratory with acute or chronic carbon disulfide exposure. Profound morphological changes, especially in the basal ganglia, can be produced with intense exposure. Dopamine beta-hydroxylase inhibition has been demonstrated in vivo and in vitro. Despite prolonged interest in its health effects, the toxic sequelae of exposure have not been adequately described using modern techniques of neurobehavioral toxicology, nor have the mechanisms of action been adequately elucidated.
Interactive verification of knowledge-based systems (1993)

The Validator program, which interactively checks the consistency and completeness of a knowledge base, is discussed. Validator verifies and validates rule-based expert systems and guarantees that every element in the knowledge base is accessible and essential to the system. The program checks for syntactic errors, unused rules, facts, and questions, incorrectly used legal values, redundant constructs, rules that use illegal values, wrong instantiations, and multiple methods for obtaining values for expressions.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
Palladium Based Fabry-Pérot Etalons for Hydrogen Sensing (2012)

We present simulations and measurements of palladium coated etalon sensors for detection of hydrogen gas. Hydrogen concentration can be determined by the shift in the wavelength or amplitude of the minima in the interference pattern.
Observations on the Course of<i>Plasmodium Knowlesi</i>Infection in Monkeys<i>(Macacus Rhesus)</i>, with Notes on Its Treatment by (1) Atebrin and (2) 1: 11 Normal Undecane Diamidine, Together with a Note on the Action of the Latter on Bird Malaria (1938)

(1938). Observations on the Course of Plasmodium Knowlesi Infection in Monkeys (Macacus Rhesus), with Notes on Its Treatment by (1) Atebrin and (2) 1: 11 Normal Undecane Diamidine, Together with a Note on the Action of the Latter on Bird Malaria. Annals of Tropical Medicine & Parasitology: Vol. 32, No. 3, pp. 257-278.
Design and testing of conductive polysilicon beam leads for use in a high-density biomedical connector (2004)

A study was conducted to measure and characterize the reliability of polysilicon cantilever beams with electroplated gold pads for use in a high-density biomedical connector. In this design, an array of beams is brought into contact with a corresponding array of 30 m high gold bumps, forming electrical connection. Analytical computations of multi-layer beams were performed, including the effects of residual stresses. Beam leads of various lengths and widths with electroplated gold contact pads on their ends were tested over 1000 cycles to determine their mechanical reliability, and to measure their contact resistance with gold bumps on a separate substrate. The dimensions of the polysilicon beam that produce the least breakage were determined to be 400 m long by 125 m wide. For a beam having a calculated contact force of 100 N, the initial contact resistance was 764 m . After 1000 connect/disconnect cycles, beams of this type had an average final contact resistance of 1.598 . These results demonstrate that very high-density connectors with high mechanical reliability and low-contact resistance can be fabricated.
Stimuli-responsive polymer vesicles (2009)

Polymer vesicles, commonly called polymersomes, are spherical shell structures in which an aqueous compartment is enclosed by a bilayer membrane made from amphiphilic block copolymers. Compared to liposomes, their low molecular weight analogues, polymersomes have many superior properties (higher toughness, better stability, tailorable membrane properties), which make them attractive candidates for applications including encapsulation, drug delivery, nanoreactors and templates for micro- or nano-structured materials. Many potential applications require the ability to control the release of substances encapsulated in the interior compartment and/or in the hydrophobic core of membrane. To address this goal, polymersomes have to be developed in which a specific stimulus destabilises the vesicle structure. In this article we review the most promising approaches to make stimuli-responsive polymer vesicles that permit the controlled release of encapsulated contents. Stimuli including hydrolysis, oxidation, reduction, pH, temperature and light are discussed and their effect on the chemical and physical structure of the amphiphilic copolymers is also described.
Application of the Trephine for Bone Biopsy (1963)

The purpose of this study was to determine operability in malignant cases by proving the presence or absence of skeletal metastases. Radiographic findings have frequently led to error. Benign bone lesions sometimes resemble metastases, or extensive metastases may be present in bones which appear radiographically normal. The most frequent sites of bone metastases are the vertebral bodies. They are involved in from 50% to 75% of cases of carcinoma of the breast, lungs, and prostate. New instruments for biopsy of vertebral bodies were invented. Their use is described. In this study on the living, metastases were found in 20%. The fact that in the majority of cases bone biopsy was done before the metastatic spread was far advanced explains this low incidence.
Explantation of Infected Hemostatic Puncture Closure Devices (1999)

Hemostatic puncture closure devices for the femoral artery are currently marketed as a means of shortening hemostasis, ambulation, and observation times after cardiac catheterization procedures. Some of these devices are deployed external to the artery, but at least one device, Angio-SealA (Sherwood, Davis & Geck), includes a polymer anchor that is deployed inside the artery. Major complications may arise from the use of this device, including thrombosis, embolization of the anchor, and infection. The manufacturer does not claim that the device reduces the incidence of local complications as compared to the traditional technique of manual compression. The author presents a case of infection of the groin involving the Angio-Seal device in which the patient presented with septic shock and renal failure after cardiac catheterization. A large abscess was present, and removal of the device required arterial surgery in an infected field. The author reports on the technique and precautions used to surgically remove the device and to prevent further complications.