gebhart/patrepeval huggingface dataset:
MixKD: Towards Efficient Distillation of Large-scale Language Models (2020)

Large-scale language models have recently demonstrated impressive empirical performance. Nevertheless, the improved results are attained at the price of bigger models, more power consumption, and slower inference, which hinder their applicability to low-resource (both memory and computation) platforms. Knowledge distillation (KD) has been demonstrated as an effective framework for compressing such big models. However, large-scale neural network systems are prone to memorize training instances, and thus tend to make inconsistent predictions when the data distribution is altered slightly. Moreover, the student model has few opportunities to request useful information from the teacher model when there is limited task-specific data available. To address these issues, we propose MixKD, a data-agnostic distillation framework that leverages mixup, a simple yet efficient data augmentation approach, to endow the resulting model with stronger generalization ability. Concretely, in addition to the original training examples, the student model is encouraged to mimic the teacher's behavior on the linear interpolation of example pairs as well. We prove from a theoretical perspective that under reasonable conditions MixKD gives rise to a smaller gap between the generalization error and the empirical error. To verify its effectiveness, we conduct experiments on the GLUE benchmark, where MixKD consistently leads to significant gains over the standard KD training, and outperforms several competitive baselines. Experiments under a limited-data setting and ablation studies further demonstrate the advantages of the proposed approach.
Protective effects of HOE642, a selective sodium-hydrogen exchange subtype 1 inhibitor, on cardiac ischaemia and reperfusion (1995)

HOE642 is a very selective NHE subtype 1 inhibitor showing cardioprotective and antiarrhythmic effects in ischaemic and reperfused hearts. Further development of well tolerated compounds like HOE642 could lead to a new therapeutic approach in clinical indications related to cardiac ischaemia and reperfusion.
On-chip cell culture biosensing with microfluidic feedback control (2011)

We present work towards expanding the capabilities of microfluidic cell culture devices through the incorporation of microelectronic sensing systems. A system has been fabricated that includes four sensing regions each consisting of a pH sensor, capacitance sensor, and photodiode. We have demonstrated the incorporation of feedback control systems using computer controlled microfluidics for a pH sensor. Preliminary data for photodiode characterization, pH detection using ISFETs, and capacitance sensing of cell density is presented. Results from this work will be used towards creating a single system that can function as a cell culture platform with programmable control over all of these variables.
Simple estimatin for SSBW excitation strength. (1985)

On so-called SSBW cuts, some guided wave (GSW) is often launched from an IDT and propagated with a velocity virtually indistinguishable from that of SSBW. 1-3) Refs.4) and5) have shown for41rotated Y-cut LiNbO3 (41-LNO) and 36rotated Y-cut LiTaO3 (36-LTO) that SSBW is a dominant propagation mode on the free surface. On the metallised surface, however, leaky SAW, one of GSWs, dominates over SSBW. Similarly, both SSBW and BGW, velocities of which are in very close proximity, are launched and propagated on rotated Y-cuts of quartz. 1) These two modes sometimes produce unexpected behaviour3) and results in a complicated device design. The experimental result is fairly supported by rigorous mathematical treatments by Milsom et al. 6) However, the treatment is only evaluated by numerical calculation
Transient Electric Birefringence Measurement of the Persistence Length of Sodium Polystyrene Sulfonate (1991)

The persistence length Lp of a flexible polyelectrolyte, sodium polystyrene sulfonate, is measured at very low concentration and ionic strength by transient electric birefringence. The data show that the persistence length reaches, at very low ionic strength, a limiting value which depends on the extended chain length L, but is much shorter than L. The results are not in agreement with the available theoretical predictions. © 1991 IOP publisher Ltd.
XI. On Linear Hyperbolic Differential Equations with Variable Coefficients on a Vector Space (1955)

XI. On Linear Hyperbolic Differential Equations with Variable Coefficients on a Vector Space was published in Contributions to the Theory of Partial Differential Equations. (AM-33), Volume 33 on page 201.
Novel Electrically Conductive Porous PDMS/Carbon Nanofiber Composites for Deformable Strain Sensors and Conductors (2017)

Highly flexible and deformable electrically conductive materials are vital for the emerging field of wearable electronics. To address the challenge of flexible materials with a relatively high electrical conductivity and a high elastic limit, we report a new and facile method to prepare porous polydimethylsiloxane/carbon nanofiber composites (denoted by p-PDMS/CNF). This method involves using sugar particles coated with carbon nanofibers (CNFs) as the templates. The resulting three-dimensional porous nanocomposites, with the CNFs embedded in the PDMS pore walls, exhibit a greatly increased failure strain (up to ∼94%) compared to that of the solid, neat PDMS (∼48%). The piezoresistive response observed under cyclic tension indicates that the unique microstructure provides the new nanocomposites with excellent durability. The electrical conductivity and the gauge factor of this new nanocomposite can be tuned by changing the content of the CNFs. The electrical conductivity increases, while the gauge factor decreases, upon increasing the content of CNFs. The gauge factor of the newly developed sensors can be adjusted from approximately 1.0 to 6.5, and the nanocomposites show stable piezoresistive performance with fast response time and good linearity in ln(R/R<sub>0</sub>) versus ln(L/L<sub>0</sub>) up to ∼70% strain. The tunable sensitivity and conductivity endow these highly stretchable nanocomposites with considerable potential for use as flexible strain sensors for monitoring the movement of human joints (where a relatively high gauge factor is needed) and also as flexible conductors for wearable electronics (where a relatively low gauge factor is required).
Tracking the optic nervehead in oct video using dual eigenspaces and an adaptive vascular distribution model (2003)

Optical coherence tomography (OCT) is a new ophthalmic imaging modality generating cross sectional views of the retina. OCT systems are essentially Michelson interferometers that form images in 1.5 s by directing a superluminescent diode (SLD) beam over the retinal surface. Involuntary eye motions frequently cause incorrect locations to be imaged. This motion may leave no obvious artifacts in the scan data and can easily go undetected. For glaucoma monitoring especially, knowing the measurement path, typically a circle concentric with the nerve head, is crucial. The commercially available OCT system displays a near-infrared video of the retina showing the SLD beam. This paper presents a prototype system to detect the nerve head and SLD beam in the video, and report the true scan path relative to the nerve head. Low image contrast and limited resolution make the reliable detection of retinal features difficult. In an adaptive model construction phase, the system directly detects retinal vasculature and the nerve head and incrementally builds a model of the current subject's vascular pattern relative to the optic disk. The nerve head identification is multitiered, using a novel dual eigenspace technique and a geometric comparison of detected vessel positions and nerve head hypotheses. In its operational phase, a correspondence is achieved between the currently detected vasculature and the model. Using subjects not included in training, the system located the optic nerve head to within 5 pixels (0.07 optic disk diameters, an error well below clinical significance) in 99.75% of 2800 video fields. In current clinical practice, motions as large as 1-2 disc diameters may go undetected, so this is a vast improvement.
Detecting Protein-Phospholipid Interactions (2002)

Phospholipase D (PLD) proteins have been identified in secretory and endocytic vesicles, consistent with their proposed role in regulating membrane traffic. However, their sites of catalytic action remain obscure. We have developed here a novel, analytical approach to monitor PLD activation in intact cells employing lifetime imaging microscopy to measure fluorescence resonance energy transfer between protein and membrane phospholipid. Verification and application of this technique demonstrates a dispersed endosomal, epidermal growth factor-induced activation of the PLD1b isoform. Application of this approach will facilitate the spatial resolution of many protein-phospholipid interactions that are key events in the regulation of cellular processes.
Auraptene Increases the Production of Amyloid-β via c-Jun N-Terminal Kinase-Dependent Activation of γ-Secretase (2014)

Amyloid-β (Aβ) peptide plays a major role in the pathogenesis of Alzheimer's disease (AD), and is generated by β- and γ-secretase-mediated proteolytic processing of amyloid-β protein precursor (AβPP). In the present study, we investigated the effect of 118 natural compounds on Aβ production in the medium of HEK293 cells stably expressing human AβPP695 (HEK293-AβPP) using Aβ42 sandwich ELISA to find natural compounds that can modulate Aβ production. We found that a coumarin derivative of citrus fruits, auraptene, increased Aβ production. Treatment of HEK293-AβPP cells and rat primary cortical neurons with auraptene significantly increased the secretion of Aβ40, Aβ42, and the Aβ42/40 ratio. However, auraptene did not change the protein levels of the AβPP processing enzymes, a disintegrin and metalloproteinases 10 (ADAM10, α-secretase), β-site AβPP cleaving enzyme-1 (BACE-1, β-secretase), and presenilin 1 (PS1, γ-secretase component). Auraptene increased the activity of γ-secretase but not that of α- and β-secretase. Furthermore, auraptene enhanced γ-secretase-mediated production of Aβ from AβPP or AβPP-C99, but not through α- and β-secretase. Auraptene also phosphorylated c-Jun N-terminal kinase (JNK), and pretreatment with the JNK inhibitor, SP600125, reduced auraptene-induced γ-secretase activity. Overall, our results suggest that auraptene-mediated activation of JNK may contribute to the production of Aβ by promoting γ-secretase activity.
Joint tests at INL and CEA of a transient hot wire needle probe for in-pile thermal conductivity measurement (2015)

Thermal conductivity is a key property that must be known for proper design, testing, and deployment of new fuels and structural materials in nuclear reactors. Thermal conductivity is highly dependent on the physical structure, chemical composition, and the state of the material. Typically, thermal conductivity changes that occur during irradiation are currently measured out-of-pile using a "cook and look" approach. But repeatedly removing samples from a test reactor to make measurements is expensive, has the potential to disturb phenomena of interest, and only provides understanding of the sample's end state when each measurement is made. There are also limited thermo-physical property data available for advanced fuels; and such data are needed for simulation codes, the development of next generation reactors, and advanced fuels for existing nuclear plants. Being able to quickly characterize fuel thermal conductivity during irradiation can improve the fidelity of data, reduce costs of post-irradiation examinations, increase understanding of how fuels behave under irradiation, and confirm or improve existing thermal conductivity measurement techniques. This paper discusses efforts to develop and evaluate an innovative in-pile thermal conductivity sensor based on the transient hot wire thermal conductivity method (THWM), using a single needle probe (NP) containing a line heat source and thermocouple embedded in the fuel. The sensor that has been designed and manufactured by the Idaho National Laboratory (INL) includes a unique combination of materials, geometry, and fabrication techniques that make the hot wire method suitable for in-pile applications. In particular, efforts were made to minimize the influence of the sensor and maximize fuel hot-wire heating. The probe has a thermocouple-like construction with high temperature resistant materials that remain ductile while resisting transmutation and materials interactions. THWM-NP prototypes were fabricated for both room temperature proof-of-concept evaluations and high temperature testing. Evaluations have been performed jointly by the INL and the French Alternative Energies and Atomic Energy Commission (CEA), both in Idaho Falls (USA) and in Cadarache (France), in the framework of a collaborative program for instrumentation of Material Testing Reactors. Initial tests were conducted on samples with a large range of thermal conductivities and temperatures ranging from 20 °C to 600 °C. Particularly, tests were recently performed on a sample having thermal conductivity and dimensions similar to UO2 and MOX nuclear fuels, in order to validate the ability of this sensor to operate for in-pile characterization of Light Water Reactors fuels. The results of the tests already completed at INL and CEA indicate that the Transient Hot Wire Needle Probe offers an enhanced method for in-pile detection of thermal conductivity.
Large Etch Rate Enhancement by NO-Induced Surface Chemical Reaction during Chemical Dry Etching of Silicon Oxide in F[sub 2] Remote Plasmas (2007)

The surface chemical reaction induced by directly injected (nitric oxide) during the chemical dry etching of silicon oxide layers under the supply of F radicals generated from an remote plasma generator led to the enhancement of etch rate. The large etch rate enhancement was attributed to the effective removal of oxygen atoms from the oxide layer. The direct injection of into the reactor facilitates the formation of various nitrided species through surface chemical reaction of the adsorbed molecules with the silicon oxide layer. The -induced surface reactions, in turn, promote the chemical reaction of the fluorine atoms with the silicon via formation and the resulting generation of desorbing , , and by-products. As a result, the effective removal of oxygen and silicon atoms from the silicon oxide surface significantly enhances the chemical dry etch rate. The process regime for the -induced chemical reaction and etch rate enhancement of the silicon oxide layer was extended at elevated temperature.
Genome-wide mapping of spontaneous genetic alterations in diploid yeast cells (2020)

Genomic alterations including single-base mutations, deletions and duplications, translocations, mitotic recombination events, and chromosome aneuploidy generate genetic diversity. We examined the rates of all of these genetic changes in a diploid strain of <i>Saccharomyces cerevisiae</i> by whole-genome sequencing of many independent isolates (<i>n</i> = 93) subcloned about 100 times in unstressed growth conditions. The most common alterations were point mutations and small (<100 bp) insertion/deletions (<i>n</i> = 1,337) and mitotic recombination events (<i>n</i> = 1,215). The diploid cells of most eukaryotes are heterozygous for many single-nucleotide polymorphisms (SNPs). During mitotic cell divisions, recombination can produce derivatives of these cells that have become homozygous for the polymorphisms, termed loss-of-heterozygosity (LOH) events. LOH events can change the phenotype of the cells and contribute to tumor formation in humans. We observed two types of LOH events: interstitial events (conversions) resulting in a short LOH tract (usually less than 15 kb) and terminal events (mostly cross-overs) in which the LOH tract extends to the end of the chromosome. These two types of LOH events had different distributions, suggesting that they may have initiated by different mechanisms. Based on our results, we present a method of calculating the probability of an LOH event for individual SNPs located throughout the genome. We also identified several hotspots for chromosomal rearrangements (large deletions and duplications). Our results provide insights into the relative importance of different types of genetic alterations produced during vegetative growth.
Induction of T-cell memory by a dendritic cell vaccine: a computational model (2014)

The model is fully described in the article.
Herbicides in the Soil Environment: Linkage between Bioavailability and Microbial Ecology (2011)

Modern agriculture relies heavily on herbicides for the control of weeds in crops and pastures to maximize yields and economical benefits to sustain an increasing world population. The introduction of herbicide-resistant traits in several crops, such as glyphosate-resistant soybean, maize and canola, has further increased herbicide consumption worldwide. The environmental fate of herbicides is a matter of recent concern given that only a small fraction of the chemicals reaches the target organisms. While most herbicides are not intentionally applied onto soil, they can enter the soil environment from direct interception of spray by the soil surface during early season or post-harvest applications, from runoff or leaching of the herbicide from vegetation and/or from dead plant material. This chapter will present aspects of the behavior of herbicides in soils, focusing on soil retention and microbial degradation as main factors controlling persistence. The potential impact of herbicides on non-target soil microbes, on their processes and interactions, will be also discussed. The enormous variety of herbicides commercially available today makes it impossible to review all of them. Thus, this work will focus on some of the herbicides most used in the (semiarid) Pampa region of Argentina and worldwide (i.e., glyphosate, 2,4-dichlorophenoxyacetic acid, atrazine, metsulfuron-methyl), based on our own research data. Adsorption to soil is of critical importance for the regulation of herbicide persistence and mobility throughout the environment because sorption processes control the amount of herbicide present in the soil solution. These processes are dependent on several factors related to soil characteristics such as mineral composition, organic matter content, soil solution chemistry and to chemical characteristics of the herbicide. Soil-bound herbicide or residues are temporarily inactivated, which prevents harmful effects on soil biota but also makes them less bio-available for microbial degradation because most microbial species are not able to utilize herbicides in the sorbed state. Herbicide degradation will be discussed both in terms of their use as carbon and nutrient sources. Most isolated herbicide-degrading microorganisms belong to bacterial species, but fungi are also well-known for their capacity to degrade complex substrates, and may be more important than present isolation approaches have suggested. Differential toxicity of herbicides to soil microorganisms may alter community structure, including potential increases in plant or animal pathogens. Herbicides may also cause changes in microbial community function and concomitant impacts on soil health and ecosystem processes.
A Neuromorphic Computational Primitive for Robust Context-Dependent Decision Making and Context-Dependent Stochastic Computation (2019)

The prefrontal cortex (PFC) plays an important role in complex cognitive computations, including planning and decision making. Although recurrent spiking neural network (SNN) software models of PFC have been successful in reproducing many of its cognitive computational aspects, little attention has been devoted to the question of how such systems can perform with low-resolution parameters and be robust to noise and variability in their input signals and state variables. Here, we present a mixed-signal analog/digital neuromorphic implementation of a state-dependent SNN architecture that addresses these issues by construction. The network relies on synaptic dis-inhibition to ensure robust decision making even in the face of very large variability. Depending on its connectivity, the network can either perform robustly in a deterministic way or exploit the device mismatch and noise to explore stochastically multiple states in constraint satisfaction problems (CSPs). We validate the architecture by mapping it onto a network of spiking neurons in a multi-core mixed-signal neuromorphic system and presenting experimental results for three different examples of CSPs.
Léxico fiscal e instrumentos de política financiera en Derecho Romano (2010)

La denominacion y conformacion de numerosos conceptos e instituciones del moderno derecho financiero, asi como el contenido de un amplio numero de disposiciones especificas en la materia, tienen su precedente historico en la terminologia y regulacion de los pilares basicos que, en las distintas etapas caracterizan el ordenamiento juridico romano, en materia tributaria.
A STUDY OF N-ALLYL-N '-2-PYRIDYLTHIOUREA AND γ-IRRADIATION TREATMENT ON GROWTH, YIELD AND QUALITY OF PEAS AND WHEAT (1995)

Summary. The effect of N-allyl -N´-2-pyridyl-thiourea and γ-irradiation on growth, yield and quality of peas and wheat have been studied. The γ-irradiation of peas with 10000 R led to an increase in yield of green mass and grain of peas and treatment with 15000 R led to a decrease of yield. These changes also correlate with the protein content in the green mass and in the grain. Such an effect was also observed in wheat cv. Sadovo-1 which is very resistant to γ-irradiation and a following treatment with a growth regulator led to an increase in grain yield and in protein content (rich in essential amino acids).
Astrocyte glycogen metabolism is required for neural activity during aglycemia or intense stimulation in mouse white matter (2004)

We tested the hypothesis that inhibiting glycogen degradation accelerates compound action potential (CAP) failure in mouse optic nerve (MON) during aglycemia or high-intensity stimulation. Axon function was assessed as the evoked CAP, and glycogen content was measured biochemically. Isofagomine, a novel inhibitor of central nervous system (CNS) glycogen phosphorylase, significantly increased glycogen content under normoglycemic conditions. When MONs were bathed in artificial cerebrospinal fluid (aCSF) containing 10 mM glucose, the CAP failed 16 min after exposure to glucose-free aCSF. MONs bathed in aCSF plus isofagomine displayed accelerated CAP failure on glucose removal. Similar results were obtained in MONs bathed in 30 mM glucose, which increased baseline glycogen concentration. The ability of isofagomine to increase glycogen content thus was not translated into delayed CAP failure. This is likely due to the inability of the tissue to metabolize glycogen in the presence of isofagomine, highlighting the importance of glycogen in sustaining neural function during aglycemia. The hypothesis that glycogen breakdown supports intense neural activity was tested by blocking glycogen breakdown during periods of high-frequency stimulation. The CAP area declined more rapidly when glycogen metabolism was inhibited by isofagomine, explicitly showing an important physiological role for glycogen metabolism during neural activity.