gebhart/patrepeval huggingface dataset:
Why are Adaptive Methods Good for Attention Models (2020)

While stochastic gradient descent (SGD) is still the \emph{de facto} algorithm in deep learning, adaptive methods like Clipped SGD/Adam have been observed to outperform SGD across important tasks, such as attention models. The settings under which SGD performs poorly in comparison to adaptive methods are not well understood yet. In this paper, we provide empirical and theoretical evidence that a heavy-tailed distribution of the noise in stochastic gradients is one cause of SGD's poor performance. We provide the first tight upper and lower convergence bounds for adaptive gradient methods under heavy-tailed noise. Further, we demonstrate how gradient clipping plays a key role in addressing heavy-tailed gradient noise. Subsequently, we show how clipping can be applied in practice by developing an \emph{adaptive} coordinate-wise clipping algorithm (ACClip) and demonstrate its superior performance on BERT pretraining and finetuning tasks.
[Surgical approach to a leg ulcer in areas of subcutaneous calcinosis]. (1976)

The medical treatment of ulceration of the legs in areas with a subcutaneous plaque of calcinosis is often unsuccessful. The phlebologists then refer the patient to a surgeon. A patient aged 58 years, with a previous history of phlebitis, presented on two successive occasions with ulceration in the area of a large calcification in the lower third of the left leg. Cicatrization was obtained by a surgical treatment. Such surgery must be preceded by local and complete vascular assessment and by appropriate pre-operative care. It consists mainly of ablation of bone sequestration in order to obtain a suitable surface on which to apply thin skin graft in strips. It is often necessary to carry out an internal saphenous crossectomy as well to treat an associated venous insufficiency.
Design of an Area-Efficient One-Dimensional Median Filter (2013)

An area-efficient 1-D median filter based on the sorting network is presented in this brief. It is a word-level filter, storing the samples in the window in descending order according to their values. When a sample enters the window, the oldest sample is removed, and the new sample is inserted in an appropriate position to preserve the sorting of samples. To increase the throughput, the deletion and insertion of samples are performed in one clock cycle, so that the median output is generated at each cycle. The experimental results have shown the improved area efficiency of our design in comparison with previous work.
Internet Denial of Service: Attack and Defense Mechanisms (Radia Perlman Computer Networking and Security) (2004)

Suddenly your Web server becomes unavailable. When you investigate, you realize that a flood of packets is surging into your network. You have just become one of the hundreds of thousands of victims of a denial-of-service attack, a pervasive and growing threat to the Internet. What do you do?Internet Denial of Service sheds light on a complex and fascinating form of computer attack that impacts the confidentiality, integrity, and availability of millions of computers worldwide. It tells the network administrator, corporate CTO, incident responder, and student how DDoS attacks are prepared and executed, how to think about DDoS, and how to arrange computer and network defenses. It also provides a suite of actions that can be taken before, during, and after an attack.Inside, you'll find comprehensive information on the following topics How denial-of-service attacks are waged How to improve your network's resilience to denial-of-service attacks What to do when you are involved in a denial-of-service attack The laws that apply to these attacks and their implications How often denial-of-service attacks occur, how strong they are, and the kinds of damage they can cause Real examples of denial-of-service attacks as experienced by the attacker, victim, and unwitting accomplicesThe authors' extensive experience in handling denial-of-service attacks and researching defense approaches is laid out clearly in practical, detailed terms.
Does the Second-generation Intercalary Humeral Spacer Improve on the First? (2008)

Level IV, therapeutic study. See the Guidelines for Authors for a complete description of levels of evidence.
A Phase II clinical trial of a mixture of plasma-derived factor VIIa and factor X (MC710) in haemophilia patients with inhibitors: haemostatic efficacy, safety and pharmacokinetics/pharmacodynamics (2013)

MC710, a mixture of plasma-derived activated factor VII and factor X at a protein weight ratio of 1:10, is a novel bypassing agent for haemostasis in haemophilia patients with inhibitors. In a Phase II trial, we evaluated the haemostatic efficacy and safety of single doses of MC710, and investigated pharmacokinetic and pharmacodynamic parameters in nine joint bleeding episodes in six male haemophilia patients with inhibitors. This trial was a multi-centre, open-label, non-randomized study of two doses (60 and 120 μg kg(-1) as FVIIa dose), allowing the re-administration of different MC710 dosages to the same subjects. Haemostatic efficacy was assessed by evaluating reduction in pain and swelling, as well as increase in range of motion in a bleeding joint. The results of the study showed that in nine bleeding episodes, seven treatments were rated as 'excellent' or 'effective' according to investigator's rating system of efficacy at 8 h after administration. No serious or severe adverse events were observed after administration; furthermore, measurement of several diagnostic markers revealed no signs or symptoms of disseminated intravascular coagulation (DIC). The haemostatic potential of MC710 was confirmed at doses of 60 and 120 μg kg(-1) in this trial. MC710 is thus expected to be a safe and efficacious novel bypassing agent for controlling bleeding in haemophilia patients with inhibitors.
Identification of Lysine Succinylation Substrates and the Succinylation Regulatory Enzyme CobB in Escherichia coli (2013)

Lysine succinylation is a newly identified protein post-translational modification pathway present in both prokaryotic and eukaryotic cells. However, succinylation substrates and regulatory enzyme(s) remain largely unknown, hindering the biological study of this modification. Here we report the identification of 2,580 bacterial lysine succinylation sites in 670 proteins and 2,803 lysine acetylation (Kac) sites in 782 proteins, representing the first lysine succinylation dataset and the largest Kac dataset in wild-type E. coli. We quantified dynamic changes of the lysine succinylation and Kac substrates in response to high glucose. Our data showed that high-glucose conditions led to more lysine-succinylated proteins and enhanced the abundance of succinyllysine peptides more significantly than Kac peptides, suggesting that glucose has a more profound effect on succinylation than on acetylation. We further identified CobB, a known Sir2-like bacterial lysine deacetylase, as the first prokaryotic desuccinylation enzyme. The identification of bacterial CobB as a bifunctional enzyme with lysine desuccinylation and deacetylation activities suggests that the eukaryotic Kac-regulatory enzymes may have enzymatic activities on various lysine acylations with very different structures. In addition, it is highly likely that lysine succinylation could have unique and more profound regulatory roles in cellular metabolism relative to lysine acetylation under some physiological conditions.
Science to Practice: Can CT Be Performed for Multicolor Molecular Imaging? (2010)

In an animal model of atherosclerosis, it was shown that multispectral computed tomography (CT) used with two radiologic contrast agents (gold and iodine) can depict macrophages, vascularization, and calcification separately and simultaneously during only one scanning examination.
The Impact of Oxytocin on Neurite Outgrowth and Synaptic Proteins in Magel2 -Deficient Mice (2020)

Abstract Oxytocin contributes to the regulation of cytoskeletal and synaptic proteins and could therefore affect the mechanisms of neurodevelopmental disorders, including autism. Both the Prader-Willi syndrome and Schaaf-Yang syndrome exhibit autistic symptoms involving the MAGEL2 gene. Magel2 -deficient mice show a deficit in social behavior that is rescued following postnatal administration of oxytocin. Here, in Magel2 -deficient mice, we showed that the neurite outgrowth of primary cultures of immature hippocampal neurons is reduced. Treatment with oxytocin, but not retinoic acid, reversed this abnormality. In the hippocampus of Magel2 -deficient pups, we further demonstrated that several transcripts of neurite outgrowth-associated proteins, synaptic vesicle proteins, and cell-adhesion molecules are decreased. In the juvenile stage, when neurons are mature, normalization or even overexpression of most of these markers was observed, suggesting a delay in the neuronal maturation of Magel2 -deficient pups. Moreover, we found reduced transcripts of the excitatory postsynaptic marker, Psd95 in the hippocampus and we observed a decrease of PSD95/VGLUT2 colocalization in the hippocampal CA1 and CA3 regions in Magel2 -deficient mice, indicating a defect in glutamatergic synapses. Postnatal administration of oxytocin upregulated postsynaptic transcripts in pups; however, it did not restore the level of markers of glutamatergic synapses in Magel2 -deficient mice. Overall, Magel2 deficiency leads to abnormal neurite outgrowth and reduced glutamatergic synapses during development, suggesting abnormal neuronal maturation. Oxytocin stimulates the expression of numerous genes involved in neurite outgrowth and synapse formation in early development stages. Postnatal oxytocin administration has a strong effect in development that should be considered for certain neuropsychiatric conditions in infancy.
PAK to the future (1999)

Members of the Pak family of serine/threonine kinases serve as targets for the small GTP-binding proteins Cdc42 and Rac and have been implicated in a wide range of biological activities. Recently, some exciting developments help elaborate the regulation of Pak activity and identify downstream signalling targets. These include the discovery of the Cool/Pix and Cat proteins, which modulate Pak signalling, and downstream kinases that modulate the organization of the actin cytoskeleton or gene expression. We present these recent findings and consider how these new regulators and targets could explain some of the cellular effects that have been attributed to Pak family members.
Assembly of Micropatterned Colloidal Gold Thin Films via Microtransfer Molding and Electrophoretic Deposition (2000)

Ultra-thin micropatterned colloidal gold films on conducting platforms have been fabricated by a combination of microtransfer molding and electrophoretic deposition techniques. The nano- and microstructure of the film were characterized by atomic force microscopy, scanning electron microscopy, and energy dispersive X-ray spectroscopy and the optical properties were examined by UV-vis spectroscopy. It is shown that these patterned films are capable of functioning as transmissive 2D optical diffraction gratings.
Preparation of a volatile derivative of taurine and application to gas chromatographic determination of urinary taurine. (1989)

A new volatile derivative of taurine, N-isobutoxycarbonyltaurine methyl ester (methyl 2-(N-isobutoxycarbonylamino)ethanesulfonate), was prepared by a three-step procedure for the gas chromatographic determination of taurine in urine. First, taurine was converted to its silver salt by reaction with silver oxide; next the silver salt was reacted with isobutyl chloroformate to form the N-isobutoxycarbonyl derivative, and finally the derivative was reacted with methyl iodide to form N-isobutoxycarbonyltaurine methyl ester. The volatile derivative was analyzed by gas chromatography using a column of 3% OV-101 on Chromosorb W. When methyl 3-(N-isobutoxycarbonylamino) propanesulfonate was used as an internal standard, the calibration curve was linear between 0.5 and 5.0 mumol of taurine/ml and showed a good reproducibility. This method was applied to the determination of taurine in human urine. Recovery was 98.6 +/- 5.2%, when 1.25 to 5.0 mumol/ml of taurine was added to human urine.
Normally off Al<sub>2</sub>O<sub>3</sub>&#x2013;AlGaN/GaN MIS-HEMT With Transparent Gate Electrode for Gate Degradation Investigation (2015)

Al <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sub> O <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sub> –AlGaN/GaN metal–insulator–semiconductor high-electron-mobility transistors (MIS-HEMTs) featuring indium tin oxide transparent gate electrode are fabricated for the purpose of evaluating the gate reliability. The transparent gate electrode allows electroluminescence (EL) observation in the region directly under the gate, which cannot be performed in conventional MIS-HEMTs with opaque gate electrode. Normally OFF transparent-gate MIS-HEMTs were realized by implanting fluorine ions into the AlGaN barrier prior to the deposition of Al <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sub> O <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sub> . The dependence of EL on bias condition was investigated with the color of EL resolved by filters. Gate dielectric degradation in MIS-HEMTs was induced by OFF state drain-bias stress, as detected by the increased gate leakage current. Location of the gate degradation could be clearly identified by EL imaging through the transparent gate. From the EL image, the passivation layer under the overhang of T-shaped gate is found to be vulnerable to OFF-state stress, which is confirmed by simulation.
Rubber–fibre composite modelling and its influence on fatigue damage assessment (2020)

Abstract A novel multiaxial energy‐based approach is presented and used to demonstrate the influence of different finite element (FE) modelling techniques on the prediction of the fatigue life of a rubber composite with long oriented fibres. It is shown that the simplest modelling methods using 2‐D elements with rebar layers, layered 2‐D elements or layered 3‐D elements do not allow for a precise determination of the critical location and damage value. In contrast, modelling methods with 3‐D matrix and discrete reinforcement provide much better results. The predicted critical location corresponds to the measured one, although the predicted fatigue life still differs from the measured results. The most complex microscopic modelling method shows the best agreement between the predicted and measured fatigue life. Because microscopic modelling is not suitable for modelling larger products made of rubber–fibre composite, it is also noted that modelling techniques with 3‐D matrix and discrete reinforcing elements can be used with the same accuracy if the fatigue life curve is obtained from measurements on the specimens made of composite material rather than the specimens made of the critical base material (rubber).
Ultrafast stretched-pulse fiber laser mode-locked by carbon nanotubes (2010)

Ultrafast fiber sources having short pulses, broad bandwidth, high energy, and low amplitude fluctuations have widespread applications. Stretched-pulse fiber lasers, incorporating segments of normal and anomalous dispersion fibers, are a preferred means to generate such pulses. We realize a stretched-pulse fiber laser based on a nanotube saturable absorber, with 113 fs pulses, 33.5 nm spectral width and ˜0.07% amplitude fluctuation, outperforming current nanotube-based designs.
Density and distribution of a brown bear (Ursus arctos) population within the Caucasus biodiversity hotspot (2018)

Population declines and extirpations of large mammalian carnivores are major concerns for global biodiversity conservation. Many large carnivores are vulnerable to conflict with humans and attract conservation attention for their flagship appeal and ecological importance. Coexisting with carnivores requires an understanding of carnivore distribution and abundance relative to human activities and disturbances. Such knowledge is often hindered by the rare and elusive nature of carnivores and the lack of systematic ecological surveys in biodiverse regions facing high levels of threat. The Caucasus Ecoregion is one such biodiversity hotspot harboring several threatened mammal species for which there is a paucity of reliable data, including brown bears (Ursus arctos). Caucasus brown bear populations have declined significantly from historical times and may be isolated and vulnerable to disturbance from development activities such as mining, as well as increasing hunting pressure. To inform land-use planning and bear conservation in the Caucasus Ecoregion, we conducted systematic surveys in May-October 2015 in the foothills of the Caucasus Mountains within the Vayots Dzor region of Armenia. We used noninvasive genetic sampling, camera trapping, and statistical models that account for imperfect detection to estimate density and distribution of the bear population in the 1,000-km 2 study area. Across 34 sampling sites, we obtained 3,163 camera-trap photos of brown bears and genotyped 28 individual bears (7 males and 21 females). Spatially explicit capture-recapture models revealed an unexpectedly high density of bears (59.4/1,000 km 2 ; females = 44.6, 95% confidence interval, CI = 25.4-78.4; males = 14.8, 95% CI = 6.6-34.0), and multi-method occupancy models indicated that bears were distributed across most of the study area ( = 0.85; SE = 0.07). These results provide robust evidence that a significant population of brown bears persists in Armenia's Vayots Dzor region, despite a history of hunting and habitat loss that have driven declines in brown bear populations throughout much of the Caucasus Ecoregion. Continued persistence of this flagship species may be threatened by mining, poaching, and other anthropogenic pressures in the region, underscoring the urgent need for strategic conservation planning, impact mitigation, and expanded ecological monitoring within this biodiversity hotspot.
1-Hydroxyalkane-1,1-diyldiphosphonates as potent chelating agents for metal ions. Potentiometric and spectroscopic studies of copper(II) co-ordination (1996)

Potentiometric and spectroscopic (EPR and absorption) studies have shown that two phosphonic groups bound to the same carbon atom serve as a very powerful binding site for Cu2+ ion in spite of the very high negative charge centred on these groups. The steric effects as well as a high negative charge enforce unusual geometries around the metal ion and the formation of 1:2 complexes is less favourable. These features of the diphosphonic moiety mean that alkoxo-bridged dimer formation via the adjacent hydroxyl groups is less likely.
Parallel Solution of Very Large Sparse Linear Programs (1990)

Abstract : The principal area of research was the parallel solution of large sparse linear programs. A number of new algorithms with increased performance were developed and tested for special cases.
Triblock Colloids for Directed Self-Assembly (2011)

Methods for functionalizing micrometer-sized colloidal spheres with three or more zones of chemical functionality (ABA or ABC) are described. To produce ABA triblock colloids, we functionalized the north pole, south pole, and equator to produce what we call X, Y, and K functionality according to the number of allowed nearest neighbors and their spatial arrangements. These synthesis methods allowed targeting of various lattice structures whose bonding between neighboring particles in liquid suspension was visualized in situ by optical microscopy.
Vascular action of natural vasopressin-like peptides in isolated rat tail artery. (1992)

The literature data regarding the vasoconstriction potency of natural vasopressin-like peptides are contradictory. The cumulative concentration-response curve for arginine-vasopressin (AVP), lysine-vasopressin (LVP), arginine-vasotocin (AVT), lysine-vasotocin (LVT) and phenypressin (PHP) on the isolated rat tail artery was determined. The potency rank of these peptides on the vascular smooth muscle of the rat tail artery was the following: AVP greater than LVP greater than AVT = LVT greater than PHP. The results are discussed in comparison to the data in the literature.
Generalized Methodology for Estimating Stress-Dependent Properties in a Tight Gas Reservoir and Extension to Drill-Cuttings Data (2018)

Summary The volume of hydrocarbons contained in tight petroleum reservoirs is immense. Thus, their development is crucial to satisfy the worldwide energy demand. A critical aspect for the development of these formations is the stress dependency of rock properties. As pore pressure changes, porosity, permeability, and compressibility of both matrix and natural fractures in tight reservoirs also change, affecting the wells’ production behavior. A practical problem in the estimation of stress-dependent properties is that the amount of core data available to perform the corresponding studies in tight formations is generally scarce. Under these circumstances, drill cuttings can be used to obtain this information. These observations lead to the key objective of this paper: to develop a reliable approach for estimating stress-dependent properties through the introduction of an innovative methodology that quantifies changes in properties of tight reservoirs and how to extend this methodology in drill cuttings. The model developed is based on the relationship between the cube root of normalized permeability and the logarithm of net confining stress defined as confining pressure minus pore pressure applied on the rock. An empirical exponent α is introduced to fit the experimental data from confining tests conducted on both vertical and horizontal core samples. This exponent allows the development of an equation that works independently of the initial net confining stress, which is the main limitation of the models already available in the literature. It is our experience that, in many instances, laboratory tests are run at specific values of net confining stress that do not necessarily match the current stress of the reservoir. The correlation proposed in this paper is valuable because it provides a tool that allows correcting the laboratory results to the appropriate net confining stresses in the reservoir. A statistical analysis is performed to verify the appropriateness of the proposed model for the prediction of rock properties as a function of net confining stress. It is shown that current formulations are particular cases of the proposed model based on the results obtained for the empirical exponent α. Semilog cross-plots of the cube root of normalized permeability versus the net confining stress using core laboratory data corroborate the robustness of the proposed method. The application of the method with drill cuttings is also demonstrated. It is concluded that the proposed method provides a more accurate methodology for estimating stress-sensitive properties of rocks in tight formations, which are usually naturally fractured, such as the Nikanassin formation analyzed in this work. Porosity, permeability, and compressibility of tight formations are estimated by following the generalized methodology proposed in this study.
Digital electronic communication between ICU ventilators and computers and printers. (1992)

We recommend an optimal algorithm for automated respiratory care charting that has been suggested. Sampling frequency: Sample data from the ventilator every 10 seconds. Ventilator-setting changes: Report every new setting if change lasts more than 3 minutes. Measured respiratory care data: Filter raw MIB-collected data with a 3-minute moving-median filter. Report one filtered value every hour for each variable. In addition, use a threshold table (Table 3) to define significant events. Report changes that remain above threshold more than 3 minutes. Report all measured respiratory-care data 1 minute following any ventilator-mode changes.