gebhart/patrepeval huggingface dataset:
When Can Self-Attention Be Replaced by Feed Forward Layers? (2020)

Recently, self-attention models such as Transformers have given competitive results compared to recurrent neural network systems in speech recognition. The key factor for the outstanding performance of self-attention models is their ability to capture temporal relationships without being limited by the distance between two related events. However, we note that the range of the learned context progressively increases from the lower to upper self-attention layers, whilst acoustic events often happen within short time spans in a left-to-right order. This leads to a question: for speech recognition, is a global view of the entire sequence still important for the upper self-attention layers in the encoder of Transformers? To investigate this, we replace these self-attention layers with feed forward layers. In our speech recognition experiments (Wall Street Journal and Switchboard), we indeed observe an interesting result: replacing the upper self-attention layers in the encoder with feed forward layers leads to no performance drop, and even minor gains. Our experiments offer insights to how self-attention layers process the speech signal, leading to the conclusion that the lower self-attention layers of the encoder encode a sufficiently wide range of inputs, hence learning further contextual information in the upper layers is unnecessary.
Photochemical Selective Activation for Electroless Metal Deposition on Nonconductors (1980)

The photochemical methods for selective activation of nonconductors for electroless metal deposition have been classified in this review on the basis of kinetic scheme involved. There are three general kinetic schemes for the formation of catalytic metallic nuclei on nonconductors: photoelectrochemical, photoelectron, and intramolecular photoreduction. Photoelectrochemical scheme involves a photochemical reaction which is followed by an electrochemical reaction. The photochemical reaction is used to produce or deactivate the reducing agent. Catalytic metallic nuclei are formed in the subsequent electrochemical reaction. In the photoelectron method, electrons necessary for the formation of catalytic metallic nuclei M from metallic cations M+n are generated in the direct absorption process of a photon by a semiconductor crystal, which results in the generation of an electron and a hole. In the intramolecular photoreduction kinetic scheme catalytic metallic nuclei are formed in the intramolecular ligand to metal electron transfer process. This review surveys fundamental photochemical principles and discusses problems and prospects of the above processes.
Expression of Costimulatory Molecule CD40 in Murine Heart With Acute Myocarditis and Reduction of Inflammation by Treatment With Anti-CD40L/B7-1 Monoclonal Antibodies (1998)

Evidence has accumulated that antigen-specific T cells infiltrate the heart and play an important role in the pathogenesis of viral myocarditis. Costimulatory molecules such as B7s and CD40 expressed on antigen-presenting cells are known to play a critical role for antigen-specific T-cell activation to occur. To investigate the role for a costimulatory molecule, CD40, in the development of acute viral myocarditis, we first analyzed the expression of CD40 in the hearts of mice with acute viral myocarditis induced by Coxsackievirus B3. We also evaluated the induction of CD40 in cultured cardiac myocytes treated with interferon gamma in vitro. Second, we analyzed the cytokine production by cultured cardiac myocytes by stimulation with anti-CD40 monoclonal antibody (mAb) in vitro. Third, we examined the effects of in vivo administration of anti-CD40L/B7-1 mAbs on the development of acute viral myocarditis. We found that Coxsackievirus B3-induced murine acute myocarditis results in enhanced expression of CD40 on cardiac myocytes. The expression of CD40 on cardiac myocytes could be induced by interferon gamma in vitro. We also found that the production of interleukin-6 by cardiac myocytes was stimulated with anti-CD40 mAb and that in vivo anti-CD40L/B7-1 mAb treatment significantly decreased the myocardial inflammation. Our findings strongly suggest that CD40 plays an important role in the development of acute viral myocarditis and raise the possibility of immunotherapy with anti-CD40L/B7-1 mAbs to prevent T cell-mediated myocardial damage in viral myocarditis.
An Evaluation and Redesign of the Conflict Prediction and Trial Planning Planview Graphical User Interface (1998)

The Planview Graphical User Interface (PGUI) is the primary display of air traffic for the Conflict Prediction and Trial Planning, function of the Center TRACON Automation System. The PGUI displays air traffic information that assists the user in making decisions related to conflict detection, conflict resolution, and traffic flow management. The intent of this document is to outline the human factors issues related to the design of the conflict prediction and trial planning portions of the PGUI, document all human factors related design changes made to the PGUI from December 1996 to September 1997, and outline future plans for the ongoing PGUI design.
The in-situ analysis of lipsticks by surface enhanced resonance Raman scattering (1998)

The use of surface enhanced resonance Raman scattering (SERRS) spectroscopy is reported for the in-situ characterization of chromophores in lipstick smears on glass and cotton surfaces. A surfactant is required to obtain SERRS spectra of the dyes and pigments in these waxy samples. Of the surfactants tested, poly(L-lysine) is preferred for this purpose and serves a dual function, since it also produces the required aggregation of the silver colloid. The method is quick, effective and sensitive, and with the silver colloid distributed on the surfaces tested, no appreciable background fluorescence from the substrates is detected. For six commercial lipstick samples examined by this in-situ SERRS method, discrimination between the samples could be achieved and it was possible to identify some of the individual pigments present, thus indicating the potential of the technique for forensic and quality control applications.
Contribution to the Morphological, Microscopic, and Chemical Analysis of Tape Slags in the Reconstruction of Ironworking Activities (2007)

If the different works produced in a smithing workshop are well known, it is difficult to identify them only from the analyses from the wastes. However, these wastes are generally the only remnants that can be found during excavation of archaeological ironworkshops. To obtain the maximum of informations of these wastes, it is necessary to propose a rigorous methodology, from the sampling in the archaeological site to chemical analyses in laboratory. The quantification and representativeness notions are very important to qualify and quantify the works operated by the blacksmith, to determine the nature of used materials and to estimate the minimal quantity of worked iron. This study, although targeted on the tape slags, shows that it is necessary to take into account the totality of the wastes found in the archaeological smithy during the archeaometallurgical studies for a good comprehension of this smithy functioning. The Puy-de-Grâce example (France) allows documenting the contribution of this methodology.
Design and implementation of two key image processing techniques for CMOS image sensor based on fpga (2008)

Automatic white balance and color filter array interpolation are two important function of image signal processor for CMOS image sensor. This paper describes the designs and implementations of new automatic white balance method and color interpolation method on FPGA. This white balance method can effectively get the better of the defects of gray world and gray world-retinex methods by calculating the average deviation values of Cr and Cb. This color interpolation method can greatly reduce the artifacts causing by interpolating across edges with comparing the differences of neighboring pixels with the predefined thresholds. These two methods have been realized on Altera¿s FPGA EP1C12Q240C8. Experimental results show that the white balance method can obtain better image quality than gray world and gray world-retinex methods, and the color interpolation method can get high PSNR value. They can be good candidate for VLSI implementation.
Smile detection by boosting pixel differences (2011)

Smile detection in face images captured in unconstrained real-world scenarios is an interesting problem with many potential applications. This paper presents an efficient approach to smile detection, in which the intensity differences between pixels in the grayscale face images are used as features. We adopt AdaBoost to choose and combine weak classifiers based on intensity differences to form a strong classifier. Experiments show that our approach has similar accuracy to the state-of-the-art method but is significantly faster. Our approach provides 85% accuracy by examining 20 pairs of pixels and 88% accuracy with 100 pairs of pixels. We match the accuracy of the Gabor-feature-based support vector machine using as few as 350 pairs of pixels.
Extending the effective bandwidth concept to networks with priority classes (1998)

ATM switches are now being designed to allow connections to be partitioned into priority classes, with packets being emitted for higher priority classes before packets are emitted for lower priority classes. Accordingly, allocation of network resources based on different priority levels is becoming a realistic possibility. Thus, we need new methods for connection admission control and capacity planning that take account of the priority structure. We show that the notion of effective bandwidths can be used for these purposes when appropriately extended. The key is to have admissibility of a set of connections determined by a linear constraint for each priority level, involving a performance criterion for each priority level. For this purpose, connections are assigned more than one effective bandwidth, one for its own priority level and one for each lower priority level. Candidate effective bandwidths for each priority level can be determined by using previous methods associated with the first-in first-out discipline. The proposed effective bandwidth structure makes it possible to apply product-form stochastic loss network models to perform dimensioning.
Un bon tiers des norvégiens font confiance aux populistes (2011)

Pierre Reman (UCL) est specialiste des modeles sociaux scandinaves. Il dresse le portrait de la societe norvegienne. Un pays ideal sur le papier, dont l’image est ecornee par la tuerie d’Anders Breivik. Le Programme des Nations unies pour le developpement (Pnud) classe regulierement la Norvege parmi les Etats ou il fait bon vivre. Pour quelles raisons ?
Fourier transform analysis for periodic combinatorial arrays (2004)

Earlier we introduced a combinatorial synthetic method that employs one-dimensional supports ranging from cotton threads to optical fibres. This method affords parallel synthesis and availability of the complete library history ideally yielding identification of all library members. Moreover, the synthesized compound library will be arrayed periodically on the linear support, leading to assay data that also reflect this periodicity. This fact invites an analysis using the Fourier transform. Here we demonstrate how this approach presents n-dimensional data in a comprehensible manner and facilitates the identification of trends within the library. Carrying out an inverse Fourier transform on subsets of the data allows for the assignment of fitness profiles for each reactant and combination of reactants in the library. The tools should assist in drawing conclusions based on the diversity of library response as opposed to individual library members.
Interlaboratory Evaluation of a New Reverse Transcriptase Polymerase Chain Reaction–Based Enzyme-Linked Immunosorbent Assay for the Detection of Circulating Melanoma Cells: A Multicenter Study of the Dermatologic Cooperative Oncology Group (2001)

Reverse transcriptase-PCR ELISA has a high sensitivity and specificity for the detection of tyrosinase mRNA in peripheral blood cells. The low interlaboratory reproducibility for the detection of tumor cells in blood samples of melanoma patients, however, raises the question of relevance of this assay for clinical use.
Turbine Overspeed Control Behaviour (1981)

In recent years various power system failures have resulted in major power failures (black-outs). A modern system of turbine control can do much to avoid the serious results of such failures. Apart from a rapid system of speed or load-frequency control, it requires certain supplementary elements, such as HP and LP bypass and acceleration limiter. With such a control system it is possible to contend with the most difficult of all transients, i.e. load shedding to house load.
Prediction of Enhanced Catalytic Activity for Hydrogen Evolution Reaction in Janus Transition Metal Dichalcogenides (2018)

Significant efforts have been made in improving the hydrogen evolution reaction (HER) catalytic activity in transition metal dichalcogenides (TMDs), which are promising nonprecious catalysts. However, previous attempts have exploited possible solutions to activate the inert basal plane, with little improvement. Among them, the most successful modification requires a careful manipulation of vacancy concentration and strain simultaneously. To fully realize the promise of TMD catalysts for HER in an easier and more effective way, a new means in tuning the HER catalytic activity is needed. Herein, we propose exploiting the inherent structural asymmetry in the recently synthesized family of Janus TMDs as a new means to stimulate HER activity. We report a density functional theory (DFT) study of various Janus TMD monolayers as HER catalysts, and identify the WSSe system as a promising candidate, where the basal plane can be activated without large applied tensile strains and in the absence of significant density of vacancies. We predict that it is possible to realize a strain-free Janus TMD-based catalyst that can readily provide promising intrinsic HER catalytic performance. The calculated density of states and electronic structures reveal that the introduction of in-gap states and a shift in the Fermi level in hydrogen adsorbed systems due to Janus asymmetry is the origin of enhanced HER activity. Our results should pave the way to design high-performance and easy-accessible TMD-based HER catalysts.
A supportive environment for the management of software testing (1992)

This dissertation describes research undertaken on the management of software testing. A support environment for the management of software testing, entitled SEMST, is presented. The research approach involves the investigation of software configuration management and its application to the testing process; the study of software testing techniques and methods; the exploration of the significance of software testing management; a survey of related work; the development and analysis of the requirements for SEMST; its implementation and an assessment. The current version of SEMST is a prototype built on the top of Unix and RCS on a Sun workstation. It is able to maintain all versions of specifications, test cases and programs, as well as to manage the relationships between these components.
Let the tree Bloom (2013)

Routing in battery-operated wireless networks is challenging, posing a tradeoff between energy and latency. Previous work has shown that opportunistic routing can achieve low-latency data collection in duty-cycled networks. However, applications are now considered where nodes are not only periodic data sources, but rather addressable end points generating traffic with arbitrary patterns.
Serologic detection of infection with cagA+ Helicobacter pylori strains (1995)

Approximately 60% of Helicobacter pylori isolates possess the cagA gene and express its 120- to 140-kDa product (CagA). In this study, the cagA gene was detected in H. pylori isolates from 26 (81.3%) of 32 patients with duodenal ulcers (DU), 17 (68.0%) of 25 patients with gastric ulcers, and 23 (59.0%) of 39 patients with nonulcer dyspepsia (NUD). By Western blotting (immunoblotting) with antiserum to CagA, in vitro CagA expression was demonstrated for 95.5% of cagA+ strains compared with 0% of strains lacking cagA. Sera from patients infected with cagA+ strains (n = 66) reacted with recombinant CagA in an enzyme-linked immunosorbent assay to a significantly greater extent than either sera from patients infected with strains lacking cagA (n = 30) or sera from uninfected persons (n = 25) (P < 0.001). A strain lacking cagA was isolated from eight patients who had serum immunoglobulin G antibodies to CagA, which suggests that these patients were infected with multiple strains. Serum immunoglobulin G antibodies to CagA were present in 87.5, 76.0, and 56.4% of patients with DU, gastric ulcers, and NUD, respectively (odds ratio, 5.41; 95% confidence interval, 1.44 to 24.72; P = 0.004 [DU versus NUD]). These data demonstrate an association between infection with cagA+ H. pylori and the presence of duodenal ulceration and indicate that serologic testing is a sensitive method for detecting infection with cagA+ strains.
Preparation and swelling properties of crosslinked sodium polyacrylate (2001)

Abstract Crosslinked sodium polyacrylate as a superabsorbent was prepared by inverse suspension polymerization with cyclohexane as the continuous phase and sorbite anhydride monostearic acid ester (span‐80) as the dispersant. The crosslinking degree was regulated by NaOH. The distilled water absorbency (WA) of the polymer gel was about 700 times its own weight if the gel was allowed to swell at room temperature for 24 h. WA under various conditions, such as varying pH, temperature, reaction time, neutralization, and cyclohexane concentration, was investigated and optimized. Our results revealed that the optimal reaction conditions were 55°C, 25‐min reaction time, 85% neutralization, and a 7:1 (v/v) cyclohexane/monomer ratio. Our results also showed that such synthesized polymer gels have a high WA and a good water‐retention ability under different pressures. © 2001 John Wiley & Sons, Inc. J Appl Polym Sci 82: 1515–1520, 2001
Sink Metabolism in Tomato Fruit (1988)

Carbohydrate composition and key enzymes involved in carbohydrate metabolism were assayed throughout development of Lycopersicon esculentum and L. chmielewskii fruit. Translocation and assimilation of asymmetric sucrose and total soluble solids content was also determined in both species. The data showed that L. chmielewskii accumulated less starch than L. esculentum, and this was related to a lower level of ADPglucose pyrophosphorylase and a higher level of phosphorylase in L. chmielewskii. L. chmielewskii accumulated sucrose throughout fruit development rather than glucose and fructose which were accumulated by L. esculentum. A low level of invertase and nondetectable levels of sucrose synthase were associated with the high level of sucrose in L. chmielewskii. Translocation and assimilation of asymmetrically labeled sucrose indicated that sucrose accumulated in L. chmielewskii fruit was imported and stored directly in the fruit without intervening metabolism along the translocation path. In contrast, the relatively low level of radioactive sucrose found in L. esculentum fruit appeared to arise from hydrolysis and resynthesis of sucrose. The possible relationship between the level of soluble solids and differences in carbohydrate metabolism in sink tissue of the two species is discussed.
Avastin Enhances Photodynamic Therapy Treatment of Kaposi's Sarcoma in a Mouse Tumor Model (2006)

The goal of the current study was to determine if the antiangiogenic drug Avastin would improve the effectiveness of Photodynamic Therapy (PDT) in a xenograft model of Kaposi's sarcoma (KS). Human KS-Imm tumors transplanted in nude mice were treated with Photofrin-mediated PDT. Expression parameters of proangiogenic molecules were documented and the tumoricidal effectiveness of PDT combined with the VEGF inhibitor Avastin was determined. PDT induced increased expression of HIF-1alpha, VEGF, PGE2, TNF-alpha, and IL-1beta within treated KS tumor tissue. Significant overexpression of KS cell derived human VEGF and to a lesser extent overexpression of host cell derived mouse VEGF were detected within treated tumors. Combining PDT with Avastin resulted in a significant increase in the long-term responsiveness of treated KS tumors when compared to individual treatments. These results demonstrate for the first time that Avastin can improve PDT treatment effectiveness and suggest that VEGF inhibitors may ameliorate the clinical efficacy of PDT.
Silicon Substrate Engineered High-Voltage High-Temperature GaN-DHFETs (2013)

Low-cost GaN-on-Si-based transistors are targeted to function at high ambient temperatures. With this perspective, it is aimed to evaluate the high-temperature (HT) capabilities of GaN-on-Si double-heterostructure field-effect transistors. It is highlighted that HT device operation degrades both ON and OFF states that are directly related to the increase in the on-resistance and the decrease in device breakdown voltage; 2-DEG mobility drops with increasing temperature and is responsible for ON-state degradation. Regarding the OFF-state operation, it is observed that at low-voltage operation and with increasing temperature, there is an increase in the OFF-state leakage current because of thermal-assisted electrical conduction across the III-N layers and various interfaces. The main breakdown limiting mechanism at any temperature is, however, buffer leakage along the AlN/Si interface. Because this parasitic conduction, a negative temperature coefficient of breakdown voltage of approximately -1 V/°C is observed. For devices after Si removal, the leakage across the AlN/Si interface is interrupted and therefore HT OFF-state characteristics show high potential to be used at high operating voltage. A breakdown voltage as high as ~1800V is observed after Si removal compared with ~500 V with Si at 150°C.
[Preoperative spinal localization by the needle and marker wire technic]. (1986)

Surgeons are increasingly requested to resect dorsal disk herniation. The methods for pre- or peroperative localization of such lesions require a precision that is difficult to obtain with the usual methods. We suggest the needle and marker wire technique, a preoperative invasive technique the accuracy of which has been proven for preoperative localization of non-palpable breast lesions.
Physical Fitness and Mitochondrial Respiratory Capacity in Horse Skeletal Muscle (2012)

The scope of mitochondrial density-dependent OXPHOS capacity and the density-independent (qualitative) increase of CI-linked respiratory capacity with increased fitness open up new perspectives of integrative and comparative mitochondrial respiratory physiology.