nils-herrmann/clean_scirepeval huggingface dataset:
Actor-Critic Reinforcement Learning with Simultaneous Human Control and Feedback

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework for online cooperation between humans and reinforcement learning agents. In many humanmachine interaction settings, there is a growing gap between the degrees-of-freedom of complex semi-autonomous systems and the number of human control channels. Simple human control and feedback mechanisms are required to close this gap and allow for better collaboration between humans and machines on complex tasks. To better inform the design of concurrent control and feedback interfaces, we present experimental results from a human-robot collaborative domain wherein the human must simultaneously deliver both control and feedback signals to interactively train an actor-critic reinforcement learning robot. We compare three experimental conditions: 1) human delivered control signals, 2) reward-shaping feedback signals, and 3) simultaneous control and feedback. Our results suggest that subjects provide less feedback when simultaneously delivering feedback and control signals and that control signal quality is not significantly diminished. Our data suggest that subjects may also modify when and how they provide feedback. Through algorithmic development and tuning informed by this study, we expect semi-autonomous actions of robotic agents can be better shaped by human feedback, allowing for seamless collaboration and improved performance in difficult interactive domains. University of Alberta, Dep. of Computing Science, Edmonton, Canada University of Alberta, Deps. of Medicine and Computing Science, Edmonton, Alberta, Canada. Correspondence to: Kory Mathewson <korym@ualberta.ca>. Under review for the 34 th International Conference on Machine Learning, Sydney, Australia, 2017.  W&CP.
How does oxygen inhibit central metabolism in the obligate anaerobe Bacteroides thetaiotaomicron.

The molecular basis of obligate anaerobiosis is not well established. Bacteroides thetaiotaomicron is an opportunistic pathogen that cannot grow in fully aerobic habitats. Because microbial niches reflect features of energy-producing strategies, we suspected that aeration would interfere with its central metabolism. In anaerobic medium, this bacterium fermented carbohydrates to a mixture of succinate, propionate and acetate. When cultures were exposed to air, the formation of succinate and propionate ceased abruptly. In vitro analysis demonstrated that the fumarase of the succinate-propionate pathway contains an iron-sulphur cluster that is sensitive to superoxide. In vivo, fumarase activity fell to < 5% when cells were aerated; virtually all activity was recovered after extracts were chemically treated to rebuild iron-sulphur clusters. Aeration minimally affected the remainder of this pathway. However, aeration reduced pyruvate:ferredoxin oxidoreductase (PFOR), the first enzyme in the acetate fermentation branch, to 3% of its anaerobic activity. This cluster-containing enzyme was damaged in vitro by molecular oxygen but not by superoxide. Thus, aerobic growth is precluded by the vulnerability of these iron-sulphur cluster enzymes to oxidation. Importantly, both enzymes were maintained in a stable, inactive form for long periods in aerobic cells; they were then rapidly repaired when the bacterium was returned to anaerobic medium. This result explains how this pathogen can easily recover from occasional exposure to oxygen.
Potential adverse events of endosseous dental implants penetrating the maxillary sinus: long-term clinical evaluation.

The aim of this study was to evaluate the nature and incidence of long-term maxillary sinus adverse events related to endosseous implant placement with protrusion into the maxillary sinus.



Retrospective cohort study.



All patients who underwent placement of endosseous dental implants with clinical evidence of implant penetration into the maxillary sinus with membrane perforation were included in this study. Only patients with a minimum follow-up of 5 years after implant placement were included in this study. Maxillary sinus assessment was both clinical and radiological.



Eighty-three implants with sinus membrane perforation in 70 patients met the study's inclusion criteria. Mean age was 65.96 years ± 14.23. Twelve patients had more than one implant penetrating the maxillary sinus, and seven of them had bilateral sinus perforation. Estimated implant penetration was ≤ 3 mm in all cases. The average clinical and radiological follow-up was 9.98 years ± 3.74 (range 60-243 months). At the follow-up appointments, there were no clinical or radiological signs of sinusitis in any patient.



This long-term study, spreading over a period of up to 20 years, indicates that no sinus complication was observed following implant penetration into the maxillary sinus. Furthermore, absence of occurrence of such complications is related to the maintenance of successful osseointegration. A contrario, and in the presence of an acute or chronic maxillary sinusitis, the differential diagnosis must always consider other potential odontogenic and nonodontogenic etiologies.
Long-term Outcome after Isolated Endarterectomy of the Femoral Bifurcation

Long-term outcome after endarterectomy of the femoral bifurcation has not been widely investigated, and the aim of this study was to assess its late results from a community-wide perspective. Between 1983 and 2006 111 isolated endarterectomies of the common femoral artery and/or the proximal part of the superficial femoral artery or profunda femoris were performed in 90 patients at the Oulu University Hospital, Oulu, Finland. A total of 77 limbs were treated surgically for claudication and 34 others for critical limb ischemia. Angiographic findings of 100 extremities were evaluated. The in-hospital mortality rate was 1.8%. The mean follow-up period was 5.9 years. At 5-, 10-, and 15-year follow-up the overall survival was 60.5%, 32.7%, and 17.6%, respectively (S.E < 0.05). A C-reactive protein value ≥ 10 mg/l was predictive of poor late survival (p = 0.008). Limb salvage rates after isolated femoral endarterectomy at 5-, 10-, and 15-year follow-up were 93.7%, 93.7%, and 85.2%, respectively (S.E. < 0.08). Critical limb ischemia (p = 0.006) and current smoking (p = 0.027) were independent predictors of major lower limb amputation. A total of 41 limbs were subjected to ipsilateral vascular procedures after femoral endarterectomy, only one of which was re-endarterectomy. Freedom from any ipsilateral revascularization procedure at 5-, 10-, and 15-year follow-up was calculated at 68.0%, 50.6%, and 42.5%, respectively (S.E. < 0.08). The overall linearized rate of reintervention on the ipsilateral limb was 0.16 ± 0.44/year. The linearized rate among patients who had any ipsilateral vascular reintervention was 0.43 ± 0.66/year. Isolated femoral endarterectomy is a rather low-risk and durable procedure. However, a significant number of reinterventions distal or proximal to the endarterectomized site can be expected in one third of patients.
Multi-modal Convolutional Neural Networks for Activity Recognition

Convolutional neural network (CNN), which comprises one or more convolutional and pooling layers followed by one or more fully-connected layers, has gained popularity due to its ability to learn fruitful representations from images or speeches, capturing local dependency and slight-distortion invariance. CNN has recently been applied to the problem of activity recognition, where 1D kernels are applied to capture local dependency over time in a series of observations measured at inertial sensors (3-axis accelerometers and gyroscopes). In this paper we present a multi-modal CNN where we use 2D kernels in both convolutional and pooling layers, to capture local dependency over time as well as spatial dependency over sensors. Experiments on benchmark datasets demonstrate the high performance of our multi-modal CNN, compared to several state of the art methods.
New Synchronization Algorithm Based on Delta Synchronization for Compressed Files in the Mobile Cloud Environment

The fast growing market of mobile device adoption and cloud computing has led to exploitation of mobile devices utilizing cloud services. One major challenge facing the usage of mobile devices in the cloud environment is mobile synchronization to the cloud, e.g., synchronizing contacts, text messages, images, and videos. Owing to the expected high volume of traffic and high time complexity required for synchronization, an appropriate synchronization algorithm needs to be developed. Delta synchronization is one method of synchronizing compressed files that requires uploading the whole file, even when no changes were made or if it was only partially changed. In the present study, we proposed an algorithm, based on Delta synchronization, to solve the problem of synchronizing compressed files under various forms of modification (e.g., not modified, partially modified, or completely modified). To measure the efficiency of our proposed algorithm, we compared it to the Dropbox application algorithm. The results demonstrated that our algorithm outperformed the regular Dropbox synchronization mechanism by reducing the synchronization time, cost, and traffic load between clients and the cloud service provider.
Interactive music composition system - composition of 16-bars musical work with a melody part and backing parts

This paper aims at the construction of a music composition system that generates 16-bars musical works by interaction between human and the system, using interactive genetic algorithm. The present system generates not only various kinds of melody parts but also various kinds of patterns of backing parts and tones of all parts, so that users can acquire satisfied musical work. The users choose generating mode of musical work from three points, i.e., melody part, tones of all parts, or patterns of backing parts, and the users evaluate impressions of presented candidates of musical work through the user interface. The present system generates the candidates based on user's subjective evaluation. This paper shows evaluation experiments to confirm the usefulness of the present system.
POM/JLEC: An Automatic Program Equivalence Checker for Java Enterprise Systems

This paper presents a symbolic-execution-based approach and its implementation by POM/JLEC for checking the logical equivalence between two programs in the system replacement context. The primary contributions lie in the development of POM/JLEC, a fully automatic equivalence checker for Java enterprise systems. POM/JLEC consists of three main components: Domain Specific Pre-Processor for extracting the target code from the original system and adjusting it to a suitable scope for verification, Symbolic Execution for generating symbolic summaries, and solver-based EQuality comparison for comparing the symbolic summaries together and returning counter examples in the case of non-equivalence. We have evaluated POM/JLEC with a large-scale benchmark created from the function layer code of an industrial enterprise system. The evaluation result with 54% test cases passed shows the feasibility for deploying its mature version into software development industry.
A fuzzy inhomogenous multiattribute group decision making approach to solve outsourcing provider selection problems

Considering various situations and characteristics of supply chain management, we regard the outsourcing provider selection as a type of fuzzy inhomogenous multiattribute group decision making (MAGDM) problems with fuzzy alternatives’ comparisons and incomplete weight information. Hereby we focus on developing a new fuzzy linear programming method for solving such MAGDM problems. In this method, the decision makers’ preferences are given through pair-wise alternatives’ comparisons with fuzzy truth degrees represented as trapezoidal fuzzy numbers (TrFNs). Intuitionistic fuzzy sets, TrFNs, intervals and real numbers are used to express the inhomogenous decision information. Under the condition that the fuzzy positive ideal solution (PIS) and fuzzy negative ideal solution (NIS) are known, the fuzzy consistency and inconsistency indices are defined on the basis of the relative closeness degrees and expressed with TrFNs. The attribute weights are estimated through constructing a new fuzzy linear programming model, which is solved by the developed method of fuzzy linear programming with TrFNs. Through solving the constructed linear goal programming model, we obtain the collective comprehensive relative closeness degrees of alternatives to the fuzzy PIS, which are used to rank the alternatives. The effectiveness of the proposed method is verified with an example of IT outsourcing provider selection.
Chapter 2 The Sociocultural Aspects of HIV / AIDS in South Africa

In 2005 the Commission for Africa noted that ‘Tackling HIV and AIDS requires a holistic response that recognises the wider cultural and social context’ (p. 197). Cultural factors that range from beliefs and values regarding courtship, sexual networking, contraceptive use, perspectives on sexual orientation, explanatory models for disease and misfortune and norms for gender and marital relations have all been shown to be factors in the various ways that HIV/AIDS has impacted on African societies (UNESCO, 2002). Increasingly the centrality of culture is being recognised as important to HIV/AIDS prevention, treatment, care and support. With culture having both positive and negative influences on health behaviour, international donors and policy makers are beginning to acknowledge the need for cultural approaches to the AIDS crisis (Nguyen et al., 2008). The development of cultural approaches to HIV/AIDS presents two major challenges for South Africa. First, the multi-cultural nature of the country means that there is no single sociocultural context in which the HIV/AIDS epidemic is occurring. South Africa is home to a rich tapestry of racial, ethnic, religious and linguistic groups. As a result of colonial history and more recent migration, indigenous Africans have come to live alongside large populations of people with European, Asian and mixed descent, all of whom could lay claim to distinctive cultural practices and spiritual beliefs. Whilst all South Africans are affected by the spread of HIV, the burden of the disease lies with the majority black African population (see Shisana et al., 2005; UNAIDS, 2007). Therefore, this chapter will focus on some sociocultural aspects of life within the majority black African population of South Africa, most of whom speak languages that are classified within the broad linguistic grouping of Bantu languages. This large family of linguistically related ethnic groups span across southern Africa and comprise the bulk of the African people who reside in South Africa today (Hammond-Tooke, 1974). A second challenge involves the legitimacy of the culture concept. Whilst race was used in apartheid as the rationale for discrimination, notions of culture and cultural differences were legitimised by segregating the country into various ‘homelands’. Within the homelands, the majority black South Africans could presumably
Arctigenin Suppress Th17 Cells and Ameliorates Experimental Autoimmune Encephalomyelitis Through AMPK and PPAR-γ/ROR-γt Signaling

Arctigenin is a herb compound extract from Arctium lappa and is reported to exhibit pharmacological properties, including neuronal protection and antidiabetic, antitumor, and antioxidant properties. However, the effects of arctigenin on autoimmune inflammatory diseases of the CNS, multiple sclerosis (MS), and its animal model experimental autoimmune encephalomyelitis (EAE) are still unclear. In this study, we demonstrated that arctigenin-treated mice are resistant to EAE; the clinical scores of arctigenin-treated mice are significantly reduced. Histochemical assays of spinal cord sections also showed that arctigenin reduces inflammation and demyelination in mice with EAE. Furthermore, the Th1 and Th17 cells in peripheral immune organs are inhibited by arctigenin in vivo. In addition, the Th1 cytokine IFN-γ and transcription factor T-bet, as well as the Th17 cytokines IL-17A, IL-17F, and transcription factor ROR-γt are significantly suppressed upon arctigenin treatment in vitro and in vivo. Interestedly, Th17 cells are obviously inhibited in CNS of mice with EAE, while Th1 cells do not significantly change. Besides, arctigenin significantly restrains the differentiation of Th17 cells. We further demonstrate that arctigenin activates AMPK and inhibits phosphorylated p38, in addition, upregulates PPAR-γ, and finally suppresses ROR-γt. These findings suggest that arctigenin may have anti-inflammatory and immunosuppressive properties via inhibiting Th17 cells, indicating that it could be a potential therapeutic drug for multiple sclerosis or other autoimmune inflammatory diseases.
Effects of mindfulness-based stress reduction (MBSR) on health among breast cancer survivors.

The purpose of this study was to examine the effects of a MBSR program on physiological and psychological outcomes among early-stage breast cancer survivors. A quasi-experimental, pre-and posttest control group design was selected. The intervention group received the MBSR intervention. The control group received no MBSR intervention. ANOVA and ANCOVA were used to analyze data. The intervention group demonstrated statistically significant improvement in physiological and psychological outcomes including reduced blood pressure, heart rate, and respiratory rate and increased mindfulness state at the level of p = .05 to p = .001. The effects of MBSR on reducing stress in this sample were statistically significant on the physiological outcome (morning cortisol) at the measurement after the intervention completion, but this effect was not sustained at 1-month follow-up. MBSR showed a trend toward improving psychological outcomes by reducing mood disturbance in this sample.
3D Solid Modeling and Reveal in CNC Simulation Based on the Improved Voxel Model

In the process of dealing with the cutting calculation of Multi-axis CNC Simulation, the traditional Voxel Model not only will cost large computation time when judging whether the cutting happens or not, but also the data points may occupy greater storage space. So it cannot satisfy the requirement of real-time emulation, In the construction method of Compressed Voxel Model, it can satisfy the need of Multi-axis CNC Simulation, and storage space is relatively small. Also the model reconstruction speed is faster, but the Boolean computation in the cutting judgment is very complex, so it affects the real-time of CNC Simulation indirectly. Aimed at the shortcomings of these methods, we propose an improved solid modeling technique based on the Voxel model, which can meet the demand of real-time in cutting computation and Graphic display speed.
MINIATURIZATION OF BROADBAND 3DB BRANCHLINE COUPLER

In this letter, a new miniaturized broadband 3-dB branchline coupler at the center frequency of 880 MHz is proposed. The proposed coupler is designed by means of integrated miniaturization method, which consists of shunt capacitors, fractal geometry and equivalent miniaturized stubs, to achieve 82% size reduction compared with the referenced coupler. The return loss and isolation are both under −20 dB over a 19% relative bandwidth. The proposed coupler is simulated, fabricated and measured. The measured results agree well with the simulated ones.
Plastics Completely Synthesized by Bacteria: Polyhydroxyalkanoates

produced by many bacteria have been investigated by microbiologists, molecular biologists, biochemists, chemical engineers, chemists, polymer experts, and medical researchers over the past many years. Applications of PHA as bioplastics, fine chemicals, implant biomaterials, medicines, and biofuels have been developed. Companies have been established or involved in PHA-related R&D as well as large-scale production. PHA synthesis has been found to improve the robustness of non-PHA-producing microorganisms and to regulate bacterial metabolism, leading to yield improvement for some bacterial fermentation products. In addition, amphiphilic proteins related to PHA synthesis including PhaP, PhaZ, and PhaC have been found to be useful for achieving protein
Mecanum wheels with Astar algorithm and fuzzy PID algorithm based on genetic algorithm

In the industrial fields, Mecanum robots have been widely used. The Mecanum Wheel can do omnidirectional movements by electric machinery drive. It's more flexible than ordinary robots. It has massive potential in some situation which has small space. The robots with control system can complete the function of location and the calculation of optimal route. The Astar algorithm is most common mothed. However, Due to the orthogonal turning point, this algorithm takes a lot of Adjusting time. The Improved algorithm raised in this paper can reduce the occurrence of orthogonal turning point. It can generate a new smooth path automatically. This method can greatly reduce the time of the motion of the path. At the same time, it is difficult to obtain satisfactory performance by using the traditional control algorithm because of the complicated road conditions and the difficulty of establishing the model of the robot, so we use fuzzy algorithm to control robots. In fuzzy algorithm, the use of static membership function will affect the control effect, therefore, for complex control environment, using PSO algorithm to dynamically determine the membership function. It can effectively improve the motion performance and improve the dynamic characteristics and the adjustment time of the robot.
The role of dopamine in cognitive sequence learning: evidence from Parkinson’s disease

Electrophysiological and computational studies suggest that nigro-striatal dopamine may play an important role in learning about sequences of environmentally important stimuli, particularly when this learning is based upon step-by-step associations between stimuli, such as in second-order conditioning. If so, one would predict that disruption of the midbrain dopamine system--such as occurs in Parkinson's disease--may lead to deficits on tasks that rely upon such learning processes. This hypothesis was tested using a "chaining" task, in which each additional link in a sequence of stimuli leading to reward is trained step-by-step, until a full sequence is learned. We further examined how medication (L-dopa) affects this type of learning. As predicted, we found that Parkinson's patients tested 'off' L-dopa performed as well as controls during the first phase of this task, when required to learn a simple stimulus-response association, but were impaired at learning the full sequence of stimuli. In contrast, we found that Parkinson's patients tested 'on' L-dopa performed better than those tested 'off', and no worse than controls, on all phases of the task. These findings suggest that the loss of dopamine that occurs in Parkinson's disease can lead to specific learning impairments that are predicted by electrophysiological and computational studies, and that enhancing dopamine levels with L-dopa alleviates this deficit. This last result raises questions regarding the mechanisms by which midbrain dopamine modulates learning in Parkinson's disease, and how L-dopa affects these processes.