Miracle-dz/UniFAR-FTUs huggingface dataset:
A Survey of POMDP Solution Techniques

One of the goals of AI is to design an agent1 which can interact with an environment so as to maximize some reward function. Control theory addresses the same problem, but uses slightly different language: agent = controller, environment = plant, maximizing reward = minimizing cost. Control theory is mainly concerned with tasks in continuous spaces, such as designing a guided missile to intercept an airplane in minimum expected time, whereas AI is mainly concerned with tasks in discrete spaces, such as designing a program to play bridge to maximize the chance of winning. Nevertheless, AI and control theory have much in common [DW91], and some problems, such as designing a mobile robot to perform household chores, will require techniques from both fields. When designing agents that can act under uncertainty, it is convenient to model the environment as a POMDP (Partially Observable Markov Decision Process, pronounced “pom-dp”). At (discrete) time step t, the environment is assumed to be in some state Xt. The agent then performs an action (control) At, whereupon2 the environment (stochastically) changes to a new state Xt+1. The agent doesn’t see the environment state, but instead receives an observation Yt, which is some (stochastic) function of Xt. (If Yt = Xt, the POMDP reduces to a fully observed MDP.) In addition, the agent receives a special observation signal called the reward, Rt. The POMDP is characterized by the state transition function P (Xt+1|Xt, At), the observation function P (Yt|Xt, At−1), and the reward function E(Rt|Xt, At−1). The goal of the agent is to learn a policy π which maps the observation history (trajectory)
An Impedance Controller for Surface Alignment

This paper present a human-inspired compliant surface to surface alignment method for robotic manipulators. The surface alignment task is break down into several stages, a) make a point contact, b) alignment of point-contact to line-contact, and finally c) surface to surface alignment. The proposed controller is a combination of impedance control with rotational controllers that are activated based on the force sensing from the robot. We evaluate the performance of the proposed controller on a set of robot experiments using a 7-DOF KUKA iiwa robot on an inclined surface with different angles.
Pillar-array Based Two-dimensional Photonic Crystal Cavities: A New Paradigm for Optical Sensing

Pillar-Array Based Two-dimensional Photonic Crystal Cavities: a new paradigm for optical sensing Alan Tao Xu Doctor of Philosophy Graduate Department of Electrical and Computer Engineering University of Toronto 2010 Pillar-array based optical cavities have unique properties, e.g., having a large and connected low dielectric index space (normally air space), exhibiting a large band gap for transverse magnetic modes, having a large percent of electric field energy in air and standing on a substrate. These properties make them well suitable for applications such as optical sensing and terahertz quantum cascade lasers. However there has been rare research in it due to the common belief that pillar arrays have excessive leakage to the substrate. With careful design, we provided several methods to reduce such a leakage and experimentally proved a high quality factor (Q) pillar-array based cavity is practical. We also explored the usage of such a cavity for optical sensing. Numerical methods such as finite-difference time-domain and plane-wave expansion were used in the design of the cavity. Then in microwave spectrum, cavities consisting of dielectric rods were used to test the validity of the theory. Additionally, we observed that a high-Q cavity for modes above light line is feasible and it is very suitable to measure the optical absorption of materials introduce inside the mode volume. Finally in the optical domain, pillar arrays were fabricated in Si/SiO2 material system and measured. Q as high as 27, 600 was shown and when applying accurate refractive indices, for every ∆n = 0.01, the peak wavelength shifted as large as 3.5 nm, testifying the ultra sensitivity of the cavity to the environmental dielectric change.
Lower Limbs Alignment in Patients with a Unilateral Completely Dislocated Hip

Background: Severe hip osteoarthritis is known to lead to secondary osteoarthritis of the knee joint. It is not clear whether contracture or a leg length discrepancy is more important in determining the knee alignment. Methods: In this study, 48 hips in 48 patients with a unilateral completely dislocated hip (Crowe IV) were recruited. The patients were divided into two groups (Crowe IVa and IVb). The Crowe IVa group had completely dislocation with psudo-articulation, and the Crowe IVb group had completely dislocation without psudo-articulation. The lower limb alignment was divided into three patterns according to the femorotibial angle; varus (≥176 degrees), neutral(170 to 175 degrees) and valgus(≤169 degrees). Results: The combination of valgus alignment on the affected side and varus alignment on the unaffected side, so-called “windswept deformity” was observed in 12.5% of the patients; this included 18.2% and 7.7%, in the Crowe IVa and Crowe IVb groups, respectively. The valgus alignment on the unaffected side, namely “long leg arthropathy,” was found to have occurred in 6.3% of the patients, including 13.6% of the patients in the Crowe IVa group; there were no cases of long “leg arthropathy” in the Crowe IVb group. Conclusion: The lower limb alignment on the unaffected side had a tendency to be varus in the Crowe IV patients. The “windswept deformity” was observed in each of the groups; however, “long leg arthropathy” was only found in the Crowe IVa group.
Time Series Analysis for Jamming Attack Detection in Wireless Networks

Due to the open nature of wireless communication medium, wireless networks are susceptible to jamming attacks. Jammers interfere with the legitimate nodes by sending strong jamming signals. Legitimate nodes can successfully transmit only between the gaps of the jamming signals. It is therefore very important to detect a jamming attack as soon as it happens in order to effectively take counter measurements. There are various types of jamming attacks, however, the {\it signature} of all jamming attacks is the performance degradation of legitimate nodes. Based on this observation, we develop a detection method using time series analysis approach. We model the network measurements taken over time as time series, and employ a sequential change point detection algorithm to detect the change of state in the time series, which is an indicator of change in the network state. Timely and accurate detection is the first step before further identification and localization of the source of interference. In this paper, we address the detection part and leave the localization of the jammer to future work. The jamming attacks are simulated in ns-3 simulator, and the detection result is satisfactory in terms of false alarm rate and detection delay.
Chronic intratracheal application of the soluble guanylyl cyclase stimulator BAY 41-8543 ameliorates experimental pulmonary hypertension

Dysfunction of the NO/sGC/cGMP signaling pathway has been implicated in the pathogenesis of pulmonary hypertension (PH). Therefore, agents stimulating cGMP synthesis via sGC are important therapeutic options for treatment of PH patients. An unwanted effect of this novel class of drugs is their systemic hypotensive effect. We tested the hypothesis that aerosolized intra-tracheal delivery of the sGC stimulator BAY41-8543 could diminish its systemic vasodilating effect. Pharmacodynamics and -kinetics of BAY41-8543 after single intra-tracheal delivery was tested in healthy rats. Four weeks after a single injection of monocrotaline (MCT, 60 mg/kg s.c.), rats were randomized to a two-week treatment with either placebo, BAY 41-8543 (10 mg/kg per os (PO)) or intra-tracheal (IT) instillation (3 mg/kg or 1 mg/kg). Circulating concentrations of the drug 10 mg/kg PO and 3 mg/kg IT were comparable. BAY 41-8543 was detected in the lung tissue and broncho-alveolar fluid after IT delivery at higher concentrations than after PO administration. Systemic arterial pressure transiently decreased after oral BAY 41-8543 and was unaffected by intratracheal instillation of the drug. PO 10 mg/kg and IT 3 mg/kg regimens partially reversed pulmonary hypertension and improved heart function in MCT-injected rats. Minor efficacy was noted in rats treated IT with 1 mg/kg. The degree of pulmonary vascular remodeling was largely reversed in all treatment groups. Intratracheal administration of BAY 41-8543 reverses PAH and vascular structural remodeling in MCT-treated rats. Local lung delivery is not associated with systemic blood pressure lowering and represents thus a further development of PH treatment with sGC stimulators.
Observational evidence for anthropogenic effects on Arctic boundary layer clouds over Eureka , Nunavut

The relationship between air-mass origin and Arctic Boundary Layer Clouds over Eureka, Nunavut is investigated. This paper examines different modes of entry for air masses over the Eureka region using calculated back-trajectories with the NOAA Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT) model. Five-day-long back-trajectories all ending 1.5 km above Eureka were calculated twice daily for a three year interval (2006-2008). Each trajectory was then associated with a cloud type existing at the time and place of the end-point using a ground-based multi-sensor cloud phase classifier. All the trajectories then were grouped into similar pathways using an average-linkage clustering algorithm. Each of these clusters represented a general mode of entry into the boundary layer above Eureka and the distributions of cloud phases associated with each cluster were statistically compared. Consistent with an anthropogenic origin for many ice-forming nuclei (IFN), it was found that the modes of entry which quickly cross the arctic ocean and originate in the industrial regions of Eurasia had a statistically significant difference in their distribution of phases and exhibited the most arctic mixed-phase cloud occurrences. This has important impacts on Arctic climate since Arctic mixed-phase stratus serve as a greenhouse blanket.
The serotonin 6 receptor controls neuronal migration during corticogenesis via a ligand-independent Cdk5-dependent mechanism

The formation of a laminar structure such as the mammalian neocortex relies on the coordinated migration of different subtypes of excitatory pyramidal neurons in specific layers. Cyclin-dependent kinase 5 (Cdk5) is a master regulator of pyramidal neuron migration. Recently, we have shown that Cdk5 binds to the serotonin 6 receptor (5-HT6R), a G protein-coupled receptor (GPCR). Here, we investigated the role of 5-HT6R in the positioning and migration of pyramidal neurons during mouse corticogenesis. We report that constitutive expression of 5-HT6R controls pyramidal neuron migration through an agonist-independent mechanism that requires Cdk5 activity. These data provide the first in vivo evidence of a role for constitutive activity at a GPCR in neocortical radial migration.
On the Necessity of Irrelevant Variables

This work explores the effects of relevant and irrelevant boolean variables on the accuracy of classifiers. The analysis uses the assumption that the variables are conditionally independent given the class, and focuses on a natural family of learning algorithms for such sources when the relevant variables have a small advantage over random guessing. The main result is that algorithms relying predominately on irrelevant variables have error probabilities that quickly go to 0 in situations where algorithms that limit the use of irrelevant variables have errors bounded below by a positive constant. We also show that accurate learning is possible even when there are so few examples that one cannot determine with high confidence whether or not any individual variable is relevant.
Neither chimpanzee nor human, Ardipithecus reveals the surprising ancestry of both

Australopithecus fossils were regularly interpreted during the late 20th century in a framework that used living African apes, especially chimpanzees, as proxies for the immediate ancestors of the human clade. Such projection is now largely nullified by the discovery of Ardipithecus. In the context of accumulating evidence from genetics, developmental biology, anatomy, ecology, biogeography, and geology, Ardipithecus alters perspectives on how our earliest hominid ancestors—and our closest living relatives—evolved.
Discrete event simulation in supply chain planning and inventory control at Freescale Semiconductor Inc

The supply chain of Freescale Semiconductor from fabrication through final test and delivery was modeled and analyzed using discrete event simulation in Arena. Freescale starts products in manufacturing based on a make-to-order and make-to-stock master production schedule. Since customer lead time is often less than the supply chain cycle time, Freescale maintains strategic safety stock throughout the supply chain and as finished goods inventory. Manufacturing entry rate is determined by the amount of product in WIP and inventory. Our analysis concentrates on the relationship between on-time delivery in the major supply chain segments and on-time delivery to the customer in an environment of significant inventory and WIP level changes. The goal is to predict the effect of internal on-time delivery, inventory and WIP changes on the customer order fulfillment service level. In our analysis, we evaluate supply chain production and inventory control policies and the impact of lead time reductions
SmarPer: Context-Aware and Automatic Runtime-Permissions for Mobile Devices

Permission systems are the main defense that mobile platforms, such as Android and iOS, offer to users to protect their private data from prying apps. However, due to the tension between usability and control, such systems have several limitations that often force users to overshare sensitive data. We address some of these limitations with SmarPer, an advanced permission mechanism for Android. To address the rigidity of current permission systems and their poor matching of users' privacy preferences, SmarPer relies on contextual information and machine learning methods to predict permission decisions at runtime. Note that the goal of SmarPer is to mimic the users' decisions, not to make privacy-preserving decisions per se. Using our SmarPer implementation, we collected 8,521 runtime permission decisions from 41 participants in real conditions. With this unique data set, we show that using an efficient Bayesian linear regression model results in a mean correct classification rate of 80% (±3%). This represents a mean relative reduction of approximately 50% in the number of incorrect decisions when compared with a user-defined static permission policy, i.e., the model used in current permission systems. SmarPer also focuses on the suboptimal trade-off between privacy and utility, instead of only "allow" or "deny" type of decisions, SmarPer also offers an "obfuscate" option where users can still obtain utility by revealing partial information to apps. We implemented obfuscation techniques in SmarPer for different data types and evaluated them during our data collection campaign. Our results show that 73% of the participants found obfuscation useful and it accounted for almost a third of the total number of decisions. In short, we are the first to show, using a large dataset of real in situ permission decisions, that it is possible to learn users' unique decision patterns at runtime using contextual information while supporting data obfuscation, this is an important step towards automating the management of permissions in smartphones.
Efficient SERS Substrate Fabricated by Simple Aluminum Pits Template

This paper reports a simple and versatile method with innovative application of photoresist film for fabricating ordered nanodot arrays with tunable structural parameters as large-area surface enhanced Raman scattering (SERS) substrate with high performance. The substrate is fabricated by evaporating Au on the regularly patterned aluminum template of pits arrays formed from the anodization of Al. A key point in our method is coating a photoresist layer on the fragile Au film to support the film before separating it from the Al template, which insures the integrity of the film on large area. Taking Rhodamine 6G as probing molecules, SERS spectra are investigated. The convenience of preparation as well as the high performance for the SERS signals makes the prepared substrates a promising candidate for SERS sensing or detecting.
Effect of root proximity of orthodontic mini-implant on bone stress: A dimensional finite element analysis

Background and Objectives: This study aimed to evaluate stress in the surrounding jaw bone due to root proximity of orthodontic mini-implant, using three-dimensional finite element method (FEM). Materials and Methods: Three FEM models with different locations of mini-implants were designed and classified according to their proximity to the molar root: Category I: Screw was separate from the root (about 1 mm away), Category II: Part of the screw thread was embedded in the periodontal membrane, Category III: Part of the screw thread touches the root. Each screw was inserted at 30° mesial to mandibular molar and traction force of 2N was applied to it at 45°. Stresses in the cortical bone surrounding implant were determined. Results: Mini-implant which was separate from the root showed least amount of stresses within the bone as compared to the implants in the other two categories. The pattern of stress distribution was concentrated near the neck of the mini-implant (at the point of entry into the bone), away from the direction of force application. Interpretation and Conclusion: Stresses in the bone decrease as the distance of the orthodontic mini-implant relative to the root increases.
Cleavable PEGylation: a strategy for overcoming the “PEG dilemma” in efficient drug delivery

Abstract To prolong the circulation time of drug, PEGylation has been widely used via the enhanced permeability and retention (EPR) effect, thereby providing new hope for better treatment. However, PEGylation also brings the "PEG dilemma", which is difficult for the cellular absorption of drugs and subsequent endosomal escape. As a result, the activity of drugs is inevitably lost after PEG modification. To achieve successful drug delivery for effective treatment, the crucial issue associated with the use of PEG-lipids, that is, “PEG dilemma” must be addressed. In this paper, we introduced the development and application of nanocarriers with cleavable PEGylation, and discussed various strategies for overcoming the PEG dilemma. Compared to the traditional ones, the vehicle systems with different environmental-sensitive PEG-lipids were discussed, which cleavage can be achieved in response to the intracellular as well as the tumor microenvironment. This smart cleavable PEGylation provides us an efficient strategy to overcome “PEG dilemma”, thereby may be a good candidate for the cancer treatment in future.
HIV Seroconversion in blood donors from the coordinating blood bank in the State of Pará

Background Transfusion of Human immunodeficiency virus (HIV) infected blood is probably the most effective means of transmission of this disease. Despite intense efforts and investment to ensure safety, transmission of HIV still remains a real possibility in the transfusion service due to the fact that routine laboratory tests in most Brazilian government blood banks rely on the detection of antibodies. This leaves an immunological window period of from 16 to 22 days, which could be minimized to approximately 9 to 11 days if nucleic acid amplification tests were employed in screening. Objective To analyze the profile of blood donors who seroconverted to HIV positive from 2008 to 2010 in the coordinating blood bank of the State of Pará in respect to gender, age, marital status and educational level. Methods HIV seroconversion cases of blood donors who donated on more than one occasion at the coordinating blood bank of the State of Pará were investigated. Records from 2008 and 2010 were analyzed in respect to gender, marital status, schooling and age. Results Among the 157,432 donations in this period, 45 HIV seroconversions were confirmed. Of these, 95.56% were men, of which 86.67% were single, 53.33% had completed high school and 40% were between 23 and 29 years old. Conclusions In order to improve the quality of blood and reduce the residual risk of HIV transmission in blood banks, it is necessary to know the profiles of donors who most frequently seroconvert and use nucleic acid amplification tests as routine screening.
Hemodynamic Responses to Interictal Epileptiform Discharges in Children with Symptomatic Epilepsy

Purpose: Simultaneous electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) (EEG‐fMRI) recording is a noninvasive tool for investigating epileptogenic networks. Most EEG‐fMRI studies in epilepsy have been performed in adults. Childhood epilepsies, however, differ from those in adults due to interactions between epileptogenic and developmental processes. The purpose of this study was to investigate EEG‐fMRI in children with lesional epilepsies.
Discovery and evaluation of novel anti-inflammatory derivatives of natural bioactive curcumin

Curcumin is a natural active product that has various pharmacological activities such as anti-inflammatory effects. Here, we report the synthesis and evaluation of 34 monocarbonyl curcumin analogs as novel anti-inflammatory agents. Among the analogs, the symmetrical heterocyclic type displayed the strongest inhibition of lipopolysaccharide (LPS)-stimulated expression of pro-inflammatory cytokines in macrophages. Analogs S1–S5 and AS29 reduced tumor necrosis factor-α (TNF-α) and interleukin-6 (IL-6) production in a dose-dependent manner and also displayed excellent stability and low cytotoxicity in vitro. In addition, analog S1 dose-dependently inhibited LPS-induced extracellular signal-regulated kinase (ERK) phosphorylation. Furthermore, analogs S1 and S4 displayed a significant protective effect on LPS-induced septic death in mouse models, with 40% and 50% survival rates, respectively. These data demonstrate that the heterocyclic monocarbonyl curcumin analogs have potential therapeutic effects in acute inflammatory diseases.
Characterisation of multiphase ceramic coatings fabricated via laser in situ reaction technology

Coatings are pre-fabricated on the China low activation martensitic (CLAM) steel via thermal spraying using Cr–Fe–Al–Ti mixed powders. Crystalline and amorphous multiphase ceramic coatings are formed by a new laser surface in situ prefabricated coatings in situ reaction technology under atmospheric environments based on the Standard Gibbs free-energy theory. The grain boundary of incomplete recrystallisation section and perfect crystallisation section can be observed clearly by high-resolution transmission electron microscopy. The Al2O3 and TiO2 are found to be formed in the crystallisation section. In addition, we adopt a new method to measure bonding strength of coating and base material, and the average shear strength is found to be 290 MPa. Further finite-element analysis shows that the shear stress distribution between the coatings and substrate is consistent with the experimental data. The average microhardness of the coatings is found to reach 1864.19 HV0.2. The coatings also exhibit the strongest liquid Pb corrosion resistance. This technique may be important in technological improvement of surfaces of the candidate structural materials for the accelerator-driven sub-critical system, which is usually applied to handle the nuclear waste under extreme conditions.