Miracle-dz/UniFAR-FTUs huggingface dataset:
Dual Representations for Dynamic Programming and Reinforcement Learning

We investigate the dual approach to dynamic programming and reinforcement learning, based on maintaining an explicit representation of stationary distributions as opposed to value functions. A significant advantage of the dual approach is that it allows one to exploit well developed techniques for representing, approximating and estimating probability distributions, without running the risks associated with divergent value function estimation. A second advantage is that some distinct algorithms for the average reward and discounted reward case in the primal become unified under the dual. In this paper, we present a modified dual of the standard linear program that guarantees a globally normalized state visit distribution is obtained. With this reformulation, we then derive novel dual forms of dynamic programming, including policy evaluation, policy iteration and value iteration. Moreover, we derive dual formulations of temporal difference learning to obtain new forms of Sarsa and Q-learning. Finally, we scale these techniques up to large domains by introducing approximation, and develop new approximate off-policy learning algorithms that avoid the divergence problems associated with the primal approach. We show that the dual view yields a viable alternative to standard value function based techniques and opens new avenues for solving dynamic programming and reinforcement learning problems
A generic participatory sensing framework for multi-modal datasets

Participatory sensing has become a promising data collection approach to crowdsourcing data from multi-modal data sources. This paper proposes a generic participatory sensing framework that consists of a set of well-defined modules in support of diverse use cases. This framework incorporates a concept of “human-as-a-sensor” into participatory sensing and allows the public crowd to contribute human observations as well as sensor measurements from their mobile devices. We specifically address two issues: incentive and extensibility, where the former refers to motivating participants to contribute high-quality data while the latter refers to accommodating heterogeneous and uncertain data sources. To address the incentive issue, we design an incentive engine to attract high-quality contributed data independent of data modalities. This engine works together with a novel social network that we introduce into participatory sensing, where participants are linked together and interact with each other based on data quality and quantity they have contributed. To address the extensibility issue, the proposed framework embodies application-agnostic design and provides an interface to external datasets. To demonstrate and verify this framework, we have developed a prototype mobile application called imReporter, which crowdsources hybrid (image-text) reports from participants in an urban city, and incorporates an external dataset from a public data mall. A pilot study was also carried out with 15 participants for 3 consecutive weeks, and the result confirms that our proposed framework fulfills its design goals.
Identification of Leishmania Species Using PCR Assay on Giemsa-Stained Slides Prepared From Cutaneous Leishmaniasis Patients

Background Leishmaniasis is a group of diseases that are created by intracellular parasites of Leishmania. Cutaneous leishmaniasis is considered as one of the health problems in some provinces of Iran. Methods In this study, a total of 178 Giemsa-stained slides from confirmed cases of cutaneous leishmaniasis were examined. The slides were prepared from the patients with cutaneous leishmaniasis that referred to health centers and infected during the epidemic of cutaneous leishmaniasis in Poldokhtar city, Lorestan Province, Iran in 2006.Genomic DNA from each slide was extracted. After DNA extraction, ITS-PCR was used. Results Out of 178 slides, 129 (72.47%) samples had a band in the range of 485 bp and 49 (27.53%) samples 626 bp that matched L. tropica and L. major standard samples, respectively. Conclusion This study showed that Leishmania DNA could be efficiently extracted and amplified even from old Giemsa-stained microscopic slides that were stored more than 6 yr. In this study was shown that both L. tropica and L. major species exist in Lorestan Province.
SHAPE ASSESSMENT OF GENERALIZED BUILDING FOOTPRINTS

Along with the constantly improving acquisition, processing and visualization techniques, the amount of spatial data that is available today has dramatically increased. As a consequence, various data sets for one and the same area are often available, reflecting temporal changes or representations at different resolutions. Thus, there is a rising need to compare such data sets in order to assess their quality and pick out the proper one for a specific application. In this paper, the focus lies on the shape assessment of building ground plans for which various versions are available as a result of cartographic generalization. The commonly used characteristic for measuring the deviation between the outlines of polygonal objects is the Hausdorff distance. On generalized building data, however, the metric performs less intuitive from a human point of understanding. Examples resulting from the geometric simplification of footprints are given, the shortcomings of the Hausdorff distance discussed, and an alteration of the metric motivated therewith. This new metric does not allow for a direct connection of the two points of shortest distance, but restricts it to remain inside the polygonal difference between the two footprints. Besides the shortest distance, a variation of the metric is also shown to express the complexity of shape differences.
Effects of PKA-CREB Signal Transduction System on Cognitive Impairment in Rats with Chronic Cerebral Hypoperfusion

Aim: To study the effects of PKA-CREB signal transduction system on cognitive impairment in rats with chronic cerebral hypoperfusion. Methods: The chronic cerebral hypoperfusion model was made by permanent bilateral occlusion of both common carotid arteries, and the rats were randomly divided into sham control and ischemic groups. The spatial learning and memory function was tested with Morris water maze at the eighth week after the operation. The levels of PKAca and pCREB in hippocampus tissues of rats were measured by Western blotting. Results: The learning and memory ability in rats was significantly injured in the ischemic group. The levels of PKAca and pCREB in the ischemic group were lower than that in the sham control group. The protein levels PKAca and pCREB were positively correlated with learing and memory performance in Morris water maze test. Conclusion: The PKA-CREB signal transduction system may be involved in the spatial learning and memory function in the rats with chronic cerebral hypoperfusion.
Efficient implementation of maximization likelihood estimation to constrained measurement random latency probability in nonlinear system

This paper focuses on quickly identifying the unknown or time-varying random latency probability (RLP) of the measurements in the nonlinear networked multi-sensor system by resorting to the efficient implementation of maximization likelihood (ML) estimation. Firstly, the full-probability likelihood computation is equivalently transformed into a log-likelihood function summation form parameterized by RLP through Bayes' rule. Secondly, the computation of the log-likelihood function is further transferred by skillfully introducing Jensen's inequality for facilitating the rapid maximization. Thirdly, the simple identification result of RLP is obtained by constructing Lagrange operator to maximize the transferred log-likelihood with the RLP parameter constraint. Finally, an example motivated by the maneuvering target tracking application is presented to demonstrate the superiority of the new method.
Kir potassium channel subunit expression in retinal glial cells: Implications for spatial potassium buffering †

To understand the role of different K+ channel subtypes in glial cell‐mediated spatial buffering of extracellular K+, immunohistochemical localization of inwardly rectifying K+ channel subunits (Kir2.1, Kir2.2, Kir2.3, Kir4.1, and Kir5.1) was performed in the retina of the mouse. Stainings were found for the weakly inward‐rectifying K+ channel subunit Kir4.1 and for the strongly inward‐rectifying K+ channel subunit Kir2.1. The most prominent labeling of the Kir4.1 protein was found in the endfoot membranes of Müller glial cells facing the vitreous body and surrounding retinal blood vessels. Discrete punctate label was observed throughout all retinal layers and at the outer limiting membrane. By contrast, Kir2.1 immunoreactivity was located predominantly in the membrane domains of Müller cells that contact retinal neurons, i.e., along the two stem processes, over the soma, and in the side branches extending into the synaptic layers. The results suggest a model in which the glial cell‐mediated transport of extracellular K+ away from excited neurons is mediated by the cooperation of different Kir channel subtypes. Weakly rectifying Kir channels (Kir4.1) are expressed predominantly in membrane domains where K+ currents leave the glial cells and enter extracellular “sinks,” whereas K+ influxes from neuronal “sources” into glial cells are mediated mainly by strongly rectifying Kir channels (Kir 2.1). The expression of strongly rectifying Kir channels along the “cables” for spatial buffering currents may prevent an unwarranted outward leak of K+, and, thus, avoid disturbances of neuronal information processing. GLIA 39:292–303, 2002. © 2002 Wiley‐Liss, Inc.
IRES-Mediated Translation of Membrane Proteins and Glycoproteins in Eukaryotic Cell-Free Systems

Internal ribosome entry site (IRES) elements found in the 5′ untranslated region of mRNAs enable translation initiation in a cap-independent manner, thereby representing an alternative to cap-dependent translation in cell-free protein expression systems. However, IRES function is largely species-dependent so their utility in cell-free systems from different species is rather limited. A promising approach to overcome these limitations would be the use of IRESs that are able to recruit components of the translation initiation apparatus from diverse origins. Here, we present a solution to this technical problem and describe the ability of a number of viral IRESs to direct efficient protein expression in different eukaryotic cell-free expression systems. The IRES from the intergenic region (IGR) of the Cricket paralysis virus (CrPV) genome was shown to function efficiently in four different cell-free systems based on lysates derived from cultured Sf21, CHO and K562 cells as well as wheat germ. Our results suggest that the CrPV IGR IRES-based expression vector is universally applicable for a broad range of eukaryotic cell lysates. Sf21, CHO and K562 cell-free expression systems are particularly promising platforms for the production of glycoproteins and membrane proteins since they contain endogenous microsomes that facilitate the incorporation of membrane-spanning proteins and the formation of post-translational modifications. We demonstrate the use of the CrPV IGR IRES-based expression vector for the enhanced synthesis of various target proteins including the glycoprotein erythropoietin and the membrane proteins heparin-binding EGF-like growth factor receptor as well as epidermal growth factor receptor in the above mentioned eukaryotic cell-free systems. CrPV IGR IRES-mediated translation will facilitate the development of novel eukaryotic cell-free expression platforms as well as the high-yield synthesis of desired proteins in already established systems.
Rationalization Eeects of Tarii Reductions

We analyze a panel of 230 Canadian manufacturing industries to investigate whether trade liberalization promotes e ciency through increased scale. During the six years following the Free Trade Agreement with the United States, Canadian manufacturing exhibited substantial rationalization|a decline in the number of plants accompanied by increases in output per plant. We nd that the bilateral tari reductions had opposing e ects on scale. Contraction induced by lower Canadian tari s largely o set the 10% scale increase caused by U.S. tari cuts. The observed increase in scale arose due to currency depreciation, compositional shifts towards high-scale industries, and undercounting of small establishments. JEL classi cation: F1
Epidemiology of end-stage renal disease in the countries of the Gulf Cooperation Council: a systematic review

Objectives To describe the epidemiology of end stage renal disease (ESRD). Design Mixed-methods systematic review. Setting The countries of the Gulf Cooperation Council (GCC) which consist of Saudi Arabia, the United Arab Emirates, Kuwait, Qatar, Bahrain, and Oman. Participants Defined to have ESRD or patients on regular dialysis for a minimum dialysis period of at least three months. Since many outcomes were reviewed, studies that estimated the incidence and prevalence of ESRD as outcomes should not have defined the study population as ESRD population or patients on regular dialysis. Studies where the study population mainly comprised children or pregnant woman were excluded. Main outcome measures The trends of the incidence, prevalence, and mortality rate of ESRD; also, causes of mortality, primary causes and co-morbid conditions associated with ESRD. Results 44 studies included in this review show that the incidence of ESRD has increased while the prevalence and mortality rate of ESRD in the GCC has not been reported sufficiently. The leading primary causes of ESRD recorded in the countries of the GCC is diabetes with the most prevalent co-morbid conditions being Hypertension and Hepatitis C Virus infection; the most common cause of death was cardiovascular disease and sepsis. Conclusions This review highlights that the lack of national renal registries data is a critical issue in the countries of the GCC. The available data also do not provide an accurate and updated estimate for relevant outcomes. Additionally, considering the increasing burden of chronic kidney disease (CKD), these results stressed the needs and the importance of preventative strategies for leading causes of ESRD. Furthermore, more studies are needed to describe the epidemiology of ESRD and for assessing the overall quality of renal care.
The pedagogy of teacher educators: Revealing practical wisdom through explicit modelling

The University Repository is a digital collection of the research output of the University, available on Open Access. Copyright and Moral Rights for the items on this site are retained by the individual author and/or other copyright owners. Users may access full items free of charge; copies of full text items generally can be reproduced, displayed or performed and given to third parties in any format or medium for personal research or study, educational or not-for-profit purposes without prior permission or charge, provided:
A random algorithm for designing the system matrix in compressive spectral imaging by homogenizing its structure

Compressive spectral imaging systems (CSI) use a focal plane array (FPA) to measure two-dimensional (2D) coded projections of a three-dimensional (3D) spatio-spectral scene. A reconstruction algorithm based on compressive sensing theory exploits the projections to retrieve the underlying 3D scene. Compressive sensing relies on two principles: sparsity and incoherence. Higher incoherence drives to better reconstructed images quality. The Colored Coded Aperture Spectral Imager (C-CASSI) is a CSI system where the coded projections are produced by optical elements named coded apertures. The C-CASSI system can be modeled as a linear transformation. The transformation matrix represents the physical effects of the coded aperture and the prism on the scene. The transformation matrix is also called the system representative matrix. The colored coded apertures modulate spatially and spectrally the light from the scene. The reconstruction image quality is highly dependent on the colored coded apertures design. An algorithm that randomly designs the coded apertures maintains the incoherence between the sensing matrix and the representation base. However, a coded aperture designed completely random, may cause the voxel information be sensed more than once, or not be sensed. This paper presents a random algorithm for colored coded apertures design by homogenizing defined parameters of the C-CASSI system representative matrix. Homogenization parameters guarantee that a voxel information would be sensed at least once. The homogenization is achieved leveling the selected parameters of the matrix, like the average of unblocking elements per column and the average of unblocking elements per row. Simulations show improvement up to 3.10 dB in the PSNR reconstructed images by using the colored coded apertures designs compared with traditional random coded apertures.
Polyinstantiation integrity in multilevel relations

Polyinstantiation integrity (PI) as defined in the Sea View multilevel relational data model consists of a functional dependency component and a multivalued dependency component. It is shown that the latter component rules out many practically useful relations and is therefore unduly restrictive. This leads the authors to propose that PI be defined to consist only of the functional dependency component. For this revised definition of PI, they formulate and prove correct a lossless decomposition of multilevel relations into single-level ones with recovery based on the natural join operation. <<ETX>>
Prostate Tissue Characterization via Ultrasound Speckle Statistics

In this work we study methodologies for speckle extraction and analysis in ultrasound biomedical images. Assuming a multiplicative noise model, the investigated methods exploit the decorrelating properties of the wavelet transform for non-stationary signals. The efficiency of preprocessing procedures which decompose the acquired signal into coherent and diffuse component is investigated. The different approaches are evaluated in terms of computational cost and effectiveness in tissue characterization of human prostates affected by carcinoma. In particular, we compare the performances of fractal and statistical features for the classification of textures. By analyzing speckle statistics we obtain a fundamental tissue "signature" suitable for image segmentation and characterization
Exploiting Task Order Information for Optimizing Sequentially Consistent Java Programs

Java was designed as a secure language that supports running untrusted code as part of trusted applications. For safety reasons, Java therefore defines a memory model that prevents undefined behavior in multi-threaded programs even if the programs are not correctly synchronized. Because of the potential negative performance impact the Java designers did not choose a simple and natural memory model, such as sequential consistency, but instead developed a relaxed memory model that gives the compiler more optimization opportunities. As it is today, however, the relaxed Java Memory Model is not only hard to understand but it unnecessarily complicates reasoning about parallel programs and it turned out to be difficult to implement correctly. This paper presents an optimizing compiler for a Java version that has sequential consistency as its memory model. Based on a programming model with explicit happens-before constraints between tasks, we describe a static schedule analysis that computes whether two tasks may be executed in parallel or if they are ordered. During optimization, the task-ordering information is exploited to reduce the number of volatile memory accesses the compiler must insert to guarantee sequential consistency. The evaluation shows that scheduling information significantly improves the effectiveness of the optimizations. For our set of multi-threaded benchmarks the fully optimizing compiler removes between 70\% and 100\% of the volatile memory accesses inserted by the non-optimizing compiler. As a result, the overhead of sequentially consistent Java compared to standard Java is reduced from 136\% on average for the unoptimized version to 11\% on average for the optimized version. The results indicate that with appropriate optimizations, sequential consistency can be a feasible alternative to the Java Memory Model.
A Literature Review of Business Process Reengineering of Manufacturing Systems

Business Process Reengineering is necessary to be flexible to adapt to changing global and competitive environment. Reengineering is a fundamental rethinking and radical redesign of business processes to achieve dramatic improvement in cost, quality, speed, and service. This paper is devoted to a critical review of existing literature on business process reengineering of manufacturing systems, factors and modeling in order to understand the importance of reengineering.
TEA elicits two distinct potentiations of synaptic transmission in the CA1 region of the hippocampal slice

Extracellular application of tetraethylammonium (TEA) has been shown to elicit a prolonged synaptic potentiation in the CA1 region of the hippocampus that is unaffected by NMDA receptor antagonists, but is blocked by antagonists to voltage-dependent calcium channels (Aniksztejn and Ben-Ari, 1991; Huang and Malenka, 1993). In the present study the relation between TEA-induced potentiation and NMDA receptor- dependent long-term potentiation (LTP) was investigated in the CA1 region of the hippocampal slice using extracellular recordings and picrotoxin to block GABAA-mediated inhibition. Consistent with the finding of Huang and Malenka (1993), NMDA receptor-dependent LTP partially occluded the TEA-induced potentiation. However, this occlusion was abolished when the NMDA receptor antagonist D(-)-2-amino- 5-phosphonopentanoic acid (D-AP5) was present during the application of TEA, indicating one component of TEA-induced potentiation that is induced via NMDA receptor channels and another component that is distinct from NMDA receptor-dependent LTP. In the presence of antagonists to voltage-dependent calcium channels (nifedipine or nifedipine/flunarazine) application of TEA induced a potentiation that was largely occluded by NMDA receptor-dependent LTP. In common with NMDA receptor-dependent LTP, the TEA-induced potentiation, elicited in the presence of antagonists to voltage-dependent calcium channels, was associated with a symmetrical increase of the field EPSP. On the other hand, the TEA-induced potentiation elicited in the presence of D-AP5 produced an increase of the field EPSP that did not include the early part of the initial slope. (ABSTRACT TRUNCATED AT 250 WORDS)