Miracle-dz/UniFAR-FTUs huggingface dataset:
Density-Based Bonuses on Learned Representations for Reward-Free Exploration in Deep Reinforcement Learning

In this paper, we study the problem of representation learning and exploration in reinforcement learning. We propose a framework to compute exploration bonuses based on density estimation, that can be used with any representation learning method, and that allows the agent to explore without extrinsic rewards. In the special case of tabular Markov decision processes (MDPs), this approach mimics the behavior of theoretically sound algorithms. In continuous and partially observable MDPs, the same approach can be applied by learning a latent representation, on which a probability density is estimated.
Use of a proactive herd management system in a dairy farm of northern italy: technical and economic results

Reproductive and economic data were recorded before and one year after the installation of Herd Navigator™ in a dairy farm with AMS (Automatic Milking System) located in a mountain area of Northern Italy. Number of days open reduced from 166 to 103 days, number of days between the first and second insemination decreased from 45 to 28 days, and days for identifying an abortion were 80 % less, from 31 to 6 days. The preliminary results highlight the usefulness of the proactive herd management system installed for the reproduction management. A basic economic model is proposed to evaluate the potential economic benefits coming from the introduction of this technology. The model considers the benefits deriving from the reduction of reproduction problems and, consequently, of days open. Considering the effects related to the above mentioned aspects in a case study involving 60 dairy cows, a return on investment over 5 years has been calculated.
Protecting Network-on-Chip Intellectual Property Using Timing Channel Fingerprinting

The theft of Intellectual property (IP) is a serious security threat for all businesses that are involved in the creation of IP. In this article, we consider such attacks against IP for Network-on-Chip (NoC) that are commonly used as a popular on-chip scalable communication medium for Multiprocessor System-on-Chip. As a protection mechanism, we propose a timing channel fingerprinting method and show its effectiveness by implementing five different solutions using this method. We also provide a formal proof of security of the proposed method. We show that the proposed technique provides better security and requires much lower hardware overhead (64%–74% less) compared to an existing NoC IP security solution without affecting the normal packet latency or degrading the NoC performance.
Simulation and Experiment for Non-linear Model of Constant Pump Based on Modelica

Based on the analysis of traditional formula model of constant pump,considering compressibility of the oil,character of the oil absorbent of the pump and mechanical loss,the non-linear mathematical model of constant pump was established according to the physical work-process.The non-linear simulation model of constant pump was built using Modelica language to realize the simulation and analysis in Dymola software.The simulation results and solutions of traditional formula were compared with experimental data to prove the validity and accuracy of the simulation model.
Intraoperative Injection of Normal Saline Through Lumbar Drainage for Transnasal Endoscopic Repair of Complex CSF Leaks

Objective It is well known that accurate location of the leak in the operation is crucial for repairing cerebrospinal fluid leakage. The study aims to investigate the application of intraoperative injection of normal saline through lumbar drainage in repairing complex leaks. Methods The fistulas of all patients with CSF leak were located by computed tomography cisternography (CTC) or heavy T2 magnetic resonance imaging (MRI) before surgery. Before anesthesia, the patient underwent lumbar drainage implantation, and then 20 ml of normal saline was slowly injected through the lumbar drainage to observe the patient's response. The surgical approach was designed based on the preoperative imaging data. When the operation was near to the suspected fistula, normal saline was injected through lumbar drainage (20 ml each time) to confirm the leak location. After CSF leak repair, saline was injected again to confirm whether the repair was successfully. Result Of the 5 patients with complex leaks, 4 cases were repaired by transnasal endoscopy method, and 1 case was repaired by transnasal endoscopy method and epidural method. A total of 7 leaks were found during the operation. During the operation, 40–120 ml of normal saline was injected through lumbar drainage. Cauda equina neuralgia was developed in patients who received 120 ml normal saline, which was relieved by intrathecal injection of dexamethasone. During the follow-up of 3 months, 1 case suffered from brain abscess, which was controlled by vancomycin. There was no recurrence of rhinorrhea. Conclusion Intraoperative injection of normal saline through lumbar drainage can not only better expose the complex leak but also check the repair effect of the leak during transnasal endoscopic repair, which is effective and avoids side effects.
Coupling of translation and rotation in the motion of finite-length rods near solid boundaries

Abstract The motion of finite-length cylindrical rods moving near a planar rigid surface is a scenario common across many engineering and natural settings. We study the low-Reynolds-number flow around finite rods that are allowed to rotate or translate in directions perpendicular or parallel to the plane. We develop a three-dimensional lubrication theory to characterize the pressure and hydrodynamic resistances of the cylinders through a special consideration of the cylinder's end effects. In addition, we use three-dimensional numerical simulations to solve these Stokes flows for cylinders of varying lengths and with varying gap sizes between the cylinder and plane, and the numerical results support the developed analytical descriptions. We also use visualizations of the flow to provide qualitative insights and rationalize the effect of the ends on the dynamics of the cylinders. The numerical simulations and theoretical predictions show good agreement in the long (isolated ends) and short (disk-like) limits.
Clustering spam domains and hosts: anti-spam forensics with data mining

Spam related cyber crimes, including phishing, malware and online fraud, are a serious threat to society. Spam filtering has been the major weapon against spam for many years but failed to reduce the number of spam emails. To hinder spammers’ capability of sending spam, their supporting infrastructure needs to be disrupted. Terminating spam hosts will greatly reduce spammers’ profit and thwart their ability to commit spam-related cyber crimes. This research proposes an algorithm for clustering spam domains based on the hosting IP addresses and related email subjects. The algorithm can also detect significant hosts over a period of time. Experimental results show that when domain names are investigated, many seemingly unrelated spam emails are actually related. By using wildcard DNS records and constantly replacing old domains with new domains, spammers can effectively defeat URL or domain based blacklisting. Spammers also refresh hosting IP addresses occasionally, but less frequently than domains. The identified domains and their hosting IP addresses can be used by cyber-crime investigators as leads to trace the identities of spammers and shut down the related spamming infrastructure. This paper demonstrates how data mining can help to detect spam domains and their hosts for anti-spam forensic purposes. Keywords: spam, forensics, clustering, data mining
Predation Stress Causes Excessive Aggression in Female Mice with Partial Genetic Inactivation of Tryptophan Hydroxylase-2: Evidence for Altered Myelination-Related Processes

The interaction between brain serotonin (5-HT) deficiency and environmental adversity may predispose females to excessive aggression. Specifically, complete inactivation of the gene encoding tryptophan hydroxylase-2 (Tph2) results in the absence of neuronal 5-HT synthesis and excessive aggressiveness in both male and female null mutant (Tph2−/−) mice. In heterozygous male mice (Tph2+/−), there is a moderate reduction in brain 5-HT levels, and when they are exposed to stress, they exhibit increased aggression. Here, we exposed female Tph2+/− mice to a five-day rat predation stress paradigm and assessed their emotionality and social interaction/aggression-like behaviors. Tph2+/− females exhibited excessive aggression and increased dominant behavior. Stressed mutants displayed altered gene expression of the 5-HT receptors Htr1a and Htr2a, glycogen synthase kinase-3 β (GSK-3β), and c-fos as well as myelination-related transcripts in the prefrontal cortex: myelin basic protein (Mbp), proteolipid protein 1 (Plp1), myelin-associated glycoprotein (Mag), and myelin oligodendrocyte glycoprotein (Mog). The expression of the plasticity markers synaptophysin (Syp) and cAMP response element binding protein (Creb), but not AMPA receptor subunit A2 (GluA2), were affected by genotype. Moreover, in a separate experiment, naïve female Tph2+/− mice showed signs of enhanced stress resilience in the modified swim test with repeated swimming sessions. Taken together, the combination of a moderate reduction in brain 5-HT with environmental challenges results in behavioral changes in female mice that resemble the aggression-related behavior and resilience seen in stressed male mutants; additionally, the combination is comparable to the phenotype of null mutants lacking neuronal 5-HT. Changes in myelination-associated processes are suspected to underpin the molecular mechanisms leading to aggressive behavior.
A compensation sliding mode control for machining robotic manipulators based on nonlinear disturbance observer

The machining robotic manipulators (MRMs) find a broad range of applications due to their high efficiency, wide range of processing, and strong flexibility. High tracking accuracy and strong anti-interference ability are required to trajectory tracking control of machining robot during processing. In view of the above characteristics, this paper proposes a compensation sliding mode control (CSMC) based on nonlinear disturbance observer (NBO-CSMC) for MRM. First, we deduced the dynamic model of MRM considering the uncertainties and disturbances. Then, for improving the trajectory tracking accuracy, a compensation sliding mode controller is designed based on the traditional sliding mode control (TSMC) strategy. Finally, in order to reduce the chattering in sliding mode control, the NBO-CSMC is designed for MRM, NBO is used to estimate the external composite uncertain interference existing in the system, and compensate the system control input in real time. The Lyapunov’s theory proved the stability of the proposed algorithm, and simulation experiments verified the effectiveness of the proposed control strategy.
Comparative impacts of long‐term trends in snowmelt and species interactions on plant population dynamics

Climate change can impact plant fitness and population persistence directly through changing abiotic conditions and indirectly through its effects on species interactions. Pollination and seed predation are important biotic interactions that can impact plant fitness, but their impact on population growth rates relative to the role of direct climatic effects is unknown. We combined 13 years of experiments on pollen limitation of seed set and pre‐dispersal seed predation in Ipomopsis aggregata, a subalpine wildflower, with a long‐term demographic study that has documented declining population growth with earlier spring snowmelt date. We determined how pollen limitation and seed predation changed with snowmelt date over 21 years and incorporated those effects into an integral projection model to assess relative impacts of biotic factors on population growth. Both pollen limitation and the difference in stigma pollen load between pollen‐supplemented and control plants declined over years. Neither pollen limitation nor seed predation changed detectably with snowmelt date, suggesting an absence of indirect effects of that specific abiotic factor on these indices of biotic interactions. The projected biotic impacts of pollen limitation and seed predation on population growth rate were small compared to factors associated with snowmelt date. Providing full pollination would delay the projected date when earlier snowmelt will cause populations to fall below replacement by only 14 years. Synthesis. Full pollination and elimination of seed predation would not compensate for the strong detrimental effects of early snowmelt on population growth rate, which in I. aggregata appears driven largely by abiotic environmental factors. The reduction over two decades in pollen limitation also suggests that natural selection on floral traits may weaken with continued climate change. These results highlight the value of studying both abiotic factors and biotic interactions to understand how climate change will influence plant populations.
Abstract 19003: Extracellular ATP Induces Vascular Inflammation and Atherosclerosis via P2Y2 in Mice

Introduction: A solid body of evidence supports a role of extracellular ATP and ist P2-receptors in innate and adaptive immunity. It promotes inflammation as a danger signal in various chronic inflammatory diseases. Hypothesis: We hypothesize contribution of extracellular ATP and its receptor P2Y2 in vascular inflammation and atherosclerosis.Methods: Leukocyte rolling and adhesion after stimulation with ATP was determined with intravitalmicroscopy in P2Y2-competent and P2Y2-deficient mice. Migration was analyzed with peritonitis model. To test the role of extracellular ATP in atherosclerosis, ATP or saline as control was injected intraperitoneally three times a week in LDLR-/- mice consuming high cholesterol diet (HCD). Furthermore, P2Y2-competent or P2Y2-deficient mice consumed a HCD for 16 weeks. Atherosclerosis was determined with immunhistochemistry and lesional expression of inflammatory molecules was measured with realtime PCR. Results: Extracellular ATP induced leukocyte rolling, adhesion, and migration as assessed by intravital microscopy and in sterile peritonitis. Atherosclerosis significantly increased after 16 weeks in ATP-treated mice (n=13; control group 0.26mm2; ATP group 0.33mm2, p=0.01). To gain into the role of ATP-receptor P2Y2 in ATP induced leukocyte recruitment, ATP was administered systemically in P2Y2-deficient or -competent mice. In P2Y2-deficient mice the ATP induced leukocyte adhesion was significantly reduced. P2Y2 expression in atherosclerosis was measured by real-time PCR and immunohistochemistry and demonstrates an increased expression s mainly due to influx of P2Y2-expressing macrophages. To investigate the functional role of P2Y2 in atherogenesis, P2Y2-deficient LDLR-/- mice consumed HCD. After 16 weeks P2Y2-deficient mice showed significantly reduced atherosclerotic lesions with decreased macrophages compared to P2Y2-competent mice (n=11; aortic arch: control group 0.25mm2; P2Y2-deficient 0.14mm2, p=0.04). Mechanistically,atherosclerotic lesions from P2Y2-deficient mice expressed less lesional VCAM-1 and ICAM-1 RNA . Conclusion: We show for the first time that extracellular ATP induces vascular inflammation and atherosclerosis via activation of P2Y2.
The Possibility of Using Probiotics in the Aquaculture of Freshwater Fish

Listed as one of the highest producer of aquaculture fish, Indonesia’s fisheries sector holds a promising potential to be developed as source of global food security. The total production value of both inland and marine farming from both fish and non-fish species were reported to be increased each year. The current government targeted to excel the production up to 25% by 2024. To support this, many innovation and research have been done to accelerate the production of cultured fish, especially fresh water fish which demand is always high in the market. Several fresh water fish commodities have a poor growing performances, such as growth rate, feed conversion ratio (FCR) and survival rate. Thus, a probiotics were used to boost their performance. Probiotics is known for their ability to enhance the growth of fish by secreting enzyme which beneficial to breakdown complex compounds, making it easier to digest for the fish. It is also commercially widespread in the market in various form, either incorporated to the feed or directly use to the medium. In this review, a comprehensive analysis of how probiotics help to increase aquaculture efficiency of fresh water fish will be thoroughly discussed. The discussion will be focus on three fresh water fish species, which are Gouramy fingerlings (Oshpronemus gouramy) Siamese catfish (Pangasius hypopthalmus) And Nilem fish (Osteochillus hasselti) .
Agricultural buffer zone thresholds to safeguard functional bee diversity: Insights from a community modeling approach

Abstract Wild bee species are important pollinators in agricultural landscapes. However, population decline was reported over the last decades and is still ongoing. While agricultural intensification is a major driver of the rapid loss of pollinating species, transition zones between arable fields and forest or grassland patches, i.e., agricultural buffer zones, are frequently mentioned as suitable mitigation measures to support wild bee populations and other pollinator species. Despite the reported general positive effect, it remains unclear which amount of buffer zones is needed to ensure a sustainable and permanent impact for enhancing bee diversity and abundance. To address this question at a pollinator community level, we implemented a process‐based, spatially explicit simulation model of functional bee diversity dynamics in an agricultural landscape. More specifically, we introduced a variable amount of agricultural buffer zones (ABZs) at the transition of arable to grassland, or arable to forest patches to analyze the impact on bee functional diversity and functional richness. We focused our study on solitary bees in a typical agricultural area in the Northeast of Germany. Our results showed positive effects with at least 25% of virtually implemented agricultural buffer zones. However, higher amounts of ABZs of at least 75% should be considered to ensure a sufficient increase in Shannon diversity and decrease in quasi‐extinction risks. These high amounts of ABZs represent effective conservation measures to safeguard the stability of pollination services provided by solitary bee species. As the model structure can be easily adapted to other mobile species in agricultural landscapes, our community approach offers the chance to compare the effectiveness of conservation measures also for other pollinator communities in future.
The Pattern of Thyroid Malignancy and Its Associated Characteristics Among United Arab Emirates Population With More Focus on Patients in the Bethesda III Category

Introduction: Thyroid cancer is the most prevalent endocrine cancer worldwide. It is the second most common type of cancer among United Arab Emirates (UAE) women and ranks as the sixth most common type of cancer overall among the UAE population. There are limited studies in the UAE related to thyroid malignancy. This study aimed to determine the pattern of thyroid malignancy among the UAE population and its associated characteristics, with more emphasis on patients categorized as Bethesda III by cytopathology, and furthermore, to determine the significance of advanced diagnostic methods in the assessment of thyroid nodules. Methods: A retrospective review of the electronic medical charts of adult patients (age 18 and above) who were diagnosed with a thyroid nodule by ultrasound during the years 2019 and 2020. It is a comparative study of different variables associated with thyroid nodules and thyroid malignancy. Results: A total of 1072 patients were diagnosed with thyroid nodules upon initial ultrasound. We had 174 patients diagnosed with thyroid malignancy, constituting 16% (95% CI 0.14-0.19) of the total study population. 78% of the thyroid malignancy patients were women as compared to men, and this difference was statistically significant (p=0.042). Non-UAE nationals comprised 61% of the population diagnosed with thyroid malignancy (95% CI 1.37-2.68). Malignancy was found to be more common in patients with multinodular goiter, in the 30 to 39-year age group, and in patients with high ultrasound and Bethesda grades. From the total study population, 140 patients had cytology reports in the Bethesda III category. Thyroid malignancy was found in 30 patients with Bethesda III, and this comprised 17% of the total population who were diagnosed with thyroid malignancy. Conclusion: Despite being a single-center study, it highlights the percentage of thyroid malignancy and its associated factors among the UAE population. Thyroid ultrasound grading and Bethesda classification guide physicians in risk stratification, but it remains challenging in patients who fall into the Bethesda III category. Intervention versus regular follow-up should not depend on a single value but on the overall clinical picture and the use of advanced diagnostic methods.
Prediksi Kepribadian Pengguna Instagram Berdasarkan Model Big Five Personality Menggunakan Algoritma SVM

Abstrak— Popularitas media sosial Instagram terus merangkak naik sejak debutnya pada tahun 2010. Popularitas tersebut membuat Instagram menjadi media sosial terbesar di dunia di samping Facebook dan Twitter. Kini sebagian besar perusahaan mulai menggunakan media sosial sebagai salah satu aspek untuk menilai kepribadian pelamar. Analisis kepribadian dapat dilakukan dengan mengamati aktivitas di media sosial. Hal ini menjadi alasan dibalik pentingnya pembuatan sistem prediksi kepribadian otomatis berdasarkan aktivitas di media sosial. Instagram dipilih sebagai sumber data pada penelitian ini, dan Big Five Personality dipilih sebagai model kepribadian untuk pelabelan data. Pengumpulan data dilakukan dengan melakukan tes kepribadian terhadap 191 pengguna Instagram, kemudian melakukan crawling feed akun Instagram menggunakan API Instagram. Berdasarkan hasil pengujian sistem, kombinasi algoritma Support Vector Machine dengan kernel RBF dan Bayesian Optimization mampu menghasilkan akurasi mencapai 60.34%, presisi 30.17%, dan recall 50% untuk mengklasifikasi kepribadian pengguna Instagram. Kata Kunci— prediksi kepribadian, big five personality, instagram, support vector machine, bayesian optimization.
On High-Dimensional Time-Variant Reliability Analysis with the Maximum Entropy Principle

The structural reliability analysis suffers from the curse of dimensionality if the associated limit state function involves a large number of inputs. This study develops a reliability analysis method that deals with high-dimensional inputs over time. The probability distribution of the structural response is reconstructed by the maximum entropy principle which is achieved by solving an optimization problem derived from the concept of relative entropy. The optimization problem is transformed into a convex one with respect to the orders of fractional moments and the Lagrange multipliers. Additionally, considering the associated computational issues, it is reformulated with side constraints on the parameters of the maximum entropy distribution. Then, a global optimization procedure is performed. The proposed method is successfully applied to the reliability analysis of a linear and a nonlinear structural system, which involves a large number of inputs deriving from the discretization of the input random processes.