Miracle-dz/UniFAR-FTUs huggingface dataset:
Carousel Memory: Rethinking the Design of Episodic Memory for Continual Learning

Continual Learning (CL) is an emerging machine learning paradigm that aims to learn from a continuous stream of tasks without forgetting knowledge learned from the previous tasks. To avoid performance decrease caused by forgetting, prior studies exploit episodic memory (EM), which stores a subset of the past observed samples while learning from new non-i.i. d. data. Despite the promising results, since CL is often assumed to execute on mobile or IoT devices, the EM size is bounded by the small hardware memory capacity and makes it infeasible to meet the accuracy requirements for real-world applications. Specifically, all prior CL methods discard samples overflowed from the EM and can never retrieve them back for subsequent training steps, incurring loss of information that would exacerbate catastrophic forgetting. We explore a novel hierarchical EM management strategy to address the forgetting issue. In particular, in mobile and IoT devices, real-time data can be stored not just in high-speed RAMs but in internal storage devices as well, which offer significantly larger capacity than the RAMs. Based on this insight, we propose to exploit the abundant storage to preserve past experiences and alleviate the forgetting by allowing CL to efficiently migrate samples between memory and storage without being interfered by the slow access speed of the storage. We call it Carousel Memory (CarM). As CarM is complementary to existing CL methods, we conduct extensive evaluations of our method with seven popular CL methods and show that CarM significantly improves the accuracy of the methods across different settings by large margins in final average accuracy (up to 28.4%) while retaining the same training efficiency.
Identifying Introductions in Podcast Episodes from Automatically Generated Transcripts

As the volume of long-form spoken-word content such as podcasts explodes, many platforms desire to present short, meaningful, and logically coherent segments extracted from the full content. Such segments can be consumed by users to sample content before diving in, as well as used by the platform to promote and recommend content. However, little published work is focused on the segmentation of spoken-word content, where the errors (noise) in transcripts generated by automatic speech recognition (ASR) services poses many challenges. Here we build a novel dataset of complete transcriptions of over 400 podcast episodes, in which we label the position of introductions in each episode. These introductions contain information about the episodes' topics, hosts, and guests, providing a valuable summary of the episode content, as it is created by the authors. We further augment our dataset with word substitutions to increase the amount of available training data. We train three Transformer models based on the pre-trained BERT and different augmentation strategies, which achieve significantly better performance compared with a static embedding model, showing that it is possible to capture generalized, larger-scale structural information from noisy, loosely-organized speech data. This is further demonstrated through an analysis of the models' inner architecture. Our methods and dataset can be used to facilitate future work on the structure-based segmentation of spoken-word content.
Deep Chandra observations of diffuse hot plasma in M83

It is widely believed that galaxy formation and evolution is regulated by stellar mechanical feedback in forms of fast stellar winds and supernova explosions. However, the coupling of this feedback with the interstellar medium remains poorly understood. We examine how the coupling may be traced by diffuse soft X-ray emission in M83 – a nearby face-on spiral galaxy undergoing active star formation, based chiefly on 729 ks Chandra observations. Our main findings are 1) the X-ray emission is enhanced not only along the galaxy’s grand spiral arms, but also clearly in their downstreams; 2) the spectrum of the emission can be well characterized by a super-solar metallicity plasma with a lognormal temperature distribution, plus an X-ray absorption of a lognormal column density distribution; 3) the intensity of the emission is strongly anti-correlated with the dust obscuration seen in optical images of the galaxy. These findings suggest A) the morphology of the X-ray emission is likely due to the convolution of the feedback heating of the plasma with its thermal and dynamical evolution; B) the X-ray emission, accounting for∼ 10% of the feedback energy input rate, probably traces only the high-energy tail of the radiation from the plasma; C) a good fraction of the recent star forming regions seems sufficiently energetic to produce multi-phased outflows, likely responsible for much of the dust obscuration and X-ray absorption. Direct confrontation of the findings with theories/simulations could help to understand the underlying astrophysics of the coupling and how the hot plasma shapes the interstellar medium.
A CLIP-Enhanced Method for Video-Language Understanding

This technical report summarizes our method for the Video-And-Language Understanding Evaluation (VALUE) challenge (https://value-benchmark.github.io/challenge\_2021.html). We propose a CLIP-Enhanced method to incorporate the image-text pretrained knowledge into downstream video-text tasks. Combined with several other improved designs, our method outperforms the state-of-the-art by $2.4\%$ ($57.58$ to $60.00$) Meta-Ave score on VALUE benchmark.
ADMM-DAD Net: A Deep Unfolding Network for Analysis Compressed Sensing

In this paper, we propose a new deep unfolding neural network based on the ADMM algorithm for analysis Compressed Sensing. The proposed network jointly learns a redundant analysis operator for sparsification and reconstructs the signal of interest. We compare our proposed network with a state-of-the-art unfolded ISTA decoder, that also learns an orthogonal sparsifier. Moreover, we consider not only image, but also speech datasets as test examples. Computational experiments demonstrate that our proposed network outperforms the state-of-the-art deep unfolding network, consistently for both real-world image and speech datasets.
WAFFLE: Weighted Averaging for Personalized Federated Learning

In federated learning, model personalization can be a very effective strategy to deal with heterogeneous training data across clients. We introduce WAFFLE (Weighted Averaging For Federated LEarning), a personalized collaborative machine learning algorithm that leverages stochastic control variates for faster convergence. WAFFLE uses the Euclidean distance between clients' updates to weigh their individual contributions and thus minimize the personalized model loss on the specific agent of interest. Through a series of experiments, we compare our new approach to two recent personalized federated learning methods--Weight Erosion and APFL--as well as two general FL methods--Federated Averaging and SCAFFOLD. Performance is evaluated using two categories of non-identical client data distributions--concept shift and label skew--on two image data sets (MNIST and CIFAR10). Our experiments demonstrate the comparative effectiveness of WAFFLE, as it achieves or improves accuracy with faster convergence.
Methylation Modification, Alternative Splicing, and Noncoding RNA Play a Role in Cancer Metastasis through Epigenetic Regulation

Metastasis is the leading cause of cancer-related deaths. Understanding the pathogenesis of metastasis at the molecular levels is of great significance for cancer research. However, the molecular diagnosis or treatment of cancer metastasis is limited. Accumulating and growing evidence shows that epigenetic changes are present in all human cancers, and epigenetic regulation is an indispensable factor to promote tumor metastasis. With the deepening of research and the advancement of technology, the function and mechanism of epigenetic regulation, including DNA methylation, histone/RNA modification, and precursor messenger RNA alternative splicing and noncoding RNAs, has become more increasingly clear. At present, the application of epigenetic therapies in tumor treatment is becoming a feasible therapeutic route. In this review, we looked for the key molecules in epigenetic regulation and discuss their relative regulating mechanisms in cancer metastasis. Furthermore, we highlight promising therapeutic strategies, including monitoring serum DNA for diagnostic purposes and early phase clinical trial therapies that target DNA and histone methylation. This may also be beneficial in finding new targets for further prognosis and diagnosis of cancer metastasis.
Atrial fibrillation in advanced renal failure: are there alternative solutions to warfarin-dicumarol?

Abstract Patients with atrial fibrillation (AF) and chronic renal failure (CRF) represent a growing population in epidemiological terms since both conditions increase with advancing age. The association of AF and CRF is burdened with a poor prognosis and with a high risk of adverse events, both ischaemic and haemorrhagic. Oral anticoagulant therapy, in these patients, is more problematic, especially due to the concomitant increased risk of bleeding. The use of direct oral anticoagulants (DOACs) in patients with non-severe renal insufficiency appears to be safe and effective. Since all currently available DOACs are at least partially eliminated by the kidney (dabigatran is the direct anticoagulant with the highest rate of renal elimination, approximately 80%), periodic monitoring of renal function is recommended to evaluate possible need for dosage adjustment. In patients with advanced renal insufficiency, the use of DOAC appears controversial, given the small number of clinical studies that have tested its efficacy and safety. It is known, however, that oral anticoagulation therapy with vitamin K antagonists (VKAs) is associated with an increase in nephropathy and renal-vascular calcification. From this point of view, therapy with DOAC could be more advantageous than VKAs. Data from clinical studies would seem to show that the use of dabigatran and rivaroxaban in these patients may lead to a reduction in the inevitable deterioration of renal function.
Osteoporosis therapies and their mechanisms of action (Review)

Osteoporosis is a common disease that affects millions of patients worldwide and is most common in menopausal women. The main characteristics of osteoporosis are low bone density and increased risk of fractures due to deterioration of the bone architecture. Osteoporosis is a chronic disease that is difficult to treat; thus, investigations into novel effective therapeutic methods are required. A number of studies have focused on determining the most effective treatment options for this disease. There are several treatment options for osteoporosis that differ depending on the characteristics of the disease, and these include both well-established and newly developed drugs. The present review focuses on the various drugs available for osteoporosis, the associated mechanisms of action and the methods of administration.
Pathways of Glucagon Secretion and Trafficking in the Pancreatic Alpha Cell: Novel Pathways, Proteins, and Targets for Hyperglucagonemia

Patients with diabetes mellitus exhibit hyperglucagonemia, or excess glucagon secretion, which may be the underlying cause of the hyperglycemia of diabetes. Defective alpha cell secretory responses to glucose and paracrine effectors in both Type 1 and Type 2 diabetes may drive the development of hyperglucagonemia. Therefore, uncovering the mechanisms that regulate glucagon secretion from the pancreatic alpha cell is critical for developing improved treatments for diabetes. In this review, we focus on aspects of alpha cell biology for possible mechanisms for alpha cell dysfunction in diabetes: proglucagon processing, intrinsic and paracrine control of glucagon secretion, secretory granule dynamics, and alterations in intracellular trafficking. We explore possible clues gleaned from these studies in how inhibition of glucagon secretion can be targeted as a treatment for diabetes mellitus.
And yet, migration, population growth or mortality are not balanced among Cantabrian brown bear subpopulations. Reply to Blanco et al (2020)

In a recent paper, we presented new evidence and provided new insights on the status of Cantabrian brown bear subpopulations, relevant for this species conservation. Namely, we revealed the likely phylogeographic relation between eastern Cantabrian subpopulation and the historical Pyrenean population. We have also detected an asymmetric flow of alleles and individuals from the eastern to the western subpopulation, including seven first-generation male migrants. Based on our results and on those of previous studies, we called the attention to the fact that Eastern Cantabrian brown bears might be taking advantage of increased connectivity to avoid higher human pressure and direct persecution in the areas occupied by the eastern Cantabrian subpopulation. In reply, Blanco et al (2020) [11] have criticized our ecological interpretation of the data presented in our paper. Namely, Blanco and co-authors criticize: (1) the use of the exodus concept in the title and discussion of the paper; (2) the apparent contradiction with source-sink theory; (3) the apparent overlooking of historical demographic data on Cantabrian brown bear and the use of the expression of population decline when referring to eastern subpopulation. Rather than contradicting the long and growing body of knowledge on the two brown bear subpopulations, the results presented in our paper allow a new perspective on the causes of the distinct pace of population growth of the two brown bear subpopulations in the last decades. Here, we reply to the criticisms by: clarifying our ecological interpretation of the results; refocusing the discussion on how the new genetic data suggest that currently, the flow of individuals and alleles is stronger westward, and how it may be linked to direct persecution and killing of brown bears. We provide detailed data on brown bear mortality in the Cantabrian Mountains and show that neither migration, gene flow, population increase nor mortality are balanced among the two subpopulations.
Neuron-Connection Level Sharing for Multi-Task Learning in Video Conversion Rate Prediction

Click-through Rate (CTR) and post-click conversion rate(CVR) predictions are two fundamental modules in industrial ranking systems such as recommender systems, advertising, and search engines. Most existing works try to utilize CTR&CVR multi-task learning to improve CVR performance due to the CVR data sparsity involving much fewer samples than CTR. However, the typical coarse-grained sub-network/layer sharing methods introduce conflict and lead to performance degeneration as not every neuron or neuron connection in a layer should be shared across both CVR and CTR tasks. This is because users may have different fine-grained content feature preferences between deep consumption and clicking behavior, represented by the CVR and CTR, respectively. To address this sharing&conflict issue, we propose a novel neuron-connection level-sharing multi-task CVR modeling scheme that automatically and flexibly learns which neuron weights to share or not without artificial experience. It’s the first time to provide neuron-connection level fine-grained CTR&CVR sharing compared to the previous layer-level sharing method, which is a research paradigm shift in the sharing level. Both offline and online experiments on Tencent Video’s recommender system demonstrate the superiority of our method over the single-task model and the layer level sharing model. Our proposed approach has now been successfully deployed in the online recommender system of Tencent Video serving the main traffic. 1 CCS Concepts: • Information systems → Retrieval models and ranking .
Female gender as a risk factor for developing COPD

1 Discipline of Pharmacy, Graduate School of Health, University of Technology Sydney, Ultimo, NSW 2007, Australia 2 Faculty of Health, Australian Research Centre in Complementary and Integrative Medicine, University of Technology Sydney, Ultimo, NSW 2007, Australia 3 School of Pharmacy and Pharmacology, University of Tasmania, Hobart, Australia 4 Department of Biotechnology, School of Engineering & Technology (SET), Sharda University, Greater Noida, 201310, UP, India 5 School of Pharmaceutical Sciences, Jaipur National University, Jagatpura, 302017, Jaipur, India 6 Department of Life Sciences, School of Pharmacy, International Medical University, Bukit Jalil, Kuala Lumpur 57000, Malaysia 7 School of Medicine and Public Health, Faculty of Health and Medicine, University of Newcastle, Callaghan, NSW, 2308, Australia
Force production and muscle activation during partial vs. full range of motion in Paralympic Powerlifting

Paralympic Powerlifting is a sport in which the strength of the upper limbs is assessed through bench press performance in an adapted specific bench. It is therefore essential to optimize training methods to maximize this performance. The aim of the present study was to compare force production and muscle activation involved in partial vs. full range of motion (ROM) training in Paralympic Powerlifting. Twelve male athletes of elite national level in Paralympic Powerlifting participated in the study (28.60 ± 7.60 years of age, 71.80 ± 17.90 kg of body mass). The athletes performed five sets of 5RM (repetition maximum), either with 90% of 1RM in full ROM or with a load of 130% 1RM in partial ROM. All subjects underwent both exercise conditions in consecutive weeks. Order assignment in the first week was random and counterbalanced. Fatigue index (FI), Maximum Isometric Force (MIF), Time to MIF (Time) and rate of force development (RFD) were determined by a force sensor. Muscle thickness was obtained using ultrasound images. All measures were taken pre- and post-training. Additionally, electromyographic signal (EMG) was evaluated in the last set of each exercise condition. Post-exercise fatigue was higher with full ROM as well as loss of MIF. Full ROM also induced greater. EMG showed greater activation of the Clavicular portion and Sternal portion of pectoralis major muscle and lower in the anterior portion of deltoid muscle when full ROM was performed. Muscle thickness of the pectoralis major muscle increased post-exercise. We concluded that training with partial ROM enables higher workloads with lower loss of muscle function.
These boots are made for burnin’: Inferring the position of the corpse and the presence of leather footwears during cremation through isotope (δ13C, δ18O) and infrared (FTIR) analyses of experimentally burnt skeletal remains

Cremation is a complex mortuary practice, involving a number of activities of the living towards the dead before, during, and after the destruction of the bodily soft tissues by fire. The limiting information concerning these behavioral patterns obtained from the pyre remains and/or cremation deposits prevents the reconstruction of the handling of the corpse during the burning process. This pioneering study tries to determine the initial positioning of the corpse in the pyre and assess whether the deceased was wearing closed leather shoes during cremation through isotopic (δ13C, δ18O) and infrared (ATR-FTIR) analyses of experimentally burnt pig remains, used as a proxy for humans. The results obtained show that both the position of feet on or within the pyre and the presence of footwears may moderately-to-highly influence the oxygen isotope ratios of bone apatite carbonates and the cyanamide content of calcined bone in certain situations. By forming a protective layer, shoes appear to temporarily delay the burning of the underlying pig tissues and to increase the heat-shielding effect of the soft tissues protecting the bone mineral fraction. In such case, bioapatite bone carbonates exchange oxygen with a relatively more 18O-depleted atmosphere (due to the influence of lignin-derived oxygen rather than cellulose-derived oxygen), resulting in more pronounced decrease in the δ18Ocarb values during burning of the shoed feet vs. unshoed feet. The shift observed here was as high as 2.5‰. A concomitant isotopic effect of the initial location of the feet in the pyres was also observed, resulting in a top-to-bottom decrease difference in the δ18Ocarb values of shoed feet of about 1.4‰ between each deposition level tested. Finally, the presence of cyanamide (CN/P ≥ 0.02) seems to be indicative of closed footwear since the latter creates favorable conditions for its incorporation into bone apatite.
Short-term outcomes of cochlear implantation for single-sided deafness compared to bone conduction devices and contralateral routing of sound hearing aids—Results of a Randomised controlled trial (CINGLE-trial)

Single-sided deafness (SSD) leads to difficulties with speech perception in noise, sound localisation, and sometimes tinnitus. Current treatments (Contralateral Routing of Sound hearing aids (CROS) and Bone Conduction Devices (BCD)) do not sufficiently overcome these problems. Cochlear implants (CIs) may help. Our aim was to evaluate these treatments in a Randomised Controlled Trial (RCT). Adult SSD patients were randomised using a web-based randomisation tool into one of three groups: CI; trial period of ‘first BCD, then CROS’; trial period of ‘first CROS, then BCD’. After these trial periods, patients opted for BCD, CROS, or No treatment. The primary outcome was speech perception in noise (directed from the front (S0N0)). Secondary outcomes were speech perception in noise with speech directed to the poor ear and noise to the better ear (SpeNbe) and vice versa (SbeNpe), sound localisation, tinnitus burden, and disease-specific quality of life (QoL). We described results at baseline (unaided situation) and 3 and 6 months after device activation. 120 patients were randomised. Seven patients did not receive the allocated intervention. The number of patients per group after allocation was: CI (n = 28), BCD (n = 25), CROS (n = 34), and No treatment (n = 26). In S0N0, the CI group performed significantly better when compared to baseline, and when compared to the other groups. In SpeNbe, there was an advantage for all treatment groups compared to baseline. However, in SbeNpe, BCD and CROS groups performed worse compared to baseline, whereas the CI group improved. Only in the CI group sound localisation improved and tinnitus burden decreased. In general, all treatment groups improved on disease-specific QoL compared to baseline. This RCT demonstrates that cochlear implantation for SSD leads to improved speech perception in noise, sound localisation, tinnitus burden, and QoL after 3 and 6 months of follow-up. For most outcome measures, CI outperformed BCD and CROS. Trial registration: Netherlands Trial Register (www.trialregister.nl): NTR4580, CINGLE-trial.