Miracle-dz/UniFAR-FTUs huggingface dataset:
Towards Robust Real-time Audio-Visual Speech Enhancement

The human brain contextually exploits heterogeneous sensory information to efficiently perform cognitive tasks including vision and hearing. For example, during the cocktail party situation, the human auditory cortex contextually integrates audio-visual (AV) cues in order to better perceive speech. Recent studies have shown that AV speech enhancement (SE) models can significantly improve speech quality and intelligibility in very low signal to noise ratio (SNR) environments as compared to audio-only SE models. However, despite significant research in the area of AV SE, development of real-time processing models with low latency remains a formidable technical challenge. In this paper, we present a novel framework for low latency speaker-independent AV SE that can generalise on a range of visual and acoustic noises. In particular, a generative adversarial networks (GAN) is proposed to address the practical issue of visual imperfections in AV SE. In addition, we propose a deep neural network based real-time AV SE model that takes into account the cleaned visual speech output from GAN to deliver more robust SE. The proposed framework is evaluated on synthetic and real noisy AV corpora using objective speech quality and intelligibility metrics and subjective listing tests. Comparative simulation results show that our real time AV SE framework outperforms state-of-the-art SE approaches, including recent DNN based SE models.
Forensic Analysis of Synthetically Generated Scientific Images

—The widespread diffusion of synthetically generated content is a serious threat that needs urgent countermeasures. The generation of synthetic content is not restricted to multimedia data like videos, photographs, or audio sequences, but covers a signiﬁcantly vast area that can include biological images as well, such as western-blot and microscopic images. In this paper, we focus on the detection of synthetically generated western-blot images. These images are largely explored in the biomedical literature and it has been already shown how they can be easily counterfeited with few hopes to spot manipulations by visual inspection or by standard forensics detectors. To overcome the absence of a publicly available dataset in this area, we create a new dataset comprising more than 14K original western-blot images and 18K synthetic western-blot images, generated using four different state-of-the-art generation methods. We investigate different strategies to detect synthetic western blots, exploring binary classiﬁcation methods as well as one-class detectors. In both scenarios, we never exploit synthetic western-blot images at training stage. The achieved results show that synthetically generated western-blot images can be spot with good accuracy, even though the exploited detectors are not optimized over synthetic versions of these scientiﬁc images. We also test the robustness of the developed detectors against common post-processing operations performed on scientiﬁc images, showing that we can be robust to JPEG compression and that some generative models can be easily detected, independently of the post-processing applied.
Regimes of cavity QED under incoherent excitation: From weak to deep strong coupling

The prototypical system constituted by a two-level atom interacting with a quantized single-mode electromagnetic ﬁeld is described by the quantum Rabi model (QRM). The QRM is potentially valid at any light-matter interaction regime, ranging from the weak (where the decay rates exceeds the coupling rate) to the deep strong coupling (where the interaction rate exceeds the bare transition frequencies of the subsystems). However, when reaching the ultrastrong coupling regime, several theoretical issues may prevent the correct description of the observable dynamics of such a system: (i) the standard quantum optics master equation fails to correctly describe the interaction of this system with the reservoirs; (ii) the correct output photon rate is no longer proportional to the intracavity photon number; and (iii) they appear to violate gauge invariance. Here, we study the photon ﬂux emission rate of this system under the incoherent excitation of the two-level atom for any light-matter interaction strength and consider different effective temperatures. The dependence of the emission spectra on the coupling strength is the result of the interplay between energy levels, matrix elements of the observables, and the density of states of the reservoirs. Within this approach, we also study the occurrence of light-matter decoupling in the deep strong-coupling regime and show how all of the obtained results are gauge invariant.
Rethinking Nearest Neighbors for Visual Classification

Neural network classifiers have become the de-facto choice for current"pre-train then fine-tune"paradigms of visual classification. In this paper, we investigate k-Nearest-Neighbor (k-NN) classifiers, a classical model-free learning method from the pre-deep learning era, as an augmentation to modern neural network based approaches. As a lazy learning method, k-NN simply aggregates the distance between the test image and top-k neighbors in a training set. We adopt k-NN with pre-trained visual representations produced by either supervised or self-supervised methods in two steps: (1) Leverage k-NN predicted probabilities as indications for easy vs. hard examples during training. (2) Linearly interpolate the k-NN predicted distribution with that of the augmented classifier. Via extensive experiments on a wide range of classification tasks, our study reveals the generality and flexibility of k-NN integration with additional insights: (1) k-NN achieves competitive results, sometimes even outperforming a standard linear classifier. (2) Incorporating k-NN is especially beneficial for tasks where parametric classifiers perform poorly and / or in low-data regimes. We hope these discoveries will encourage people to rethink the role of pre-deep learning, classical methods in computer vision. Our code is available at: https://github.com/KMnP/nn-revisit.
Turbulent magnetic field amplification in binary neutron star mergers

Magnetic ﬁelds are expected to play a key role in the dynamics and the ejection mechanisms that accompany the merger of two neutron stars. General relativistic magnetohydrodynamic (MHD) simulations oﬀer a unique opportunity to unravel the details of the ongoing physical processes. Nevertheless, current numerical studies are severely limited by the fact that any aﬀordable resolution remains insuﬃcient to fully capture the small-scale dynamo, initially triggered by the Kelvin-Helmholtz instability, and later sourced by several MHD processes involving diﬀerential rotation. Here, we alleviate this limitation by using explicit large-eddy simulations, a technique where the unresolved dynamics occurring at the sub-grid scales (SGS) is modeled by extra terms, which are functions of the resolved ﬁelds and their derivatives. The combination of high-order numerical schemes, high resolutions, and the gradient SGS model allow us to capture the small-scale dynamos produced during the binary neutron star mergers, as shown in previous works. Here we follow the ﬁrst 50 milliseconds after the merger and, for the ﬁrst time, we ﬁnd numerical convergence on the magnetic ﬁeld ampliﬁcation, in terms of integrated energy and spectral distribution over spatial scales. Among other results, we ﬁnd that the average intensity of the magnetic ﬁeld in the remnant saturates at ∼ 10 16 G around 5 ms after the merger. After 20 − 30 ms, both toroidal and poloidal magnetic ﬁeld components grow continuously, fed by the winding mechanism that provides a slow inverse cascade, i.e. gradually transferring kinetic into magnetic energy. We ﬁnd no clear hints for magneto-rotational instabilities, and no signiﬁcant impact of the magnetic ﬁeld on the redistribution of angular momentum in the remnant in our simulations, probably due to the very turbulent and dynamical topology of the magnetic ﬁeld at all stages, with small-scale components largely dominating over the large-scale ones. Although the magnetic ﬁeld grows near the rotation axis of the remnant, longer large-eddy simulations are necessary to further investigate the formation of large-scale, helical structures close to the rotational axis, which could be associated to jet formation.
CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data

We present a visual localization system that learns to estimate camera poses in the real world with the help of synthetic data. Despite significant progress in recent years, most learning-based approaches to visual localization target at a single domain and require a dense database of geo-tagged images to function well. To mitigate the data scarcity issue and improve the scalability of the neural localization models, we introduce TOPO-DataGen, a versatile synthetic data generation tool that traverses smoothly between the real and virtual world, hinged on the geographic camera viewpoint. New large-scale sim-to-real benchmark datasets are proposed to showcase and evaluate the utility of the said synthetic data. Our experiments reveal that synthetic data generically enhances the neural network performance on real data. Furthermore, we introduce CrossLoc, a cross-modal visual representation learning approach to pose estimation that makes full use of the scene coordinate ground truth via self-supervision. Without any extra data, CrossLoc significantly outperforms the state-of-the-art methods and achieves substantially higher real-data sample efficiency. Our code and datasets are all available at crossloc. github. io.
Relationships Between Self-Esteem, Interoceptive Awareness, Impulse Regulation, and Binge Eating. Path Analysis in Bariatric Surgery Candidates

Objective The current study investigates the hypothesis that the effect of low self-esteem on binge eating in bariatric candidates was mediated by both difficulties in the perception of bodily signals and impulse regulation after accounting for gender, age, and body mass index. Method 59 preoperative patients (both male and female) were screened by means of self-report measures of self-esteem, interoceptive deficits, impulse dysregulation, and severity of binge eating. Results: Results indicated that all direct effects were significant, except for the self-esteem on impulse dysregulation and the interoceptive deficits on binge eating. Self-esteem had a significant indirect effect on impulse dysregulation mediated by interoceptive deficits. Impulse dysregulation, in turn, mediates the effect of interoceptive deficits on binge eating. Moreover, the path starting from self-esteem, going first to interoceptive deficits, then going via impulse regulation difficulties to binge eating was significant. Results and conclusions A potential underlying mechanism through which self-esteem is linked to binge eating has been suggested. Obese individuals who perceived themselves as inadequate may carry a stronger burden by the confusion and mistrust related to bodily functioning and, consequently, may act more impulsively, through binge eating.
Sixty years of gender representation in children’s books: Conditions associated with overrepresentation of male versus female protagonists

As a reflection of prominent cultural norms, children’s literature plays an integral role in the acquisition and development of societal attitudes. Previous reports of male overrepresentation in books targeted towards children are consistent with a history of gender disparity across media and society. However, it is unknown whether such bias has been attenuated in recent years with increasing emphasis on gender equity and greater accessibility of books. Here, we provide an up-to-date estimate of the relative proportion of males and females featured as single protagonists in 3,280 children’s books (0–16 years) published between 1960–2020. We find that although the proportion of female protagonists has increased over this 60-year period, male protagonists remain overrepresented even in recent years. Importantly, we also find persistent effects related to author gender, age of the target audience, character type (human vs. non-human), and book genre (fiction vs. non-fiction) on the male-to-female ratio of protagonists. We suggest that this comprehensive account of the factors influencing the rates of appearance of male and female protagonists can be leveraged to develop specific recommendations for promoting more equitable gender representation in children’s literature, with important consequences for child development and society.
Effects of low pH on the coral reef cryptic invertebrate communities near CO2 vents in Papua New Guinea

Small cryptic invertebrates (the cryptofauna) are extremely abundant, ecologically important, and species rich on coral reefs. Ongoing ocean acidification is likely to have both direct effects on the biology of these organisms, as well as indirect effects through cascading impacts on their habitats and trophic relationships. Naturally acidified habitats have been important model systems for studying these complex interactions because entire communities that are adapted to these environmental conditions can be analyzed. However, few studies have examined the cryptofauna because they are difficult to census quantitatively in topographically complex habitats and are challenging to identify. We addressed these challenges by using Autonomous Reef Monitoring Structures (ARMS) for sampling reef-dwelling invertebrates >2 mm in size and by using DNA barcoding for taxonomic identifications. The study took place in Papua New Guinea at two reef localities, each with three sites at varying distances from carbon dioxide seeps, thereby sampling across a natural gradient in acidification. We observed sharp overall declines in both the abundance (34–56%) and diversity (42–45%) of organisms in ARMS under the lowest pH conditions sampled (7.64–7.75). However, the overall abundance of gastropods increased slightly in lower pH conditions, and crustacean and gastropod families exhibited varying patterns. There was also variability in response between the two localities, despite their close proximity, as one control pH site displayed unusually low diversity and abundances for all invertebrate groups. The data illustrate the complexity of responses of the reef fauna to pH conditions, and the role of additional factors that influence the diversity and abundance of cryptic reef invertebrates.
Exploring anxiety awareness during academic science examinations

There is a developing interdisciplinary research field which has been trying to integrate results and expertise from various scientific areas, such as affective computing, pedagogical methodology and psychological appraisal theories, into learning environments. Moreover, anxiety recognition and regulation has attracted the interest of researchers as an important factor in the implementation of advanced learning environments. The present article explores the test anxiety and stress awareness of university students who are attending a science course during examinations. Real-time anxiety awareness as provided by biofeedback during science exams in an academic environment is shown to have a positive effect on the anxiety students experience and on their self-efficacy regarding examinations. Furthermore, the relevant research identifies a significant relationship between the students’ anxiety level and their performance. Finally, the current study indicates that the students’ anxiety awareness as provided by biofeedback is related to their performance, a relationship that is mediated and explained by the students’ anxiety.
National Early Warning Score 2 (NEWS2) to predict poor outcome in hospitalised COVID-19 patients in India

Background While several parameters have emerged as predictors of prognosis of COVID-19, a simple clinical score at baseline might help early risk stratification. We determined the ability of National Early Warning Score 2 (NEWS2) to predict poor outcomes among adults with COVID-19. Methods A prospective study was conducted on 399 hospitalised adults with confirmed SARS-CoV-2 infection between August and December 2020. Baseline NEWS2 score was determined. Primary outcome was poor outcomes defined as need for mechanical ventilation or death within 28 days. The sensitivity, specificity and Area under the curve were determined for NEWS2 scores of 5 and 6. Results Mean age of patients was 55.5 ± 14.8 years and 275 of 399 (68.9%) were male. Overall mortality was 3.8% and 7.5% had poor outcomes. Median (interquartile range) NEWS2 score at admission was 2 (0–6). Sensitivity and specificity of NEWS 2 of 5 or more in predicting poor outcomes was 93.3% (95% CI: 76.5–98.8) and 70.7% (95% CI: 65.7–75.3) respectively [area under curve 0.88 (95% CI: 0.847–0.927)]. Age, baseline pulse rate, baseline oxygen saturation, need for supplemental oxygen and ARDS on chest X ray were independently associated with poor outcomes. Conclusions NEWS2 score of 5 or more at admission predicts poor outcomes in patients with COVID-19 with good sensitivity and can easily be applied for risk stratification at baseline. Further studies are needed in the Indian setting to validate this simple score and recommend widespread use.
Predicting life expectancy after geriatric hip fracture: A systematic review

Background Displaced femoral neck fractures in geriatric patients are typically treated with either hemiarthroplasty or total hip arthroplasty. The choice between hemiarthroplasty and total hip arthroplasty requires a good estimate of the patient’s life expectancy, as the recent HEALTH trial suggests that the benefits of the two operations do not diverge, if at all, until the second year post-operatively. A systematic review was this performed to determine if there sufficient information in the medical literature to estimate a patient’s life expectancy beyond two years and to identify those patient variables affecting survival of that duration. Methods Pubmed, Embase, and Cochrane databases were queried for articles reporting survival data for at least two years post-operatively for at least 100 patients, age 65 or greater, treated surgically for an isolated hip fracture. A final set of 43 papers was created. The methods section of all selected papers was then reviewed to determine which variables were collected in the studies and the results section was reviewed to note whether an effect was reported for all collected variables. Results There were 43 eligible studies with 25 unique variables identified. Only age, gender, comorbidities, the presence of dementia and fracture type were collected in a majority of studies, and within that, only age and gender were reported in a majority of the results. Most (15/ 25) variables were reported in 5 or fewer of the studies. Discussion There are important deficiencies in the literature precluding the evidence-based estimation of 2 year life expectancy. Because the ostensible advantages of total hip arthroplasty are reaped only by those who survive two years or more, there is a need for additional data collection, analysis and reporting regarding survival after geriatric hip fracture.
Prevalence of the Frank’s sign by aetiopathogenic stroke subtype: A prospective analysis

Background and purpose The Frank’s sign is a diagonal earlobe crease running from the tragus to the edge of the auricle at an angle of 45°. Many studies have associated this sign with coronary artery disease and some with cerebrovascular disease. The objective of this study was to analyse the prevalence of the Frank’s sign in patients suffering from acute stroke with a particular focus on its prevalence in each of the five aetiopathogenic stroke subtypes. Special interest is given to embolic stroke of undetermined source (ESUS), correlating the sign with clinical and radiological markers that support an underlying causal profile in this subgroup. Methods Cross-sectional descriptive study including 124 patients admitted consecutively to a stroke unit after suffering an acute stroke. The Frank’s sign was evaluated by the same blinded member of the research team from photographs taken of the patients. The stroke subtype was classified following SSS-TOAST criteria and the aetiological study was performed following the ESO guidelines. Results The Frank’s sign was present in 75 patients and was more prevalent in patients with an ischaemic stroke in comparison with haemorrhagic stroke (63.9 vs. 37.5, p<0.05). A similar prevalence was found in the different ischaemic stroke subtypes. The Frank’s sign was significantly associated with age, particularly in patients older than 70 who had vascular risk factors. Atherosclerotic plaques found in carotid ultrasonography were significantly more frequent in patients with the Frank’s sign (63.6%, p<0.05). Analysing the ESUS, we also found an association with age and a higher prevalence of the Frank’s sign in patients with vascular risk factors and a tendency to a high prevalence of atherosclerosis markers. Conclusion The Frank’s sign is prevalent in all aetiopathogenic ischaemic stroke subtypes, including ESUS, where it could be helpful in suspecting the underlying cardioembolic or atherothrombotic origin and guiding the investigation of atherosclerosis in patients with ESUS and the Frank’s sign.
Forced Medication in Psychiatry: Patients’ Rights and the Law Not Respected by Appeals Board in Denmark

Objective We investigated if the law and the patients’ rights are being respected in Denmark when patients appeal forced medication orders. Method We assessed 30 consecutive cases described on the webpage of the Psychiatric Appeals Board. Results No clear and convincing evidence was presented in any case that the proposed treatment was in the patient’s best interests. Furthermore, according to Danish law, forced medication should be with drugs with the fewest possible adverse effects, but this condition was violated in 29 of the 30 cases (97%). In seven cases (23%), where the board disagreed with an earlier decision made by the Psychiatric Patients’ Complaints Board and resolved that the conditions for forced treatment with an antipsychotic had not been met, the issues were formal and minor, and the Appeals Board argued, also in these cases, that force was justified because the patient was insane and that the prospect of cure or a significant and decisive improvement in the condition would otherwise be significantly impaired. This view lacks support in reliable science. The board seems mainly to have a cosmetic function, rubber stamping what the psychiatrists want. It focused on uncontroversial issues it could easily check and not on what is important for patients. Conclusions Patients’ rights and the law were not being respected. We suggest forced medication be abandoned, in accordance with the United Nations Convention on the Rights of Persons with Disabilities.
Study on compressive strength behaviour of normal concrete and self-compacting concrete subjected to elevated temperatures

Self-compacting concrete (SCC) is a form of high-performance concrete that flows and fills the form without segregation. This paper presents the behaviour of concrete when it is subjected to elevated temperatures. The investigation reports the loss in compressive strength and risk of spalling of SCC. The effects of elevated temperature on the properties of normal concrete (NC) and SCC are summarised. The compressive strength of NC and SCC was determined at different temperatures, thus providing scope of determining loss/gain in strength. In addition, modes of cooling and variation in different grades of concrete were studied. Non-destructive testing using a rebound hammer was also conducted to study the changes in surface hardness of concrete specimens subjected to elevated temperatures. The test results indicate that SCC is more sensitive to elevated temperatures, compared to NC.