Miracle-dz/UniFAR-FTUs huggingface dataset:
Integrating Social Media into the Design Process

Social media captures examples of people's behaviors, actions, beliefs, and sentiments. As a result, it can be a valuable source of information and inspiration for HCI research and design. Social media technologies can improve, inform, and strengthen insights to better understand and represent user populations. To understand the position of social media research and analysis in the design process, this paper seeks to highlight shortcomings of using traditional research methods (e.g., interviews, focus groups) that ignore or don't adequately reflect relevant social media, and this paper speculates about the importance and benefits of leveraging social media for establishing context in supplement with these methods. We present examples that guide our thinking and introduce discussion around concerns related to using social media data.
Keratoconus Classifier for Smartphone-based Corneal Topographer

Keratoconus is a severe eye disease that leads to deformation of the cornea. It impacts people aged 10–25 years and is the leading cause of blindness in that demography. Corneal topography is the gold standard for keratoconus diag-nosis. It is a non-invasive process performed using expensive and bulky medical devices called corneal topographers. This makes it inaccessible to large populations, especially in the Global South. Low-cost smartphone-based corneal topographers, such as SmartKC, have been proposed to make keratoconus diagnosis accessible. Similar to medical-grade topographers, SmartKC outputs curvature heatmaps and quantitative metrics that need to be evaluated by doctors for keratoconus diagnosis. An auto-matic scheme for evaluation of these heatmaps and quantitative values can play a crucial role in screening keratoconus in areas where doctors are not available. In this work, we propose a dual-head convolutional neural network (CNN) for classifying keratoconus on the heatmaps generated by SmartKC. Since SmartKC is a new device and only had a small dataset (114 sam-ples), we developed a 2-stage transfer learning strategy-using historical data collected from a medical-grade topographer and a subset of SmartKC data-to satisfactorily train our network. This, combined with our domain-specific data augmentations, achieved a sensitivity of 91.3% and a specificity of 94.2%.
Unsupervised learning of Rydberg atom array phase diagram with Siamese neural networks

We introduce an unsupervised machine learning method based on Siamese neural networks (SNNs) to detect phase boundaries. This method is applied to Monte-Carlo simulations of Ising-type systems and Rydberg atom arrays. In both cases the SNN reveals phase boundaries consistent with prior research. The combination of leveraging the power of feed-forward neural networks, unsupervised learning and the ability to learn about multiple phases without knowing about their existence provides a powerful method to explore new and unknown phases of matter.
Paraxial Wave Propagation in Random Media with Long-Range Correlations

We study the paraxial wave equation with a randomly perturbed index of refraction, which can model the propagation of a wave beam in a turbulent medium. The random perturbation is a stationary and isotropic process with a general form of the covariance that may be integrable or not. We focus attention mostly on the non-integrable case, which corresponds to a random perturbation with long-range correlations, that is relevant for propagation through a cloudy turbulent atmosphere. The analysis is carried out in a high-frequency regime where the forward scattering approximation holds. It reveals that the randomization of the wave field is multiscale: The travel time of the wave front is randomized at short distances of propagation and it can be described by a fractional Brownian motion. The wave field observed in the random travel time frame is affected by the random perturbations at long distances, and it is described by a Schroedinger-type equation driven by a standard Brownian field. We use these results to quantify how scattering leads to decorrelation of the spatial and spectral components of the wave field and to a deformation of the pulse emitted by the source. These are important questions for applications like imaging and free space communications with pulsed laser beams through a turbulent atmosphere. We also compare the results with those used in the optics literature, which are based on the Kolmogorov model of turbulence.
A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and a 3D-printed Marker

Purpose. Ability to locate and track ultrasound images in the 3D operating space is of great benefit for multiple clinical applications. This is often accomplished by tracking the probe using a precise but expensive optical or electromagnetic tracking system. Our goal is to develop a simple and low cost augmented reality echography framework using a standard RGB-D Camera. Methods. A prototype system consisting of an Occipital Structure Core RGB-D camera, a specifically-designed 3D marker, and a fast point cloud registration algorithm FaVoR was developed and evaluated on an Ultrasonix ultrasound system. The probe was calibrated on a 3D-printed N-wire phantom using the software PLUS toolkit. The proposed calibration method is simplified, requiring no additional markers or sensors attached to the phantom. Also, a visualization software based on OpenGL was developed for the augmented reality application. Results. The calibrated probe was used to augment a real-world video in a simulated needle insertion scenario. The ultrasound images were rendered on the video, and visually-coherent results were observed. We evaluated the end-to-end accuracy of our AR US framework on localizing a cube of 5 cm size. From our two experiments, the target pose localization error ranges from 5.6 to 5.9 mm and from -3.9 to 4.2 degrees. Conclusion. We believe that with the potential democratization of RGB-D cameras integrated in mobile devices and AR glasses in the future, our prototype solution may facilitate the use of 3D freehand ultrasound in clinical routine. Future work should include a more rigorous and thorough evaluation, by comparing the calibration accuracy with those obtained by commercial tracking solutions in both simulated and real medical scenarios.
Collective Motion of Quincke Rollers with Fully Resolved Hydrodynamics

Hydrodynamic effects are known to significantly affect the collective behavior of wet active matter systems. However, the non‐linear many‐body nature of these interactions makes them very challenging to analyze, particularly in dense suspensions. Quincke rollers are one of the canonical examples of artificial microswimmers. These are active particles that move freely above a plate due to the torque generated by a uniform DC electric field. A system involving many such particles exhibits a variety of collective dynamics, such as the disordered gas, polar liquid, and active crystal states. This work accomplishes numerical simulations of a 3D system containing many rollers in order to explicitly resolve the hydrodynamic interactions and understand the role these play in the resulting active dynamics. It reveals that the far‐field hydrodynamic effects tend to drive ordered collective motion, while the near‐field effects tend to drive disordered collective behavior, and reproduce diverse collective behavior while capturing the role of hydrodynamic effects between rollers without resorting to the approximations previously employed.
New Results and Open Questions for SIR-PH Epidemic Models with Linear Birth Rate, Loss of Immunity, Vaccination, and Disease and Vaccination Fatalities

Our paper presents three new classes of models: SIR-PH, SIR-PH-FA, and SIR-PH-IA, and states two problems we would like to solve about them. Recall that deterministic mathematical epidemiology has one basic general law, the “R0 alternative” of Van den Driessche and Watmough, which states that the local stability condition of the disease-free equilibrium may be expressed as R0<1, where R0 is the famous basic reproduction number, which also plays a major role in the theory of branching processes. The literature suggests that it is impossible to find general laws concerning the endemic points. However, it is quite common that 1. When R0>1, there exists a unique fixed endemic point, and 2. the endemic point is locally stable when R0>1. One would like to establish these properties for a large class of realistic epidemic models (and we do not include here epidemics without casualties). We have introduced recently a “simple” but broad class of “SIR-PH models” with varying populations, with the express purpose of establishing for these processes the two properties above. Since that seemed still hard, we have introduced a further class of “SIR-PH-FA” models, which may be interpreted as approximations for the SIR-PH models, and which include simpler models typically studied in the literature (with constant population, without loss of immunity, etc.). For this class, the first “endemic law” above is “almost established”, as explicit formulas for a unique endemic point are available, independently of the number of infectious compartments, and it only remains to check its belonging to the invariant domain. This may yet turn out to be always verified, but we have not been able to establish that. However, the second property, the sufficiency of R0>1 for the local stability of an endemic point, remains open even for SIR-PH-FA models, despite the numerous particular cases in which it was checked to hold (via Routh–Hurwitz time-onerous computations, or Lyapunov functions). The goal of our paper is to draw attention to the two open problems above, for the SIR-PH and SIR-PH-FA, and also for a second, more refined “intermediate approximation” SIR-PH-IA. We illustrate the current status-quo by presenting new results on a generalization of the SAIRS epidemic model.
A Re-examination of the Census Bureau Reconstruction and Reidentification Attack

: Recent analysis by researchers at the U.S. Census Bureau claims that by reconstructing the tabular data released from the 2010 Census, it is possible to reconstruct the original data and, using an accurate external data file with identity, reidentify 179 million respondents (approximately 58% of the population). This study shows that there are a practically infinite number of possible reconstructions, and each reconstruction leads to assigning a different identity to the respondents in the reconstructed data. The results reported by the Census Bureau researchers are based on just one of these infinite possible reconstructions and is easily refuted by an alternate reconstruction. Without definitive proof that the reconstruction is unique, or at the very least, that most reconstructions lead to the assignment of the same identity to the same respondent, claims of confirmed reidentification are highly suspect and easily refuted. The Census releases data at different geographic levels: nation, state, county, tract, block group, and block. The final three are census-defined constructs and do not necessarily correspond to traditional geographic classification. For personal level data, the data at the smaller geographic level is aggregated to the next higher level, that is, the results at the block level are aggregated to block groups, block groups are aggregated to tracts, etc. The multiple tables that are released (Total Population, Sex by Age, Total Races, and others) are all aggregations of the most detailed data release (Age by Sex, by Race, by Ethnicity). The different tables released form the basis of the reconstruction of the respondent microdata.
Automatic segmentation of meniscus based on MAE self-supervision and point-line weak supervision paradigm

Medical image segmentation based on deep learning is often faced with the problems of insufficient datasets and long time-consuming labeling. In this paper, we introduce the self-supervised method MAE(Masked Autoencoders) into knee joint images to provide a good initial weight for the segmentation model and improve the adaptability of the model to small datasets. Secondly, we propose a weakly supervised paradigm for meniscus segmentation based on the combination of point and line to reduce the time of labeling. Based on the weak label ,we design a region growing algorithm to generate pseudo-label. Finally we train the segmentation network based on pseudo-labels with weight transfer from self-supervision. Sufficient experimental results show that our proposed method combining self-supervision and weak supervision can almost approach the performance of purely fully supervised models while greatly reducing the required labeling time and dataset size.
CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeech

Recently, many studies have tried to create generation models to assist counter speakers by providing counterspeech suggestions for combating the explosive proliferation of online hate. However, since these suggestions are from a vanilla generation model, they might not include the appropriate properties required to counter a particular hate speech instance. In this paper, we propose CounterGeDi - an ensemble of generative discriminators (GeDi) to guide the generation of a DialoGPT model toward more polite, detoxified, and emotionally laden counterspeech. We generate counterspeech using three datasets and observe significant improvement across different attribute scores. The politeness and detoxification scores increased by around 15% and 6% respectively, while the emotion in the counterspeech increased by at least 10% across all the datasets. We also experiment with triple-attribute control and observe significant improvement over single attribute results when combining complementing attributes, e.g., politeness, joyfulness and detoxification. In all these experiments, the relevancy of the generated text does not deteriorate due to the application of these controls.
Atomistic Modelling of Energy Dissipation in Nanoscale Gears

Molecule- and solid-state gears build the elementary constituents of nanoscale mechanical machineries. Recent experimental advances in fabrication technologies in the ﬁeld have strongly contributed to better delineate the roadmap to-wards the ultimate goal of engineering molecular-scale mechanical devices. To com-plement experimental studies, computer simulations play an invaluable role, since they allow to address, with atomistic resolution, various fundamental issues such as the transmission of angular momentum in nanoscale gear trains and the mechanisms of energy dissipation at such length scales. We review in this chapter our work ad-dressing the latter problem. Our computational approach is based on classical atomistic Molecular Dynamics simulations. Two basic problems are discussed: (i) the dominant energy dissipation channels of a rotating solid-state nanogear adsorbed on a surface, and (ii) the transmission of rotational motion and frictional processes in a heterogeneous gear pair consisting of a graphene nanodisk and a molecular-scale gear.
The AI Index 2022 Annual Report

Welcome to the fifth edition of the AI Index Report! The latest edition includes data from a broad set of academic, private, and nonprofit organizations as well as more self-collected data and original analysis than any previous editions, including an expanded technical performance chapter, a new survey of robotics researchers around the world, data on global AI legislation records in 25 countries, and a new chapter with an in-depth analysis of technical AI ethics metrics. The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Its mission is to provide unbiased, rigorously vetted, and globally sourced data for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The report aims to be the world's most credible and authoritative source for data and insights about AI.
Bandwidth-Scalable Fully Mask-Based Deep FCRN Acoustic Echo Cancellation and Postfiltering

Although today’s speech communication systems support various bandwidths from narrowband to super-wideband and beyond, state-of-the art DNN methods for acoustic echo cancellation (AEC) are lacking modularity and bandwidth scalability. Our proposed DNN model builds upon a fully convolutional recurrent network (FCRN) and introduces scalability over various bandwidths up to a fullband (FB) system (48 kHz sampling rate). This modular approach allows separate wideband (WB) pre-training of mask-based AEC and postfilter stages with dedicated losses, followed by a joint training of them on FB data. A third lightweight blind bandwidth extension stage is separately trained on FB data, flexibly allowing to extend the WB postfilter output towards higher bandwidths until reaching FB. Thereby, higher frequency noise and echo are reliably suppressed. On the ICASSP 2022 Acoustic Echo Cancellation Challenge blind test set we report a competitive performance, showing robustness even under highly delayed echo and dynamic echo path changes.
What Do You Get from Turning on Your Video? Effects of Videoconferencing Affordances on Remote Class Experience During COVID-19

The outbreak of COVID-19 forced schools to swiftly transition from in-person classes to online or remote offerings, making educators and learners alike rely on online videoconferencing platforms. Platforms like Zoom offer audio-visual channels of communication and include features that are designed to approximate the classroom experience. However, it is not clear how students' learning experiences are affected by affordances of the videoconferencing platforms or what underlying factors explain the differential effects of these affordances on class experiences of engagement, interaction, and satisfaction. In order to find out, we conducted two online survey studies: Study 1 (N = 176) investigated the effects of three types of videoconferencing affordances (i.e., modality, interactivity, and agency affordances) on class experience during the first two months after the transition to online learning. Results showed that usage of the three kinds of affordances was positively correlated with students' class engagement, interaction, and satisfaction. Perceived anonymity, nonverbal cues, and comfort level were found to be key mediators. In addition, students' usage of video cameras in class was influenced by their classmates. Study 2 (N = 256) tested the proposed relationships at a later stage of the pandemic and found similar results, thus serving as a constructive replication. This paper focuses on reporting the results of Study 1 since it captures the timely reactions from students when they first went online, and the second study plays a supplementary role in verifying Study 1 and thereby extending its external validity. Together, the two studies provide insights for instructors on how to leverage different videoconferencing affordances to enhance the virtual learning experience. Design implications for digital tools in online education are also discussed.
Low coherency of wind induced seismic noise: implications for gravitational wave detection

Seismic noise poses challenges for gravitational wave detection. Effective vibration isolation and methods to subtract unshieldable Newtonian noise (NN) are examples. Seismic arrays offer one way to deal with these issues by making use of correlations between seismic ground measurements and noise inside the detector. In this paper we find that wind induced seismic noise is incoherent and our results show that it can dramatically reduce the projected low frequency sensitivity of future gravitational wave detectors. To quantify this, we measure the coherence length of wind induced seismic noise from 0.06–20 Hz in three distinct locations: close to a building, among tall trees and in shrubs. We show that wind induced seismic noise is ubiquitous and reduces the coherence lengths from several hundred meters to 2–40 m for 0.06–0.1 Hz, from $? > > 60 m to 3–16 m for 1.5–2.5 Hz and from $? > > 35 m to 1–16 m around 16.6 Hz in the study area. This leads to significant loss of velocity resolution of the array for primary microseism and 5 times worse NN cancellation by Wiener filtering at 2 Hz, while it may not pose additional limitation to NN cancellation between 10–20 Hz.
Measuring Cognitive Workload Using Multimodal Sensors

This study aims to identify a set of indicators to estimate cognitive workload using a multimodal sensing approach and machine learning. A set of three cognitive tests were conducted to induce cognitive workload in twelve participants at two levels of task difficulty (Easy and Hard). Four sensors were used to measure the participants' physiological change, including, Electrocardiogram (ECG), electrodermal activity (EDA), respiration (RESP), and blood oxygen saturation (SpO2). To understand the perceived cognitive workload, NASA-TLX was used after each test and analysed using Chi-Square test. Three well-know classifiers (LDA, SVM, and DT) were trained and tested independently using the physiological data. The statistical analysis showed that participants' perceived cognitive workload was significantly different ($p< 0.001$) between the tests, which demonstrated the validity of the experimental conditions to induce different cognitive levels. Classification results showed that a fusion of ECG and EDA presented good discriminating power (acc = 0.74) for cognitive workload detection. This study provides preliminary results in the identification of a possible set of indicators of cognitive workload. Future work needs to be carried out to validate the indicators using more realistic scenarios and with a larger population.
SkillNet-NLU: A Sparsely Activated Model for General-Purpose Natural Language Understanding

Prevailing deep models are single-purpose and overspecialize at individual tasks. However, when being extended to new tasks, they typically forget previously learned skills and learn from scratch. We address this issue by introducing SkillNet-NLU, a general-purpose model that stitches together existing skills to learn new tasks more effectively. The key feature of our approach is that it is sparsely activated guided by predefined skills. Different from traditional dense models that always activate all the model parameters, SkillNet-NLU only activates parts of the model parameters whose skills are relevant to the target task. When learning for a new task, our approach precisely activates required skills and also provides an option to add new skills. We evaluate on natural language understandings tasks and have the following findings. First, with only one model checkpoint, SkillNet-NLU performs better than task-specific fine-tuning and two multi-task learning baselines (i.e., dense model and Mixture-of-Experts model) on six tasks. Second, sparsely activated pre-training further improves the overall performance. Third, SkillNet-NLU significantly outperforms baseline systems when being extended to new tasks.