Miracle-dz/UniFAR-FTUs huggingface dataset:
Omnivore: An Optimizer for Multi-device Deep Learning on CPUs and GPUs

We study the factors affecting training time in multi-device deep learning systems. Given a specification of a convolutional neural network, our goal is to minimize the time to train this model on a cluster of commodity CPUs and GPUs. We first focus on the single-node setting and show that by using standard batching and data-parallel techniques, throughput can be improved by at least 5.5x over state-of-the-art systems on CPUs. This ensures an end-to-end training speed directly proportional to the throughput of a device regardless of its underlying hardware, allowing each node in the cluster to be treated as a black box. Our second contribution is a theoretical and empirical study of the tradeoffs affecting end-to-end training time in a multiple-device setting. We identify the degree of asynchronous parallelization as a key factor affecting both hardware and statistical efficiency. We see that asynchrony can be viewed as introducing a momentum term. Our results imply that tuning momentum is critical in asynchronous parallel configurations, and suggest that published results that have not been fully tuned might report suboptimal performance for some configurations. For our third contribution, we use our novel understanding of the interaction between system and optimization dynamics to provide an efficient hyperparameter optimizer. Our optimizer involves a predictive model for the total time to convergence and selects an allocation of resources to minimize that time. We demonstrate that the most popular distributed deep learning systems fall within our tradeoff space, but do not optimize within the space. By doing this optimization, our prototype runs 1.9x to 12x faster than the fastest state-of-the-art systems.
Modeling the role that short term memory stores and attention play in change blindness

Humans tend to think that they see the entire world. However change blindness – the inability to detect salient changes from one view to a next – reveals a different story. Objects in front of people can change without it being noticed. Change blindness does not occur due to poor visibility of the changes, because they can be clearly seen once they are detected. The question addressed in this paper concerns why these salient changes can so easily be missed. The relation between iconic memory, visual short term memory and attention is investigated. How can human access iconic and visual short term memory stores and use this information to detect changes? It is explained why these cognitive functions must operate together in order to detect changes. A new model is presented that describes the role that attention, iconic memory and Visual Short-Term Memory (VSTM) play. In order to detect changes attended stimuli from iconic memory or a fragile part of VSTM are transferred to a robust form of VSTM. This is necessary for change detection, because representations in the robust part of VSTM are solid enough to detect changes before they are lost from memory.
Psychological Momentum—A Key to Continued Success

One of the most fundamental characteristics about humans is their desire for success, especially in highly competitive societies. What does it take to be successful? Is success simply a matter of better performance, and if so, what specifically is it about performance that determines success? A long research tradition suggests that psychological momentum (PM) plays a critical role in goal pursuit and achievement. Accordingly, sequential runs of success are an essential feature of high levels of performance, meaning that better performers perceive and experience momentum of success more frequently, ride it as long as they can, and as a result, become more successful in the end. Theoretically, momentum is a principle vehicle of performance that will significantly augment future success and facilitate goal achievement. Consequently, an overall performance consists of occurrences of momentum that vary in frequency and duration. The higher the frequency and the higher the duration, the more likely is success. Research suggests that the main psychological processes that underpin momentum effects are confidence, perceived competence, and internal (ability-skill) attributions. Based upon related research, it is hypothesized that PM starts as a conscious process but subsequently becomes a major facilitator of nonconscious automatic execution of human behavior and performance.
PHYSICAL AND CHEMICAL IMPACTS ON THE ICE NUCLEATING PROPERTIES OF ATMOSPHERIC PARTICLES

Nucleation of ice particles in the atmosphere occurs by homogeneous freezing of liquid particles and by heterogeneous nucleation due to the action of insoluble ice nuclei (IN). Homogeneous freezing herein refers to spontaneous ice embryo formation within either dilute droplets or concentrated solutions at temperatures below about -36°C. Heterogeneous nucleation can occur via multiple ice formation mechanisms at all temperatures below 0°C, given a sufficiently effective ice nucleus. These two fundamental ice nucleation processes interact directly in the cirrus cloud regime. This particular regime provides the focus for much of the work reported in this paper, but the methodologies applied are currently being extended to cover all mixed phase (ice present with liquid) clouds. Understanding the range of temperature and relative humidity conditions that can support cirrus cloud formation in the presence of diverse types of aerosol particles present in the atmosphere is critical to an assessment of the effects of these cold clouds on climate (e.g., Kärcher and Lohmann 2003). While some atmospheric measurements have been made to infer the activation conditions for homogeneous freezing and the presence or absence of heterogeneous nuclei around cirrus clouds (Haag et al. 2003), few direct measurements of these nuclei as functions of temperature and ice supersaturation exist. Measurements of the concentrations and compositions of total aerosol particles and those active in homogeneous and heterogeneous ice formation processes are being made to investigate natural and anthropogenic influences on ice nuclei populations throughout the range of conditions relevant for tropospheric clouds. These studies are conducted for particles in free tropospheric air, as sampled from a mountaintop location (Storm Peak Laboratory, 3220 m MSL) in the western United States. Focused laboratory studies are also underway. Results from ambient particle measurements during three weeks in autumn (November 2001) are reviewed
Working memory differences in long-distance dependency resolution

There is a wealth of evidence showing that increasing the distance between an argument and its head leads to more processing effort, namely, locality effects; these are usually associated with constraints in working memory (DLT: Gibson, 2000; activation-based model: Lewis and Vasishth, 2005). In SOV languages, however, the opposite effect has been found: antilocality (see discussion in Levy et al., 2013). Antilocality effects can be explained by the expectation-based approach as proposed by Levy (2008) or by the activation-based model of sentence processing as proposed by Lewis and Vasishth (2005). We report an eye-tracking and a self-paced reading study with sentences in Spanish together with measures of individual differences to examine the distinction between expectation- and memory-based accounts, and within memory-based accounts the further distinction between DLT and the activation-based model. The experiments show that (i) antilocality effects as predicted by the expectation account appear only for high-capacity readers; (ii) increasing dependency length by interposing material that modifies the head of the dependency (the verb) produces stronger facilitation than increasing dependency length with material that does not modify the head; this is in agreement with the activation-based model but not with the expectation account; and (iii) a possible outcome of memory load on low-capacity readers is the increase in regressive saccades (locality effects as predicted by memory-based accounts) or, surprisingly, a speedup in the self-paced reading task; the latter consistent with good-enough parsing (Ferreira et al., 2002). In sum, the study suggests that individual differences in working memory capacity play a role in dependency resolution, and that some of the aspects of dependency resolution can be best explained with the activation-based model together with a prediction component.
GMRT and VLA observations of HI AND OH from the Seyfert galaxy MRK 1

We present Giant Meterwave Radio Telescope (GMRT) observations of the Hi 21 cm line and Very Large Array (VLA) observations of the OH 18 cm line from the Seyfert 2 galaxy Mrk 1. Hi emission is detected from both Mrk 1 and its companion NGC 451. The Hi emission morphology and the velocity field of Mrk 1 are disturbed. We speculate that the nuclear activities of Mrk 1 are triggered by tidal interactions. We estimate the Hi masses of Mrk 1 and NGC 451 to be 8:0(0:6) 10 8 M and 1:3(0:1) 10 9 M respectively. We have also detected the Hi 21 cm line and the OH 18 cm line in absorption toward the nucleus of Mrk 1 at a blueshifted velocity with respect to its systemic velocity indicating an outflow of atomic and molecular gas. Two OH lines, at 1665 and 1667 MHz, are detected. Each of the profiles of the Hi and OH absorption consists of two components that are separated by125 km s 1 . Gaussian fitting gave dispersions of44 km s 1 for both the components of the Hi absorption. The profile of the OH absorption is qualitatively similar to that of the Hi absorption. Both components of the OH absorption are thermally excited. The peak optical depths of the two components of the Hi absorption are (7:3 0:4) 10 2 and (3:2 0:4) 10 2 . The corresponding peak optical depths of the 1667 MHz OH absorption are (2:3 0:3) 10 2 and (1:1 0:3) 10 2 . The higher velocity components of the Hi and OH (1667 MHz) absorption lines are blueshifted from the (Oiii)5007, (Oi)6300, and the systemic velocity by100 km s 1 , but are consistent with the (Oii)3727 velocity. We explain these velocity discrepancies as due to shock ionization of a region which is pushed forward due to shocks in front of the radio nucleus thereby giving apparent blueshift to Hi, OH, and (Oii) velocities. The optical depth ratiosHi= 1667 of both the components of the Hi and OH absorption are3, indicating their origin in dense molecular clouds. Using OH/Av values for the Galactic molecular clouds, we obtain 9< Av< 90 toward the line of sight of Mrk 1.
Knowledge, Practices, and Restrictions Related to Menstruation among Young Women from Low Socioeconomic Community in Mumbai, India

The main objective was to assess knowledge, practices, and restrictions faced by young women regarding their menstrual hygiene. The views of adult women having young daughters were also included and both views were compared. In addition, the factors influencing the menstrual hygiene practices were also studied. The study was carried out during 2008 in Mumbai, India. The mixed methods approach was followed for the data collection. Both qualitative and quantitative methods were used to collect the data. For quantitative survey, totally 192 respondents (96 adult and 96 younger women) were selected. While young women were asked about questions related to their menstruation, adult women were asked questions to find out how much they know about menstrual history of their daughters. The qualitative data helped to supplement the findings from the quantitative survey and to study the factors affecting menstrual practices in young women. The mean age at menarche reported was 13.4 years and 30–40% of young girls did not receive any information about menstruation before menarche. It is thus seen that very few young girls between the age group 15 and 24 years did receive any information before the onset of menstruation. Among those who received some information, it was not adequate enough. The source of information was also not authentic. Both young and adult women agreed on this. Due to the inadequate knowledge, there were certain unhygienic practices followed by the young girls resulting in poor menstrual hygiene. It also leads to many unnecessary restrictions on young girls and they faced many health problems and complaints, which were either ignored or managed inappropriately. The role of health sector was almost negligible from giving information to the management of health problems of these young girls. This paper reemphasizes the important, urgent, and neglected need of providing correct knowledge to the community including adolescent girls.
Primary students' group metacognitive processes in a computer supported collaborative learning environment

The current understanding of students’ group metacognition is limited. The research on metacognition has focused mainly on the individual student. The aim of this study was to address the void by developing a conceptual model to inform the use of scaffolds to facilitate group metacognition during mathematical problem solving in computer supported collaborative learning (CSCL) environments. An initial conceptual framework based on the literature from metacognition, cooperative learning, cooperative group metacognition, and computer supported collaborative learning was used to inform the study. In order to achieve the study aim, a design research methodology incorporating two cycles was used. The first cycle focused on the within-group metacognition for sixteen groups of primary school students working together around the computer; the second cycle included between-group metacognition for six groups of primary school students working together on the Knowledge Forum® CSCL environment. The study found that providing groups with group metacognitive scaffolds resulted in groups planning, monitoring, and evaluating the task and team aspects of their group work. The metacognitive scaffolds allowed students to focus on how their group was completing the problem-solving task and working together as a team. From these findings, a revised conceptual model to inform the use of scaffolds to facilitate group metacognition during mathematical problem solving in computer supported collaborative learning (CSCL) environments was generated.
The Effectiveness of Constraint-Induced Therapy as a Stroke Intervention: A Meta-Analysis

Stroke is one of the most disabling conditions affecting adults today. Much research has been performed on rehabilitation interventions targeting hemiparesis after stroke. Constraint-induced therapy is a treatment technique that focuses on restraining the unaffected upper extremity while forcing use of the affected extremity to promote purposeful movement. This study presents a meta-analysis of applicable current literature on this treatment approach. It is concluded that constraint-induced therapy may be an effective treatment option for hemiparesis experienced after stroke.
Cytochrome oxidase response to cochlea removal in chicken auditory brainstem neurons

Changes in cytochrome oxidase (CO) activity were studied in the chick brainstem auditory nuclei, n. magnocellularis (NM) and n. laminaris (NL), following unilateral cochlea removal. Chickens aged 10 days or 56 weeks underwent unilateral cochlea removal. Following survival periods of 30 minutes to 14 days for the 10‐day‐old birds and 6 hours or 14 days for the 56‐week‐old birds, the animals were perfused with paraformaldehyde/glutaraldehyde fixative. Cryostat sections of the brainstem were then prepared for CO histochemistry. Microdensitometry was used to quantify the difference in CO staining in NM and NL ipsilateral and contralateral to the cochlea removal. Since the cochlea projects to the ipsilateral NM, the contralateral NM was used as a within‐animal control.
Effects of the Racket Polar Moment of Inertia on Dominant Upper Limb Joint Moments during Tennis Serve

This study examined the effect of the polar moment of inertia of a tennis racket on upper limb loading in the serve. Eight amateur competition tennis players performed two sets of 10 serves using two rackets identical in mass, position of center of mass and moments of inertia other than the polar moment of inertia (0.00152 vs 0.00197 kg.m2). An eight-camera motion analysis system collected the 3D trajectories of 16 markers, located on the thorax, upper limbs and racket, from which shoulder, elbow and wrist net joint moments and powers were computed using inverse dynamics. During the cocking phase, increased racket polar moment of inertia was associated with significant increases in the peak shoulder extension and abduction moments, as well the peak elbow extension, valgus and supination moments. During the forward swing phase, peak wrist extension and radial deviation moments significantly increased with polar moment of inertia. During the follow-through phase, the peak shoulder adduction, elbow pronation and wrist external rotation moments displayed a significant inverse relationship with polar moment of inertia. During the forward swing, the magnitudes of negative joint power at the elbow and wrist were significantly larger when players served using the racket with a higher polar moment of inertia. Although a larger polar of inertia allows players to better tolerate off-center impacts, it also appears to place additional loads on the upper extremity when serving and may therefore increase injury risk in tennis players.
Model and Scenario Variations in Predicted Number of Generations of Spodoptera litura Fab. on Peanut during Future Climate Change Scenario

The present study features the estimation of number of generations of tobacco caterpillar, Spodoptera litura. Fab. on peanut crop at six locations in India using MarkSim, which provides General Circulation Model (GCM) of future data on daily maximum (T.max), minimum (T.min) air temperatures from six models viz., BCCR-BCM2.0, CNRM-CM3, CSIRO-Mk3.5, ECHams5, INCM-CM3.0 and MIROC3.2 along with an ensemble of the six from three emission scenarios (A2, A1B and B1). This data was used to predict the future pest scenarios following the growing degree days approach in four different climate periods viz., Baseline-1975, Near future (NF) -2020, Distant future (DF)-2050 and Very Distant future (VDF)—2080. It is predicted that more generations would occur during the three future climate periods with significant variation among scenarios and models. Among the seven models, 1–2 additional generations were predicted during DF and VDF due to higher future temperatures in CNRM-CM3, ECHams5 & CSIRO-Mk3.5 models. The temperature projections of these models indicated that the generation time would decrease by 18–22% over baseline. Analysis of variance (ANOVA) was used to partition the variation in the predicted number of generations and generation time of S. litura on peanut during crop season. Geographical location explained 34% of the total variation in number of generations, followed by time period (26%), model (1.74%) and scenario (0.74%). The remaining 14% of the variation was explained by interactions. Increased number of generations and reduction of generation time across the six peanut growing locations of India suggest that the incidence of S. litura may increase due to projected increase in temperatures in future climate change periods.
Effects of 12 months of voluntary alcohol self-administration on intracortical bone remodeling in a rhesus macaque model

approved: _____________________________________________________________________ Urszula T. Iwaniec Russell T. Turner Background: Alcohol is a nonessential nutrient widely consumed throughout the world. Chronic alcohol abuse is associated with numerous adverse skeletal effects. However, prior to this study, the effects of alcohol abuse on intracortical bone remodeling in an animal model had not been investigated. Reduced intracortical bone remodeling could impair repair of microdamage accrued during activities of daily living and lead to increased risk of bone fractures. Methods: To fill this gap in knowledge, we investigated the effects of 12 months of voluntary self-administration of ethanol (4% v/v) on bone mass, bone microarchitecture, and intracortical bone remodeling in male rhesus monkeys approaching skeletal maturity (mean age 6.7 years). Results: Alcohol-fed monkeys consumed a mean of 2.8 g/kg ethanol per day. No significant difference was found between alcohol and control monkeys for body weight, age, or any indices of bone mass or bone microarchitecture. However, monkeys in the alcohol group had significantly lower intracortical bone formation and bone resorption compared to the control group. Conclusions: These results suggest that 12-months of self-administration of alcohol results in significantly reduced intracortical bone remodeling without affecting bone mass or bone microarchitecture; thus, evidence from this study indicates that alcohol abuse can reduce bone quality without affecting bone quantity.
Safety of Transesophageal Echocardiography: A Multicenter Survey of 10,419 Examinations

BackgroundDuring the past few years, transesophageal echocardiography (TEE) has been increasingly used in clinical cardiology; data concerning the practicability and safety of the technique, however, are rare. Methods and ResultsThis report analyzes the experience of 15 European centers performing TEE studies for at least 1 year. At the time of this survey, 10,419 TEE examinations had been attempted or performed in these institutions. These TEE examinations were carried out by 54 physicians, 53.7% of whom had been trained in endoscopic techniques. Within the same time period, 160,431 precordial echocardiographic examinations were performed in the 15 institutions; the ratio between TEE and transthoracic studies averaged 9.03 ± 6.4% (range of the 15 centers, 1.4-23.6%). Of the 10,419 patients, 9,240 (88.7%) were conscious inpatients or outpatients at the time of the TEE examination; the vast majority of the conscious patients did not receive intravenous sedation before TEE. In 201 cases (1.9%), insertion of the TEE probe was unsuccessfully attempted because of a lack of patient cooperation and/or operator experience (98.5%) or because of anatomical reasons (1.5%). In 90 of 10,218 TEE studies (0.88%) with successful probe insertion, the examination had to be interrupted because of the patient's intolerance of the echoscope (65 cases); because of pulmonary (eight cases), cardiac (eight cases), or bleeding complications (two cases); or for other reasons (seven cases). One of the bleeding complications resulted from a malignant lung tumor with esophageal infiltration and was fatal (mortality rate, 0.0098%). ConclusionsThis multicenter survey documents that TEE studies are associated with an acceptable low risk when used by experienced operators under proper safety conditions. (Circulation 1991;83:817–821)