Miracle-dz/UniFAR-FTUs huggingface dataset:
The large learning rate phase of deep learning: the catapult mechanism

The choice of initial learning rate can have a profound effect on the performance of deep networks. We present a class of neural networks with solvable training dynamics, and confirm their predictions empirically in practical deep learning settings. The networks exhibit sharply distinct behaviors at small and large learning rates. The two regimes are separated by a phase transition. In the small learning rate phase, training can be understood using the existing theory of infinitely wide neural networks. At large learning rates the model captures qualitatively distinct phenomena, including the convergence of gradient descent dynamics to flatter minima. One key prediction of our model is a narrow range of large, stable learning rates. We find good agreement between our model's predictions and training dynamics in realistic deep learning settings. Furthermore, we find that the optimal performance in such settings is often found in the large learning rate phase. We believe our results shed light on characteristics of models trained at different learning rates. In particular, they fill a gap between existing wide neural network theory, and the nonlinear, large learning rate, training dynamics relevant to practice.
Intuitionistic Mathematics and Logic.

The first seeds of mathematical intuitionism germinated in Europe over a century ago in the constructive tendencies of Borel, Baire, Lebesque, Poincare, Kronecker and others. The flowering was the work of one man, Luitzen Egbertus Jan Brouwer, who taught mathematics at the University of Amsterdam from 1909 until 1951. By proving powerful theorems on topological invariants and fixed points of continuous mappings, Brouwer quickly build a mathematical reputation strong enough to support his revolutionary ideas about the nature of mathematical activity. These ideas influenced Hilbert and Godel and established intuitionistic logic and mathematics as subjects worthy of independent study. Our aim is to describe the development of Brouwer's intuitionism, from his rejection of the classical law of excluded middle to his controversial theory of the continuum, with fundamental consequences for logic and mathematics. We borrow Kleene's formal axiomatic systems (incorporating earlier attempts by Kolmogorov, Glivenko, Heyting and Peano) for intuitionistic logic and arithmetic as subtheories of the corresponding classical theories, and sketch his use of godel numbers of recursive functions to realize sentences of intuitionistic arithmetic including a form of Church's Thesis. Finally, we present Kleene and Vesley's axiomatic treatment of Brouwer's continuum, with the function-realizability interpretation which establishes its consistency.
Taking a hint: How to leverage loss predictors in contextual bandits?

We initiate the study of learning in contextual bandits with the help of loss predictors. The main question we address is whether one can improve over the minimax regret $\mathcal{O}(\sqrt{T})$ for learning over $T$ rounds, when the total error of the predictor $\mathcal{E} \leq T$ is relatively small. We provide a complete answer to this question, including upper and lower bounds for various settings: adversarial versus stochastic environments, known versus unknown $\mathcal{E}$, and single versus multiple predictors. We show several surprising results, such as 1) the optimal regret is $\mathcal{O}(\min\{\sqrt{T}, \sqrt{\mathcal{E}}T^\frac{1}{4}\})$ when $\mathcal{E}$ is known, a sharp contrast to the standard and better bound $\mathcal{O}(\sqrt{\mathcal{E}})$ for non-contextual problems (such as multi-armed bandits); 2) the same bound cannot be achieved if $\mathcal{E}$ is unknown, but as a remedy, $\mathcal{O}(\sqrt{\mathcal{E}}T^\frac{1}{3})$ is achievable; 3) with $M$ predictors, a linear dependence on $M$ is necessary, even if logarithmic dependence is possible for non-contextual problems. We also develop several novel algorithmic techniques to achieve matching upper bounds, including 1) a key action remapping technique for optimal regret with known $\mathcal{E}$, 2) implementing Catoni's robust mean estimator efficiently via an ERM oracle leading to an efficient algorithm in the stochastic setting with optimal regret, 3) constructing an underestimator for $\mathcal{E}$ via estimating the histogram with bins of exponentially increasing size for the stochastic setting with unknown $\mathcal{E}$, and 4) a self-referential scheme for learning with multiple predictors, all of which might be of independent interest.
Absence of embedded eigenvalues for Hamiltonian with crossed magnetic and electric fields

In the presence of the homogeneous electric field and the homogeneous perpendicular magnetic field, the classical trajectory of a quantum particle on ${\mathbb R}^2$ moves with drift velocity which is perpendicular to the electric and magnetic fields. For such Hamiltonians the absence of the embedded eigenvalues of perturbed Hamiltonian has been conjectured. In this paper one proves this conjecture for the perturbations which have sufficiently small support in direction of drift velocity.
RODNet: Object Detection under Severe Conditions Using Vision-Radio Cross-Modal Supervision

Radar is usually more robust than the camera in severe autonomous driving scenarios, e.g., weak/strong lighting and bad weather. However, the semantic information from the radio signals is difficult to extract. In this paper, we propose a radio object detection network (RODNet) to detect objects purely from the processed radar data in the format of range-azimuth frequency heatmaps (RAMaps). To train the RODNet, we introduce a cross-modal supervision framework, which utilizes the rich information extracted by a vision-based object 3D localization technique to teach object detection for the radar. In order to train and evaluate our method, we build a new dataset -- CRUW, containing synchronized video sequences and RAMaps in various scenarios. After intensive experiments, our RODNet shows favorable object detection performance without the presence of the camera. To the best of our knowledge, this is the first work that can achieve accurate multi-class object detection purely using radar data as the input.
Multiple scaling limits of $\mathrm{U}(N)^2 \times \mathrm{O}(D)$ multi-matrix models

We study the double- and triple-scaling limits of a complex multi-matrix model, with $\mathrm{U}(N)^2\times \mathrm{O}(D)$ symmetry. The double-scaling limit amounts to taking simultaneously the large-$N$ (matrix size) and large-$D$ (number of matrices) limits while keeping the ratio $N/\sqrt{D}=M$ fixed. The triple-scaling limit consists in taking the large-$M$ limit while tuning the coupling constant $\lambda$ to its critical value $\lambda_c$ and keeping fixed the product $M(\lambda_c-\lambda)^\alpha$, for some value of $\alpha$ that depends on the particular combinatorial restrictions imposed on the model. Our first main result is the complete recursive characterization of the Feynman graphs of arbitrary genus which survive in the double-scaling limit. Next, we classify all the dominant graphs in the triple-scaling limit, which we find to have a plane binary tree structure with decorations. Their critical behavior belongs to the universality class of branched polymers. Lastly, we classify all the dominant graphs in the triple-scaling limit under the restriction to three-edge connected (or two-particle irreducible) graphs. Their critical behavior falls in the universality class of Liouville quantum gravity (or, in other words, the Brownian sphere).
Is Braden Scale Reliable and Sufficient to Evaluate the Risk of Pressure Ulcer Occurrence in Level 3 Intensive Care Unit Patients

Objective: To prevent pressure ulcer, detecting risk factors and planning how to act with respect to patients provide to find solution. Thus, Braden Scale is the most common tool that is used in Turkey. This study aimed to measure Braden Scale effectiveness at detecting the risk groups of level 3 intensive care unit patients. Methods: This prospective, single-center study includes 206 level 3 intensive care unit patients whose risk factors were standardized as much as possible in the intensive care unit between January 2014 and May 2015. Routine clinical care was applied to the patients whose risk groups were determined by Braden Scale, and the patients were divided into two groups depending on the presence of a pressure ulcer before discharging from the hospital. Demographic findings, hospitalization duration, mental status, Apache II score, expected/actual mortality, blood albumin levels, and Braden Scale score were compared. Results: Comparison of the groups showed that patients’ age, length of stay in intensive care unit, mental status, and blood albumin levels are significantly different between patients with and without pressure ulcers. Furthermore, scores of patients with pressure ulcers were not significantly different from those of patients without pressure ulcers. Data also illustrated that pressure ulcers occurred in no risk patients with the ratio of 7.14%; in low-risk patients with the ratio of 27.8%; in moderate-risk patients with the ratio of 29.73%; in high-risk patients with the ratio of 17.72%. Conclusion: Data evaluation demonstrates that Braden Scale is not effective to detect the risk factors, and parameters related to pressure ulcer development are not sufficiently represented by Braden Scale. Modification of an existing scale or a new risk assessment scale that includes all other risk parameters and that is more suitable for the patients of our country is required. (JAREM 2016; 6: 98-104)
Strong-field ionization of complex molecules

Strong-field photoelectron momentum imaging of the prototypical biomolecule indole was disentangled in a combined experimental and computational approach. Experimentally, strong control over the molecules enabled the acquisition of photoelectron momentum distributions in the molecular frame for a well-defined, narrow range of incident intensities. A novel, highly efficient semiclassical simulation setup based on the adiabatic tunneling theory quantitatively reproduced these results. Jointly, experiment and computations revealed holographic structures in the asymptotic momentum distributions, which were found to sensitively depend on the alignment of the molecular frame. We identified the essential molecular properties that shape the photoelectron wavepacket in the first step of the ionization process and employ a quantum-chemically exact description of the cation during the subsequent continuum dynamics. The detailed modeling of the molecular ion, which accounts for its polarization by the laser-electric field, enables the simulation of laser-induced electron diffraction off large and complex molecules and provides full insight into the photoelectron's dynamics in terms of semiclassical trajectories. This provides the computational means to unravel strong-field diffractive imaging of biomolecular systems on femtosecond time scales.
MOSEL Survey: Tracking the Growth of Massive Galaxies at 2 < z < 4 Using Kinematics and the IllustrisTNG Simulation

We use K-band spectroscopic data from the Multi-Object Spectroscopic Emission Line survey to analyze the kinematic properties of galaxies at z > 3. Our sample consists of 34 galaxies at 3.0 < zspec < 3.8 between 9.0 < < 11.0. We find that galaxies with > 10.2 at z > 3 have 56 ± 21 km s−1 lower integrated velocity dispersion compared to galaxies at z ≃ 2 of similar stellar mass. Massive galaxies at z > 3 have either a flat or declining star formation history (SFH), whereas similar stellar mass galaxies at z ∼ 2.0 exhibit a slight peak in the past 500 Myr. Comparing with the IllustrisTNG cosmological simulation, we find that (i) the dynamical mass of massive galaxies in simulations ( > 10.0) increases by ∼0.1 dex at a fixed stellar mass between z = 2.0–3.0, and (ii) dynamical mass growth is coupled with a rapid rise in the ex situ stellar mass fraction (stars accreted from other galaxies) for massive galaxies at z < 3.5. We speculate that the rising contribution of ex situ stellar mass to the total stellar mass growth of massive galaxies is driving the higher integrated velocity dispersion and rising SFHs of massive galaxies at z ∼ 2.0 compared to galaxies of similar stellar masses at z > 3.
ETRI-Activity3D: A Large-Scale RGB-D Dataset for Robots to Recognize Daily Activities of the Elderly

Deep learning, based on which many modern algorithms operate, is well known to be data-hungry. In particular, the datasets appropriate for the intended application are difficult to obtain. To cope with this situation, we introduce a new dataset called ETRI-Activity3D, focusing on the daily activities of the elderly in robot-view. The major characteristics of the new dataset are as follows: 1) practical action categories that are selected from the close observation of the daily lives of the elderly; 2) realistic data collection, which reflects the robot’s working environment and service situations; and 3) a large-scale dataset that overcomes the limitations of the current 3D activity analysis benchmark datasets. The proposed dataset contains 112,620 samples including RGB videos, depth maps, and skeleton sequences. During the data acquisition, 100 subjects were asked to perform 55 daily activities. Additionally, we propose a novel network called four-stream adaptive CNN (FSA-CNN). The proposed FSA-CNN has three main properties: robustness to spatio-temporal variations, input-adaptive activation function, and extension of the conventional two-stream approach. In the experiment section, we confirmed the superiority of the proposed FSA-CNN using NTU RGB+D and ETRI-Activity3D. Further, the domain difference between both groups of age was verified experimentally. Finally, the extension of FSA-CNN to deal with the multimodal data was investigated.
Flame: A Self-Adaptive Auto-Labeling System for Heterogeneous Mobile Processors

How to accurately and efficiently label data on a mobile device is critical for the success of training machine learning models on mobile devices. Auto-labeling data on mobile devices is challenging, because data is incrementally generated and there is a possibility of having unknown labels among new coming data. Furthermore, the rich hardware heterogeneity on mobile devices creates challenges on efficiently executing the auto-labeling workload. In this paper, we introduce Flame, an auto-labeling system that can label dynamically generated data with unknown labels. Flame includes an execution engine that efficiently schedules and executes auto-labeling workloads on heterogeneous mobile processors. Evaluating Flame with six datasets on two mobile devices, we demonstrate that the labeling accuracy of Flame is 11.8%, 16.1%, 18.5%, and 25.2% higher than a state-of-the-art labeling method, transfer learning, semi-supervised learning, and boosting methods respectively. Flame is also energy efficient, it consumes only 328.65mJ and 414.84mJ when labeling 500 data instances on Samsung S9 and Google Pixel2 respectively. Furthermore, running Flame on mobile devices only brings about 0.75 ms additional frame latency which is imperceivable by the users.
Late effects of poliomyelitis.

: Muscular atrophy and decreased functional abilities are recognized as late complications of poliomyelitis. This study sought to more clearly define late-onset, postpolio muscular weakness--age of onset, symptoms, and severity--and to determine whether people might benefit from environmental modification, respiratory aids, and orthoses. A total of 183 postpolio patients were examined by a physician and completed a questionnaire on their ambulatory status and related musculoskeletal and respiratory symptoms. Of those participating in the study, 154 claimed to be experiencing late deterioration in strength. The syndrome included decreased endurance, more limited ambulation, and increased weakness in the previously affected limb/s. For those describing late-onset weakness, average ages were determined for the onset of polio (8.3 years), the onset of postpolio muscular weakness (42.3 years), and the latent period of stable functioning (34.8 years). Patients claimed to have experienced a new, lower level of strength for an average of 4.7 years. All 33 patients who had undergone muscle transfer surgery were experiencing late-onset weakness in that extremity. Fasciculations (51%) and long-bone fractures secondary to falls (21%) were common sleep disturbances occurred frequently (31%) even in those without prior bulbar involvement. Upper motor neuron signs were present in only one case. Bracing was rare (16%) and the braces used were usually old. The subjects did not report a steadily or rapidly progressive decline, but rather described a steplike decrement with long plateaus. The population described losses in strength that had significant bearing on functional status and general health. (ABSTRACT TRUNCATED AT 250 WORDS)
Listening to the Voices of Syrian Women Refugees in Jordan: Ethnographies of Displacement and Emplacement

Electronic reference AL AKASH, Ruba ; BOSWALL, Karen. Listening to the Voices of Syrian Women Refugees in Jordan: Ethnographies of Displacement and Emplacement In: “Guests and Aliens”: Re-Configuring New Mobilities in the Eastern Mediterranean After 2011 with a special focus on Syrian refugees [online]. Istanbul: Institut français d’études anatoliennes, 2016 (generated 03 mai 2019). Available on the Internet: <http:// books.openedition. org/ifeagd/1884>. ISBN: 9782362450624. DOI: 10.4000/books.ifeagd. 1884.
Results of Deep Lamellar Keratoplasty using the Big-bubble Technique in Patients with Keratoconus

Themedicalrecordsof44eyesof42patientswithmoderate to advanced keratoconus whounderwent DALK procedure using the big-bubbletechniquebetweenNovember2005andMay2008wereanalyzed.TheindicationsforDALKw erm od tv nck us,contactlensintoleranceorcornealapicalscarring.An informed consent was obtained from allpatients.All patients had detailed ophthalmicexamination pre-operatively like uncorrectedvisualacuity(UCVA),bestspectaclecorrected
Drug Eluting Stents vs. Bare Metal Stents: An Analysis of Stent Restenosis and Mortality Rates

The purpose of this research project is to find clarity in the recent media publicity surrounding drug eluting stents. As a cardiac cath lab worker, I felt that it was imperative that I research this topic further due to the fact that I work with both bare metal and drug eluting stents on a day to day basis. I believe that knowing the findings of this study will make me better at my job and help me to feel more comfortable with my patients. Researching the topic of drug eluting versus bare metal stents is something that I felt would be easy due to the recent media attention. There were, in fact, many articles online and in journals about this topic, however, it was hard to find unbiased information online. I did however find several unbiased articles and was able to conclude my study in a positive way. Recent media hype has deemed drug-eluting stents dangerous. To research this topic, several studies were concluded with more than one thousand participants each. The results of these studies varied greatly. Several studies concluded that there was not a greater risk of using a drug eluting stent than using a bare metal stent. Others, however, disagreed. Restenosis rates were studied as well as mortality rates and acute myocardial infarction rates. A key factor that was shown to be a major contributing factor to in drug eluting stent restenosis was the compliance of the patient in using his/her post stent anticoagulant therapy. I will compare these studies, and hopefully shed light on the situation of controversy. In my research findings, I will differentiate drug eluting stents and bare metal stents, explain restenosis, and hopefully shed some light on the negative attention that has been given to drug eluting stents over the past several months.
Regulation of cerebral and systemic blood flow in humans with high level spinal cord injury: the infleunce of alpha1-agonist midodrine hydrochloride

ii PREFACE . ii TABLE OF CONTENTS . iv LIST OF TABLES . ix LIST OF FIGURES . x LIST OF ABBREVIATIONS . xii ACKNOWLEDGEMENTS . xiv CHAPTER ONE INTRODUCTION . 1 STATEMENT OF THE PROBLEM . 2 OVERVIEW . 2 CHAPTER TWO LITERATURE REVIEW . 4 PART I – CEREBROVASCULAR CONTROL AFTER SCI . 4 SUMMARY . 4 INTRODUCTION . 4 REGULATION OF CEREBRAL BLOOD FLOW . 6 Cerebral autoregulation . 8 Cerebrovascular reactivity . 9 Neurovascular coupling . 10 CEREBRAL BLOOD FLOW AFTER SPINAL CORD INJURY . 10 Cardiovascular consequences of spinal cord injury . 11 Static cerebral autoregulation. 13
Prostate Cancer Management in the UK and Other European Countries: A Systematic Review

Prostate cancer is a growing health problem among men with new cases being diagnosed each day. At the point of diagnosis symptoms might not be obvious but with the progression of the disease it becomes clear. The diagnosis of prostate cancer put men through a lot of psychological trauma. Several studies have shown that there no consensus on the best approach to the treatment and management of prostate cancer. The aim of this study is to elicit the effectiveness of the available treatment options for prostate cancer. A computer based literature search was conducted through Science Direct, CINAHL, Medline, Cochrane library, Embase, Psyc article, Google Scholar and library services of University of Sunderland. Out of the 1350 studies that emerged from the search, a total of 10 research studies which met the inclusion criteria were
MYOCARDIAL BRIDGES OF THE HEART OF THE DROMEDARY CAMEL (Camelus dromedarius)

Myocardial bridges were found in 90% of dissected adult hearts of thedromedary camel. Myocardial bridges were classified into two types according to their relation with the overbridged artery. In Type I, the descending interventricular subsinuosal or paraconal branches were bridged by one or two bands of cardiac muscle, in Type II, the descending interventricular subsinuosal or paraconal branches were noticed to dip in the myocardium without reappearing. Eight out of eleven hearts of fetuses had myocardial bridges (72.7%); seven hearts had myocardial bridges of Type II category in the subsinuosal interventricular branch, (87.5%); only one heart showed myocardial bridges on both sides (12.5%). In this heart, Type I category was observed over the subsinuosal interventricular branch whereas Type II category was confined to the paraconal interventricular branch.
N-Back Performance in Chronic Fatigue Syndrome

Phenylephrine Alteration of Cerebral Blood Flow During Orthostasis; Effect on 1 N-Back Performance in Chronic Fatigue Syndrome 2 3 4 5 Marvin S. Medow, Ph.D., Shilpa Sood, M.D., Zachary Messer, B.S., Seli Dzogbeta, 6 M.Sc., Courtney Terilli R.N. and Julian M. Stewart M.D., Ph.D. 7 8 Departments of Pediatrics and Physiology, New York Medical College, 9 Valhalla, New York 10595 10 11 12 13 14 15 16 17 18 19 20 Corresponding author: 21 22 Marvin S. Medow, Ph.D. 23 24 The Center for Hypotension 25 26 19 Bradhurst Avenue 27 28 Suite 1600 South 29 30 Hawthorne, N.Y. 10532 31 32 Phone: (914) 593-8888 33 34 Fax: (914) 593-8890 35 36 Email: Marvin_Medow@nymc.edu 37 38 39 40 Running Title: Brain Blood Flow and Cognition in CFS 41 42