ShantanuT01/DACTYL-Pretraining huggingface dataset:
Knowledge distillation has been applied to various tasks successfully. The current distillation algorithm usually improves students' performance by imitating the output of the teacher. This paper shows that teachers can also improve students' representation power by guiding students' feature recovery. From this point of view, we propose Masked Generative Distillation (MGD), which is simple: we mask random pixels of the student's feature and force it to generate the teacher's full feature through a simple block. MGD is a truly general feature-based distillation method, which can be utilized on various tasks, including image classification, object detection, semantic segmentation and instance segmentation. We experiment on different models with extensive datasets and the results show that all the students achieve excellent improvements. Notably, we boost ResNet-18 from 69.90% to 71.69% ImageNet top-1 accuracy, RetinaNet with ResNet-50 backbone from 37.4 to 41.0 Boundingbox mAP, SOLO based on ResNet-50 from 33.1 to 36.2 Mask mAP and DeepLabV3 based on ResNet-18 from 73.20 to 76.02 mIoU. Our codes are available at https://github.com/yzd-v/MGD.
Ultraluminous X-ray sources (ULXs) are thought to be powerful X-ray binaries (XRBs) and may contribute significantly to the redshift-dependent X-ray emission from star forming galaxies. We have assembled a uniform sample of 259 ULXs over the redshift range z=0.002-0.51 to constrain their physical nature and their contribution to the Cosmic X-Ray Background (CXB). The sample is constructed by crossmatching galaxies from the Sloan Digital Sky Survey with the Chandra Source Catalog and selecting off-nuclear X-ray sources after applying astrometric corrections. The fraction of contaminants is ~30% and shows no evolution with redshift. The host galaxy star formation rates (SFRs) are systematically elevated relative to the parent sample when matched in host stellar mass. The specific SFRs suggest a slight preference for high-mass XRBs, and the X-ray luminosity scaling relations with host galaxy stellar mass and SFR indicate that the highest redshift sources represent relatively luminous XRB populations that dominate their host galaxy X-ray emission. The fraction of galaxies hosting at least one ULX of a given luminosity increases with redshift over the full range of our sample, as expected if ULXs are preferentially found in galaxies with high SFRs and low metallicities. At z~0.5, the ULX X-ray flux is consistent with the X-ray emission from star-forming galaxies. Moreover, ULXs may account for up to ~40% of the integrated flux from XRBs in the normal galaxy population out to z~0.5, suggesting they may contribute significantly to the overall ionizing radiation from galaxies.
The effect of a high-frequency signal on the FitzHugh-Nagumo excitable model is analyzed. We show that the firing rate is diminished as the ratio of the high-frequency amplitude to its frequency is increased. Moreover, it is demonstrated that the excitable character of the system, and consequently the firing activity, is suppressed for ratios above a given threshold value. In addition, we show that the vibrational resonance phenomenon turns up for sufficiently large noise strength values.
We consider the limit $a\rightarrow \infty$ of the Kerr-de Sitter spacetime. The spacetime is a Petrov type-D solution of the vacuum Einstein field equations with a positive cosmological constant $\Lambda$, vanishing Mars-Simon tensor and conformally flat scri. It possesses an Abelian 2-dimensional group of symmetries whose orbits are spacelike or timelike in different regions, and it includes, as a particular case, de Sitter spacetime. The global structure of the solution is analyzed in detail, with particular attention to its Killing horizons: they are foliated by non-compact marginally trapped surfaces of finite area, and one of them `touches' the curvature singularity, which resembles a null 2-dimensional surface. Outside the region between these horizons there exist trapped surfaces that again are non-compact. The solution contains, apart from $\Lambda$, a unique free parameter which can be related to the angular momentum of the non-singular horizon in a precise way. A maximal extension of the (axis of the) spacetime is explicitly built. We also analyze the structure of scri, whose topology is $\mathbb{R}^3$.
We analyze the leading effective operators which induce a quartic momentum dependence in the Higgs propagator, for a linear and for a non-linear realization of electroweak symmetry breaking. Their specific study is relevant for the understanding of the ultraviolet sensitivity to new physics. Two methods of analysis are applied, trading the Lagrangian coupling by: i) a "ghost" scalar, after the Lee-Wick procedure; ii) other effective operators via the equations of motion. The two paths are shown to lead to the same effective Lagrangian at first order in the operator coefficients. It follows a modification of the Higgs potential and of the fermionic couplings in the linear realization, while in the non-linear one anomalous quartic gauge couplings, Higgs-gauge couplings and gauge-fermion interactions are induced in addition. Finally, all LHC Higgs and other data presently available are used to constrain the operator coefficients; the future impact of $pp\to\text{4 leptons}$ data via off-shell Higgs exchange and of vector boson fusion data is considered as well. For completeness, a summary of pure-gauge and gauge-Higgs signals exclusive to non-linear dynamics at leading-order is included.
In this paper, we investigate an inverse problem for the radiative transfer equation that is coupled with a heat equation in a nonscattering medium in $\mathbb{R}^n$, $n\geq 2$. The two equations are coupled through a nonlinear blackbody emission term that is proportional to the fourth power of the temperature. By measuring the radiation intensity on the surface of the blackbody, we prove that the emission property of the system can be uniquely reconstructed. In particular, we design a reconstruction procedure that uses merely one set of experiment setup to fully recover the emission parameter.
The 21 cm signal from the Epoch of Reionization should be observed within the next decade. While a simple statistical detection is expected with SKA pathfinders, the SKA will hopefully produce a full 3D mapping of the signal. To extract from the observed data constraints on the parameters describing the underlying astrophysical processes, inversion methods must be developed. For example, the Markov Chain Monte Carlo method has been successfully applied. Here we test another possible inversion method: artificial neural networks (ANN). We produce a training set which consists of 70 individual sample. Each sample is made of the 21 cm power spectrum at different redshifts produced with the 21cmFast code plus the value of three parameters used in the semi-numerical simulations that describe astrophysical processes. Using this set we train the network to minimize the error between the parameter values it produces as an output and the true values. We explore the impact of the architecture of the network on the quality of the training. Then we test the trained network on the new set of 54 test samples with different values of the parameters. We find that the quality of the parameter reconstruction depends on the sensitivity of the power spectrum to the different parameters at a given redshift, that including thermal noise and sample variance decreases the quality of the reconstruction and that using the power spectrum at several redshifts as an input to the ANN improves the quality of the reconstruction. We conclude that ANNs are a viable inversion method whose main strength is that they require a sparse exploration of the parameter space and thus should be usable with full numerical simulations.
The combination of huge databases of galaxy spectra and advances in evolutionary synthesis models in the past few years has renewed interest in an old question: How to estimate the star formation history of a galaxy out of its integrated spectrum? Fresh approaches to this classical problem are making it possible to extract the best of both worlds, producing exquisite pixel-by-pixel fits to galaxy spectra with state-of-the-art stellar population models while at the same time exploring the fabulous statistics of mega-surveys to derive the star-formation and chemical enrichment histories of different types of galaxies with an unprecedented level of detail. This review covers some of these recent advances, focusing on results for late-type, star-forming galaxies, and outlines some of the issues which will keep us busy in the coming years.
Increasing the magnetic data recording density requires reducing the size of the individual memory elements of a recording layer as well as employing magnetic materials with temperature-dependent functionalities. Therefore, it is predicted that the near future of magnetic data storage technology involves a combination of energy-assisted recording on nanometer-scale magnetic media. We present the potential of heat-assisted magnetic recording on a patterned sample; a ferrimagnetic alloy composed of a rare earth and a transition metal, DyCo$_5$, which is grown on a hexagonal-ordered nanohole array membrane. The magnetization of the antidot array sample is out-of-plane oriented at room temperature and rotates towards in-plane upon heating above its spin-reorientation temperature (T$_R$) of ~350 K, just above room temperature. Upon cooling back to room temperature (below T$_R$), we observe a well-defined and unexpected in-plane magnetic domain configuration modulating with ~45 nm. We discuss the underlying mechanisms giving rise to this behavior by comparing the magnetic properties of the patterned sample with the ones of its extended thin film counterpart. Our results pave the way for novel applications of ferrimagnetic antidot arrays of superior functionality in magnetic nano-devices near room temperature.
The soft-gamma repeater SGR 1900+14 became active again on June 1998 after a long period of quiescence; it remained at a low state of activity until August 1998, when it emitted a series of extraordinarily intense outbursts. We have observed the source with RXTE twice, during the onset of each active episode. We confirm the pulsations at the 5.16 s period reported earlier (Hurley et al. 1998b, Hurley et al. 1998 e) from SGR 1900+14. Here we report the detection of a secular spindown of the pulse period at an average rate of 1.1*10^{-10} s/s. In view of the strong similarities between SGRs, we attribute the spindown of SGR 1900+14 to magnetic dipole radiation, possibly accelerated by a quiescent flux, as in the case of SGR 1806-20 (Kouveliotou et al. 1998a). This allows an estimate of the pulsar dipolar magnetic field, which is 2-8*10^{14} G. Our results confirm that SGRs are magnetars.
We consider in this paper blow-up solutions of the semilinear wave equation in one space dimension, with an exponential source term. Assuming that initial data are in $H^{1}_{loc}\times L^2_{loc}$ or some times in $ W^{1,\infty}\times L^{\infty}$, we derive the blow-up rate near a non-characteristic point in the smaller space, and give some bounds near other points. Our result generalize those proved by Godin under high regularity assumptions on initial data.
We discuss the spin-dependent structure function $g_2(x,Q^2)$ in the framework of the operator product expansion. It is noted that the anomalous dimensions and coefficient functions for the twist-3 gluon-field-dependent operators depend on the choice of the operator basis. The role played by the operators proportional to the equation of motion is clarified.
We obtain an upper bound on the initial blow-up of nonnegative solutions of second order semilinear parabolic inequalities when a superlinear exponent in the inequalities is not too large.
In this paper we present an analysis to determine the existence of singularities in spatially homogeneous anisotropic universes filled with nonlinear electromagnetic radiation. These spaces are conformal to Bianchi spaces admitting a three parameter group of motions G$_3$. For these models we study geodesic completeness. It is shown that with nonlinear electromagnetic field some of the Bianchi spaces are geodesically complete, like G$_3$IX and G$_3$VIII; however, completeness depends on the curvature of the space. When certain topology is assumed, Bianchi G$_3$IX presents geodesics that are imprisoned. It is surprising that in the linear limit (Maxwell field) the spacetimes are singularity-free even if the curvature parameter is zero.
We propose and demonstrate a quantum key distribution scheme in higher-order $d$-dimensional alphabets using spatial degrees of freedom of photons. Our implementation allows for the transmission of 4.56 bits per sifted photon, while providing improved security: an intercept-resend attack on all photons would induce an error rate of 0.47. Using our system, it should be possible to send more than a byte of information per sifted photon.
We present new observations of IRAS 04000+5052, a Galactic HII region associated with a young stellar cluster and possibly located at the Perseus arm. Contrary to previous claims, we have found that this object is not a compact metal-poor HII region. The electron density and chemical composition of the nebula are similar to those of normal HII regions of the Galactic disk. The radial velocity of the ionized gas coincides with that obtained from CO observations, indicating that the nebula is associated with a molecular cloud. Probably, the ionizing source of the HII region is a Herbig Be star of B0.5 spectral type.
Using equidistribution results of Katz and a computation in finite symplectic groups, we give an explicit asymptotic formula for the proportion of curves C over a finite field for which the l-torsion of Jac(C) is isomorphic to a given abelian l-group. In doing so, we prove a conjecture of Friedman and Washington
Let $p>3$ be a prime. Euler numbers $E_{p-3}$ first appeared in H. S. Vandiver's work (1940) in connection with the first case of Fermat Last Theorem. Vandiver proved that $x^p+y^p=z^p$ has no solution for integers $x,y,z$ with $\gcd(xyz,p)=1$ if $E_{p-3}\equiv 0 (\bmod p)$. Numerous combinatorial congruences recently obtained by Z.-W. Sun and by Z.-H. Sun involve the Euler numbers $E_{p-3}$. This gives a new significance to the primes $p$ for which $E_{p-3}\equiv 0 (\bmod p)$.   For the computation of residues of Euler numbers $E_{p-3}$ modulo a prime $p$, we use the congruence which runs significantly faster than other known congruences involving $E_{p-3}$. Applying this congruence, a computation via {\tt Mathematica 8} shows that only three primes less than $10^7$ satisfy the condition $E_{p-3}\equiv 0 (\bmod p)$ (such primes are 149, 241 and 2946901, and they are given as a Sloane's sequence A198245). By using related computational results and statistical considerations similar to those on search for Wieferich and Fibonacci-Wieferich and Wolstenholme primes, we conjecture that there are infinitely many primes $p$ such that $E_{p-3}\equiv 0 (\bmod p)$. Moreover, we propose a conjecture on the asymptotic estimate of number of primes $p$ in an interval $[x,y]$ such that $E_{p-3}\equiv A (\bmod p)$ for some integer $A$ with $|A|\in [K,L]$.
Optical flow estimation in omnidirectional videos faces two significant issues: the lack of benchmark datasets and the challenge of adapting perspective video-based methods to accommodate the omnidirectional nature. This paper proposes the first perceptually natural-synthetic omnidirectional benchmark dataset with a 360-degree field of view, FLOW360, with 40 different videos and 4,000 video frames. We conduct comprehensive characteristic analysis and comparisons between our dataset and existing optical flow datasets, which manifest perceptual realism, uniqueness, and diversity. To accommodate the omnidirectional nature, we present a novel Siamese representation Learning framework for Omnidirectional Flow (SLOF). We train our network in a contrastive manner with a hybrid loss function that combines contrastive loss and optical flow loss. Extensive experiments verify the proposed framework's effectiveness and show up to 40% performance improvement over the state-of-the-art approaches. Our FLOW360 dataset and code are available at https://siamlof.github.io/.
Strong gravitational lensing gives access to the total mass distribution of galaxies. It can unveil a great deal of information about the lenses dark matter content when combined with the study of the lenses light profile. However, gravitational lensing galaxies, by definition, appear surrounded by point-like and diffuse lensed signal that is irrelevant to the lens flux. Therefore, the observer is most often restricted to studying the innermost portions of the galaxy, where classical fitting methods show some instabilities. We aim at subtracting that lensed signal and at characterising some lenses light profile by computing their shape parameters. Our objective is to evaluate the total integrated flux in an aperture the size of the Einstein ring in order to obtain a robust estimate of the quantity of ordinary matter in each system. We are expanding the work we started in a previous paper that consisted in subtracting point-like lensed images and in independently measuring each shape parameter. We improve it by designing a subtraction of the diffuse lensed signal, based only on one simple hypothesis of symmetry. This extra step improves our study of the shape parameters and we refine it even more by upgrading our half-light radius measurement. We also calculate the impact of our specific image processing on the error bars. The diffuse lensed signal subtraction makes it possible to study a larger portion of relevant galactic flux, as the radius of the fitting region increases by on average 17\%. We retrieve new half-light radii values that are on average 11\% smaller than in our previous work, although the uncertainties overlap in most cases. This shows that not taking the diffuse lensed signal into account may lead to a significant overestimate of the half-light radius. We are also able to measure the flux within the Einstein radius and to compute secure error bars to all of our results.
Thermodynamic and electronic properties are obtained for a lattice-gas model fluid with self-consistent, partial, occupation of its sites; the self consistency consists in obtaining ionic configurations from grand-canonical Monte Carlo simulations based on fits to the exact, electronic, tight-binding energies of isothermal ensembles of those same ionic configurations. The energy of an ion is found to be a concave-up function of its local coordination. Liquid-vapor coexistence densities and the electrical conductivity, which shows a metal-nonmetal transition, have been obtained.
The theoretical existence of photon-number-splitting attacks creates a security loophole for most quantum key distribution (QKD) demonstrations that use a highly attenuated laser source. Using ultra-low-noise, high-efficiency transition-edge sensor photodetectors, we have implemented the first version of a decoy-state protocol that incorporates finite statistics without the use of Gaussian approximations in a one-way QKD system, enabling the creation of secure keys immune to photon-number-splitting attacks and highly resistant to Trojan horse attacks over 107 km of optical fiber.
We study the SIR epidemic model with infections carried by $k$ particles making independent random walks on a random regular graph. Here we assume $k\leq n^{\epsilon}$, where $n$ is the number of vertices in the random graph, and $\epsilon$ is some sufficiently small constant. We give an edge-weighted graph reduction of the dynamics of the process that allows us to apply standard results of Erd\H{o}s-R\'{e}nyi random graphs on the particle set. In particular, we show how the parameters of the model give two thresholds: In the subcritical regime, $O(\ln k)$ particles are infected. In the supercritical regime, for a constant $\beta\in(0,1)$ determined by the parameters of the model, $\beta k$ get infected with probability $\beta$, and $O(\ln k)$ get infected with probability $(1-\beta)$. Finally, there is a regime in which all $k$ particles are infected. Furthermore, the edge weights give information about when a particle becomes infected. We exploit this to give a completion time of the process for the SI case.
We study the asymptotic behavior of the $\nu$-symmetric Riemman sums for functionals of a self-similar centered Gaussian process $X$ with increment exponent $0<\alpha<1$. We prove that, under mild assumptions on the covariance of $X$, the law of the weak $\nu$-symmetric Riemman sums converge in the Skorohod topology when $\alpha=(2\ell+1)^{-1}$, where $\ell$ denotes the smallest positive integer satisfying $\int_{0}^{1}x^{2j}\nu(dx)=(2j+1)^{-1}$ for all $j=0,\dots, \ell-1$. In the case $\alpha>(2\ell+1)^{-1}$, we prove that the convergence holds in probability.
This paper introduces BReG-NeXt, a residual-based network architecture using a function wtih bounded derivative instead of a simple shortcut path (a.k.a. identity mapping) in the residual units for automatic recognition of facial expressions based on the categorical and dimensional models of affect. Compared to ResNet, our proposed adaptive complex mapping results in a shallower network with less numbers of training parameters and floating point operations per second (FLOPs). Adding trainable parameters to the bypass function further improves fitting and training the network and hence recognizing subtle facial expressions such as contempt with a higher accuracy. We conducted comprehensive experiments on the categorical and dimensional models of affect on the challenging in-the-wild databases of AffectNet, FER2013, and Affect-in-Wild. Our experimental results show that our adaptive complex mapping approach outperforms the original ResNet consisting of a simple identity mapping as well as other state-of-the-art methods for Facial Expression Recognition (FER). Various metrics are reported in both affect models to provide a comprehensive evaluation of our method. In the categorical model, BReG-NeXt-50 with only 3.1M training parameters and 15 MFLOPs, achieves 68.50% and 71.53% accuracy on AffectNet and FER2013 databases, respectively. In the dimensional model, BReG-NeXt achieves 0.2577 and 0.2882 RMSE value on AffectNet and Affect-in-Wild databases, respectively.
Quasicrystals can be considered, from the point of view of their electronic properties, as being intermediate between metals and insulators. For example, experiments show that quasicrystalline alloys such as AlCuFe or AlPdMn have conductivities far smaller than those of the metals that these alloys are composed from. Wave functions in a quasicrystal are typically intermediate in character between the extended states of a crystal and the exponentially localized states in the insulating phase, and this is also reflected in the energy spectrum and the density of states. In the theoretical studies we consider in this review, the quasicrystals are described by a pure hopping tight binding model on simple tilings. We focus on spectral properties, which we compare with those of other complex systems, in particular, the Anderson model of a disordered metal.
A strong spin Nernst effect with nontrivial dependences on the carrier concentration and electric field applied is expected in silicene and other low-buckled Dirac materials. These Dirac materials can be considered as being made of two independent electron subsystems of the two-component gapped Dirac fermions. For each subsystem the gap breaks a time-reversal symmetry and thus plays a role of an effective magnetic field. Accordingly, the standard Kubo formalism has to be altered by including the effective magnetization in order to satisfy the third law of thermodynamics. We explicitly demonstrate this by calculating the magnetization and showing how the correct thermoelectric coefficient emerges.