ShantanuT01/DACTYL-Pretraining huggingface dataset:
Self-supervised learning (SSL) holds promise in leveraging large amounts of unlabeled data. However, the success of popular SSL methods has limited on single-centric-object images like those in ImageNet and ignores the correlation among the scene and instances, as well as the semantic difference of instances in the scene. To address the above problems, we propose a Unified Self-supervised Visual Pre-training (UniVIP), a novel self-supervised framework to learn versatile visual representations on either single-centric-object or non-iconic dataset. The framework takes into account the representation learning at three levels: 1) the similarity of scene-scene, 2) the correlation of scene-instance, 3) the discrimination of instance-instance. During the learning, we adopt the optimal transport algorithm to automatically measure the discrimination of instances. Massive experiments show that UniVIP pre-trained on non-iconic COCO achieves state-of-the-art transfer performance on a variety of downstream tasks, such as image classification, semi-supervised learning, object detection and segmentation. Furthermore, our method can also exploit single-centric-object dataset such as ImageNet and outperforms BYOL by 2.5% with the same pre-training epochs in linear probing, and surpass current self-supervised object detection methods on COCO dataset, demonstrating its universality and potential.
We report an all-electric integrable electron focusing lens in n-type GaAs. It is shown that a pronounced focusing peak takes place when the focal point aligns with an on-chip detector. The intensity and full width half maximum (FWHM) of the focusing peak are associated with the collimation of injected electrons. To demonstrate the reported focusing lens can be a useful tool, we investigate characteristic of an asymmetrically gate biased quantum point contact with the assistance of focusing lens. A correlation between the occurrence of conductance anomaly in low conductance regime and increase in FWHM of focusing peak is observed. The correlation is likely due to the electron-electron interaction. The reported electron focusing lens is essential for a more advanced electron optics device.
A neutron powder diffraction study has been carried out on Pb(Zr0.52Ti0.48)O3 in order to resolve an ongoing controversy about the nature of the low-temperature structure of this strongly-piezoelectric and technologically-important material. The results of a detailed and systematic Rietveld analysis at 20 K are consistent with the coexistence of two monoclinic phases having space groups Cm and Ic respectively, in the approximate ratio 4:1, and thus support the findings of a recent electron diffraction study by Noheda et al. [Phys. Rev. B 66, 060103 (2002)]. The results are compared to those of two recent conflicting neutron powder diffraction studies of materials of the same nominal composition by Hatch et al. [Phys. Rev. B 65, 212101 (2002)] and Frantti et al. [Phys. Rev. B 66, 064108 (2002)].
We have used blue near-infrared colours to select a group of 12 spectroscopically-confirmed UKIDSS T dwarfs later than T4. From amongst these we identify the first two kinematic halo T-dwarf candidates. Blue near-infrared colours have been attributed to collisionally-induced hydrogen absorption, which is enhanced by either high surface gravity or low metallicity. Proper motions are measured and distances estimated, allowing the determination of tangential velocities. U and V components are estimated for our objects by assuming radial velocity = 0 km/s. From this, ULAS J0926+0835 is found to have U=62 km/s and V=-140km/s and ULAS J1319+1209 is found to have U=192 km/s and V=-92 km/s. These values are consistent with potential halo membership. However, these are not the bluest objects in our selection. The bluest is ULAS J1233+1219, with J-K=-1.16 +/- 0.07, and surprisingly this object is found to have young disc-like U and V. Our sample also contains Hip 73786B, companion to the metal-poor K5 dwarf Hip 73786. Hip 73786 is a metal-poor star, with [Fe/H]=-0.3 and is located at a distance of 19 pc. U, V, W space velocity components are calculated for Hip 73786A and B, finding that U=-48 +/- 7 km/s, V=-75 +/- 4 km/s and W=-44 +/- 8 km/s. From the properties of the primary, Hip 73786B is found to be at least 1.6 Gyr old. As a metal poor object, Hip 73786B represents an important addition to the sample of known T dwarf benchmarks.
Blazar variability may be driven by stochastic processes. On the other hand, quasi-periodic oscillation (QPO) behaviors are recently reported to be detected in $\it{Fermi}$-LAT data of blazars. However, the significances of these QPO signals given by traditional Fourier-like methods are still questioned. We analyze $\gamma$-ray light curves of the QPO blazars with two Gaussian process methods, CARMA and $\it{celerite}$, to examine the appropriateness of Gaussian processes for characterizing $\gamma$-ray light curves of blazars and the existence of the reported QPOs. We collect a sample of 27 blazars with possible $\gamma$-ray periodicity and generate their $\sim11$ years $\it{Fermi}$-LAT light curves. We apply the Gaussian process models to the $\gamma$-ray light curves, and build their intrinsic power spectral densities (PSDs). The results show that in general the $\gamma$-ray light curves can be characterized by CARMA and $\textit{celerite}$ models, indicating that $\gamma$-ray variabilities of blazars are essentially Gaussian processes. The resulting PSDs are generally the red noise shapes with slopes between $-0.6$ and $-1.7$. Possible evidence for the $\gamma$-ray QPOs in PKS 0537$-$441 and PG 1553$+$113 are found in the Gaussian process modelings.
Training deep neural networks typically requires large amounts of labeled data which may be scarce or expensive to obtain for a particular target domain. As an alternative, we can leverage webly-supervised data (i.e. results from a public search engine) which are relatively plentiful but may contain noisy results. In this work, we propose a novel two-stage approach to learn a video classifier using webly-supervised data. We argue that learning appearance features and then temporal features sequentially, rather than simultaneously, is an easier optimization for this task. We show this by first learning an image model from web images, which is used to initialize and train a video model. Our model applies domain adaptation to account for potential domain shift present between the source domain (webly-supervised data) and target domain and also accounts for noise by adding a novel attention component. We report results competitive with state-of-the-art for webly-supervised approaches on UCF-101 (while simplifying the training process) and also evaluate on Kinetics for comparison.
We show that any smooth permutation $\sigma\in S_n$ is characterized by the set ${\mathbf{C}}(\sigma)$ of transpositions and $3$-cycles in the Bruhat interval $(S_n)_{\leq\sigma}$, and that $\sigma$ is the product (in a certain order) of the transpositions in ${\mathbf{C}}(\sigma)$. We also characterize the image of the map $\sigma\mapsto{\mathbf{C}}(\sigma)$. As an application, we show that $\sigma$ is smooth if and only if the intersection of $(S_n)_{\leq\sigma}$ with every conjugate of a parabolic subgroup of $S_n$ admits a maximum. This also gives another approach for enumerating smooth permutations and subclasses thereof. Finally, we relate covexillary permutations to smooth ones and rephrase the results in terms of the (co)essential set in the sense of Fulton.
We solve a theoretical arithmetics problem stated by Wac{\l}aw Sierpi\'nski. The problem has remained open for a couple of decades.
We present a Chandra X-ray Observatory investigation of the millisecond pulsars (MSPs) in the globular cluster M28 (NGC 6626). In what is one of the deepest X-ray observations of a globular cluster, we firmly detect seven and possibly detect two of the twelve known M28 pulsars. With the exception of PSRs B1821-24 and J1824-2452H, the detected pulsars have relatively soft spectra, with X-ray luminosities 10^30-31 ergs s^-1 (0.3-8 keV),similar to most "recycled" pulsars in 47 Tucanae and the field of the Galaxy, implying thermal emission from the pulsar magnetic polar caps. We present the most detailed X-ray spectrum to date of the energetic PSR B1821-24. It is well described by a purely non-thermal spectrum with spectral photon index 1.23 and luminosity 1.4x10^33Theta(D/5.5 kpc)^2 ergs s^-1 (0.3-8 keV), where Theta is the fraction of the sky covered by the X-ray emission beam(s). We find no evidence for the previously reported line emission feature around 3.3 keV, most likely as a consequence of improvements in instrument calibration. The X-ray spectrum and pulse profile of PSR B1821--24 suggest that the bulk of unpulsed emission from this pulsar is not of thermal origin, and is likely due to low-level non-thermal magnetospheric radiation, an unresolved pulsar wind nebula, and/or small-angle scattering of the pulsed X-rays by interstellar dust grains. The peculiar binary PSR J1824-2452H shows a relatively hard X-ray spectrum and possible variability at the binary period, indicative of an intrabinary shock formed by interaction between the relativistic pulsar wind and matter from its non-degenerate companion star.
Transients in the fission of highly excited nuclei are studied in the framework of the Langevin equation. Time-dependent fission widths are calculated which show that after the initial transients, a steady flow towards the scission point is established not only for nuclei which have fission barriers but also for nuclei which have no fission barrier. It is shown from a comparison of the transient time and the fission life time that fission changes from a diffusive to a transient dominated process over a certain transition region as a function of the spin of the fissioning nucleus. Multiplicities of prescission neutrons are calculated in a statistical model with as well as without a single swoop description of fission and they are found to differ in the transition region. We however find that the difference is marginal and hence a single swoop picture of fission though not strictly valid in the transition region can still be used in the statistical model calculations.
We study how effects of the CP violation can be observed indirectly by precision measurements of Higgs boson couplings at a future Higgs factory such as the international linear collider. We consider two Higgs doublet models with the softly broken discrete symmetry. We find that by measuring the Higgs boson couplings very precisely we are able to distinguish the two Higgs doublet model with CP violation from the CP conserving one.
We investigate omni-supervised learning, a special regime of semi-supervised learning in which the learner exploits all available labeled data plus internet-scale sources of unlabeled data. Omni-supervised learning is lower-bounded by performance on existing labeled datasets, offering the potential to surpass state-of-the-art fully supervised methods. To exploit the omni-supervised setting, we propose data distillation, a method that ensembles predictions from multiple transformations of unlabeled data, using a single model, to automatically generate new training annotations. We argue that visual recognition models have recently become accurate enough that it is now possible to apply classic ideas about self-training to challenging real-world data. Our experimental results show that in the cases of human keypoint detection and general object detection, state-of-the-art models trained with data distillation surpass the performance of using labeled data from the COCO dataset alone.
On 2011 September 6, we observed an X2.1-class flare in continuum and H$\alpha$ with a frame rate of about 30~Hz. After processing images of the event by using a speckle-masking image reconstruction, we identified white-light (WL) flare ribbons on opposite sides of the magnetic neutral line. We derive the lightcurve decay times of the WL flare kernels at each resolution element by assuming that the kernels consist of one or two components that decay exponentially, starting from the peak time. As a result, 42% of the pixels have two decay-time components with average decay times of 15.6 and 587 s, whereas the average decay time is 254 s for WL kernels with only one decay-time component. The peak intensities of the shorter decay-time component exhibit good spatial correlation with the WL intensity, whereas the peak intensities of the long decay-time components tend to be larger in the early phase of the flare at the inner part of the flare ribbons, close to the magnetic neutral line. The average intensity of the longer decay-time components is 1.78 times higher than that of the shorter decay-time components. If the shorter decay time is determined by either the chromospheric cooling time or the nonthermal ionization timescale and the longer decay time is attributed to the coronal cooling time, this result suggests that WL sources from both regions appear in 42% of the WL kernels and that WL emission of the coronal origin is sometimes stronger than that of chromospheric origin.
The present article is devoted to the study of local anisotropies effects on the Durgapal's fourth model in the context of gravitational decoupling via the Minimal Geometric Deformation approach. To do it, the most general equation of state relating the components of the $\theta$--sector is imposed to obtain the decoupler function $f(r)$. In addition, certain properties of the obtained solution are investigated, such as the behavior of the salient material content threading the stellar interior, causality and energy conditions, hydrostatic balance through modified Tolman--Oppenheimer--Volkoff conservation equation and stability mechanism against local anisotropies by means of adiabatic index, sound velocity of the pressure waves, convection factor and Harrison--Zeldovich--Novikov procedure, in order to check if the model is physically admissible or not. Regarding the stability analysis, it is found that the model presents unstable regions when the sound speed of the pressure waves and convection factor are used in distinction with what happens in the adiabatic index and Harrison--Zeldovich--Novikov case. To produce a more realistic picture the numerical data for some known compact objects was placed and different values of the parameter $\alpha$ were considered to compare with the GR case \i.e, $\alpha=0$.
The ARGO-YBJ experiment is currently under construction at the Yangbajing Cosmic Ray Laboratory (4300 m a.s.l.). The detector will cover 74 X 78 m^2 with a single layer of Resistive Plate Counters (RPCs), surrounded by a partially instrumented guard ring. Signals from each RPC are picked-up with 80 read out strips 6 cm wide and 62 cm long. These strips allow one to count the particle number of small size air showers. In this paper we discuss the digital response of the detector for showers with core located in a small fiducial area inside the carpet. The results enable us to assess the sensitivity of the strip size spectrum measurement to discriminate between different models of the Primary Cosmic Ray composition in the energy range 10 - 500 TeV.
This paper is a sequel to math.AG/9803041. It consists of three parts. In the first part we give certain construction of vertex algebras which includes in particular the ones appearing in op. cit.   In the second part we show how the cohomology ring $H^*(X)$ of a smooth complex variety $X$ could be restored from the correlation functions of the vertex algebra $R\Gamma(X;\Omega^{ch}_X)$.   In the third part, we prove first a useful general statement that the sheaf of loop algebras over the tangent sheaf $\Cal{T}_X$ acts naturally on $\Omega^{ch}_X$ for every smooth $X$ (see \S 1). The Z-graded vertex algebra $H^*(X;\Omega^{ch}_X)$ seems to be a quite interesting object (especially for compact $X$). In \S 2, we compute $H^0(CP^N;\Omega^{ch}_{CP^N})$ as a module over $\hat{sl}(N+1)$.
In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting neurons indexed by a lattice $\mathbb{Z}^d$. The neurons are subject to noise, which is modelled as a correlated martingale. The probability law governing the noise is strictly stationary, and we are therefore able to find a LDP for the probability laws $\Pi^n$ governing the stationary empirical measure $\hat{\mu}^n$ generated by the neurons in a cube of length $(2n+1)$. We use this LDP to determine an LDP for the neural network model. The connection weights between the neurons evolve according to a learning rule / neuronal plasticity, and these results are adaptable to a large variety of neural network models. This LDP is of great use in the mathematical modelling of neural networks, because it allows a quantification of the likelihood of the system deviating from its limit, and also a determination of which direction the system is likely to deviate. The work is also of interest because there are nontrivial correlations between the neurons even in the asymptotic limit, thereby presenting itself as a generalisation of traditional mean-field models.
We consider hydrodynamic electron transport in the Hall-bar geometry. The theory is developed for systems with non-Galilean-invariant electron liquids. We show that inhomogeneity of the electron density induced by long-range disorder and gating leads to mixing between the hydrodynamic transport mode and transport relative to the electron liquid. For graphene systems near charge neutrality, these effects lead to strong coupling of the hydrodynamic flow to charge transport. As a result, the effective electrical conductivity of the system may significantly exceed the intrinsic conductivity of the electron liquid. We obtain analytic expressions for the thermoelectric transport coefficients of the system as a function of density in the full crossover region between clean and disorder-dominated regimes.
The $\Lambda$CDM scenario to form galaxies encounters many problems when confronted with observations, namely the prediction of dark matter cusps in all galaxies, and in particular in dwarf irregulars, dominated by dark matter, or the low angular momentum and consequent small size of galaxy disks, or the high predicted number of small systems. We will consider the hypothesis that the baryonic dark matter could be in the form of gas and could be continuously involved in the galaxy formation scenario. Through cold gas accretion all along a galaxy life, angular momentum could be increased, galaxy disks could be more dominated by baryons than previously thought, and small systems could merge more frequently.
The lower and upper bounds on the neutrinoless double beta (0nu-2beta) decay rate are obtained, as functions of the parameters of neutrino oscillations and of the lightest neutrino mass. The constraints on these parameters from the search for the 0nu-2beta transition, as well as from the interpretation of solar and atmospheric neutrino data in terms of oscillations, can be conveniently represented in one unitarity triangle. This representation helps to clarify the cases when the 0nu-2beta rate is small; the crucial dependence on the scenarios assumed for solar neutrino oscillations and on the neutrino spectrum is emphasized. We consider hierarchical and non-hierarchical neutrino spectra, and discuss their interest in view of future searches of the 0nu-2beta decay.
Converting a noisy parallax measurement into a posterior belief over distance requires inference with a prior. Usually this prior represents beliefs about the stellar density distribution of the Milky Way. However, multi-band photometry exists for a large fraction of the \textsl{\small{Gaia}} \textsl{\small{TGAS}} Catalog and is incredibly informative about stellar distances. Here we use \textsl{\small{2MASS}} colors for 1.4 million \textsl{\small{TGAS}} stars to build a noise-deconvolved empirical prior distribution for stars in color--magnitude space. This model contains no knowledge of stellar astrophysics or the Milky Way, but is precise because it accurately generates a large number of noisy parallax measurements under an assumption of stationarity; that is, it is capable of combining the information from many stars. We use the Extreme Deconvolution (\textsl{\small{XD}}) algorithm---an Empirical Bayes approximation to a full hierarchical model of the true parallax and photometry of every star---to construct this prior. The prior is combined with a \textsl{\small{TGAS}} likelihood to infer a precise photometric parallax estimate and uncertainty (and full posterior) for every star. Our parallax estimates are more precise than the \textsl{\small{TGAS}} catalog entries by a median factor of 1.2 (14% are more precise by a factor >2) and are more precise than previous Bayesian distance estimates that use spatial priors. We validate our parallax inferences using members of the Milky Way star cluster M67, which is not visible as a cluster in the \textsl{\small{TGAS}} parallax estimates, but appears as a cluster in our posterior parallax estimates. Our results, including a parallax posterior pdf for each of 1.4 million \textsl{\small{TGAS}} stars, are available in companion electronic tables.
In this paper we study the a.e. exponential strong summability problem for the rectangular partial sums of double trigonometric Fourier series of the functions from $L\log L$ .
We studied the O-bearing molecule HCOOCH3 to characterize the physical conditions of the different molecular source components in Orion-KL. We identify 28 methyl formate emission peaks throughout the 50" field of observations. The two strongest peaks are in the Compact Ridge (MF1) and in the SouthWest of the Hot Core (MF2). Spectral confusion is still prevailing as half of the expected transitions are blended over the region. Assuming that the transitions are thermalized, we derive the temperature at the five main emission peaks. At the MF1 position we find a temperature of 80K in a 1.8"x0.8" beam size and 120K on a larger scale (3.6" x2.2"), suggesting an external source of heating, whereas the temperature is about 130K at the MF2 position on both scales. Transitions of HCOOCH3 in vt=1 are detected as well and the good agreement of the positions on the rotational diagrams between the vt=0 and the vt=1 transitions suggests a similar temperature. The velocity of the gas is between 7.5 and 8.0km/s depending on the positions and column density peaks vary from 1.6x10^16 to 1.6x10^17cm^-2. A second velocity component is observed around 9-10 km/s in a North-South structure stretching from the Compact Ridge up to the BN object; this component is warmer at the MF1 peak. The two other C2H4O2 isomers are not detected and the derived upper limit for the column density is <3x10^14cm^-2 for glycolaldehyde and <2x10^15cm^-2 for acetic acid. From the 223GHz continuum map, we identify several dust clumps with associated gas masses in the range 0.8 to 5.8Msun. Assuming that the HCOOCH3 is spatially distributed as the dust, we find relative abundances of HCOOCH3 in the range <0.1x10^-8 to 5.2x10^-8. We suggest a relation between the methyl formate distribution and shocks as traced by 2.12 mum H2 emission.
We present new H$\alpha$ and H$\beta$ images of the HH~1/2 system, and we find that the H$\alpha$/H$\beta$ ratio has high values in ridges along the leading edges of the HH~1 bow shock and of the brighter condensations of HH~2. These ridges have H$\alpha$/H$\beta=4\to 6$, which is consistent with collisional excitation from the $n=1$ to the $n=3$ and 4 levels of hydrogen in a gas of temperatures $T=1.5\to 10\times 10^4$~K. This is therefore the first direct proof that the collisional excitation/ionization region of hydrogen right behind Herbig-Haro shock fronts is detected.