ShantanuT01/DACTYL-Pretraining huggingface dataset:
We present Multi-view Pose transformer (MvP) for estimating multi-person 3D poses from multi-view images. Instead of estimating 3D joint locations from costly volumetric representation or reconstructing the per-person 3D pose from multiple detected 2D poses as in previous methods, MvP directly regresses the multi-person 3D poses in a clean and efficient way, without relying on intermediate tasks. Specifically, MvP represents skeleton joints as learnable query embeddings and let them progressively attend to and reason over the multi-view information from the input images to directly regress the actual 3D joint locations. To improve the accuracy of such a simple pipeline, MvP presents a hierarchical scheme to concisely represent query embeddings of multi-person skeleton joints and introduces an input-dependent query adaptation approach. Further, MvP designs a novel geometrically guided attention mechanism, called projective attention, to more precisely fuse the cross-view information for each joint. MvP also introduces a RayConv operation to integrate the view-dependent camera geometry into the feature representations for augmenting the projective attention. We show experimentally that our MvP model outperforms the state-of-the-art methods on several benchmarks while being much more efficient. Notably, it achieves 92.3% AP25 on the challenging Panoptic dataset, improving upon the previous best approach [36] by 9.8%. MvP is general and also extendable to recovering human mesh represented by the SMPL model, thus useful for modeling multi-person body shapes. Code and models are available at https://github.com/sail-sg/mvp.
Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems are running in non-stationary and continually changing environments where the target domain distribution can change over time. Existing methods, which are mostly based on self-training and entropy regularization, can suffer from these non-stationary environments. Due to the distribution shift over time in the target domain, pseudo-labels become unreliable. The noisy pseudo-labels can further lead to error accumulation and catastrophic forgetting. To tackle these issues, we propose a continual test-time adaptation approach~(CoTTA) which comprises two parts. Firstly, we propose to reduce the error accumulation by using weight-averaged and augmentation-averaged predictions which are often more accurate. On the other hand, to avoid catastrophic forgetting, we propose to stochastically restore a small part of the neurons to the source pre-trained weights during each iteration to help preserve source knowledge in the long-term. The proposed method enables the long-term adaptation for all parameters in the network. CoTTA is easy to implement and can be readily incorporated in off-the-shelf pre-trained models. We demonstrate the effectiveness of our approach on four classification tasks and a segmentation task for continual test-time adaptation, on which we outperform existing methods. Our code is available at \url{https://qin.ee/cotta}.
Coupled mechanical oscillations were first observed in paired pendulum clocks in the mid-seventeenth century and were extensively studied for their novel sympathetic oscillation dynamics. In this era of nanotechnologies, coupled oscillations have again emerged as subjects of interest when realized in nanomechanical resonators for both practical applications and fundamental studies. However, a key obstacle to the further development of this architecture is the ability to coherently manipulate the coupled oscillations. This limitation arises as a consequence of the usually weak coupling between the constituent nanomechanical elements. Here, we report parametrically coupled mechanical resonators in which the coupling strength can be dynamically adjusted by modulating (pumping) the stress in the mechanical elements via a piezoelectric transducer. The parametric control enables the coupling rate between the two resonators to be made so strong that it exceeds their intrinsic energy dissipation rate by more than a factor of four. This ultra-strong coupling can be exploited to coherently transfer phonon populations, namely phonon Rabi oscillations, between the resonators via two coupled vibration modes, realizing superposition states of the two modes and their time-domain control. More unexpectedly, the nature of the parametric coupling can also be tuned from a linear first-order interaction to a non-linear higher-order process in which more than one pump phonon mediates the coherent oscillations. This demonstration of multi-pump phonon mixing echoes multi-wave photon mixing and suggests that concepts from non-linear optics can also be applied to mechanical systems. Ultimately, the parametric pumping is not only useful for controlling classical oscillations but can also be extended to the quantum regime, opening up the prospect of entangling two distinct macroscopic mechanical objects.
We study the Hilbert scheme (Hilb V) of smooth connected curves on a smooth del Pezzo 3-fold V. We prove that every degenerate curve C, i.e. every curve contained in a smooth hyperplane section S of V, does not deform to a non-degenerate curve if the following two conditions are satisfied: (i) the Euler characteristic of the twisted ideal sheaf I_C(S) of C is greater than or equal to one, and (ii) for every line E on S which is disjoint to C, the normal bundle of E in V is trivial. As a consequence, we prove an analogue (for Hilb V) of a conjecture of J.O.Kleppe which is concerned with non-reduced components of the Hilbert scheme (Hilb P^3) of curves in the 3-dimensional projective space P^3.
Solar active regions (ARs) are the major sources of two kinds of the most violent solar eruptions, namely flares and coronal mass ejections (CMEs). The largest AR in the past 24 years, NOAA AR 12192, crossed the visible disk from 2014 October 17 to 30, unusually produced more than one hundred flares, including 32 M-class and 6 X-class ones, but only one small CME. Flares and CMEs are believed to be two phenomena in the same eruptive process. Why is such a flare-rich AR so CME-poor? We compared this AR with other four ARs; two were productive in both and two were inert. The investigation of the photospheric parameters based on the SDO/HMI vector magnetogram reveals that the flare-rich AR 12192, as the other two productive ARs, has larger magnetic flux, current and free magnetic energy than the two inert ARs, but contrast to the two productive ARs, it has no strong, concentrated current helicity along both sides of the flaring neutral line, indicating the absence of a mature magnetic structure consisting of highly sheared or twisted field lines. Furthermore, the decay index above the AR 12192 is relatively low, showing strong constraint. These results suggest that productive ARs are always large and have enough current and free energy to power flares, but whether or not a flare is accompanied by a CME is seemingly related to (1) if there is mature sheared or twisted core field serving as the seed of the CME, (2) if the constraint of the overlying arcades is weak enough.
We estimate the electron density, n_e, and its spatial variation in quiescent prominences from the observed emission ratio of the resonance lines Na I 5890 (D2) and Sr II 4078. For a bright prominence (tau_alpha ~ 25) we obtain a mean n_e ~ 2*10^10 /cm^3; for a faint one (tau_alpha ~ 4) n_e ~ 4*10^10 /cm^3 on two consecutive days with moderate internal fluctuation and no systematic variation with height above the solar limb. The thermal and non-thermal contributions to the line broadening, T_kin and V_nth, required to deduce n_e from the emission ratio NaI/SrII cannot be unambiguously determined from observed widths of lines from atoms of different mass. The reduced widths, Delta-lambda_D / lambda_0, of Sr II 4078 show an excess over those from NaD2 and H-delta, assuming the same T_kin and V_nth. We attribute this excess broadening to higher non-thermal broadening induced by interaction of ions with the prominence magnetic field. This is suggested by the finding of higher macro-shifts of SrII4078 as compared to those from NaD2.
While the tangent space to an equisingular family of curves can be discribed by the sections of a twisted ideal sheaf, this is no longer true if we only prescribe the multiplicity which a singular point should have. However, it is still possible to compute the dimension of the tangent space with the aid of the equimulitplicity ideal. In this note we consider families L_m={(C,p) | mult_p(C)=m} with C in some linear system |L| on a smooth projective surface S and for a fixed positive integer m, and we compute the dimension of the tangent space to L_m at a point (C,p) depending on whether p is a unitangential singular point of C or not. We deduce that the expected dimension of L_m at (C,p) in any case is just dim|L|+2-m*(m+1)/2. The result is used in the study of triple-point defective surfaces in some joint papers with Luca Chiantini.
We study the Josephson effect in a quantum spin Hall system coupled to a localized magnetic impurity. As a consequence of the fermion parity anomaly, the spin of the combined system of impurity and spin-Hall edge alternates between half-integer and integer values when the superconducting phase difference across the junction advances by $2\pi$. This leads to characteristic differences in the splittings of the spin multiplets by exchange coupling and single-ion anisotropy at phase differences, for which time-reserval symmetry is preserved. We discuss the resulting $8\pi$-periodic (or $\mathbb{Z}_4$) fractional Josephson effect in the context of recent experiments.
Thick disks are faint and extended stellar components found around several disk galaxies including our Milky Way. The Milky Way thick disk, the only one studied in detail, contains mostly old disk stars (~10 Gyr), so that thick disks are likely to trace the early stages of disk evolution. Previous detections of thick disk stellar light in external galaxies have been originally made for early-type, edge-on galaxies but detailed 2D thick/thin disk decompositions have been reported for only a scant handful of mostly late-type disk galaxies. We present in this paper for the first time explicit 3D thick/thin disk decompositions characterising the presence and properties (eg scalelength and scaleheight) for a sample of eight lenticular galaxies by fitting 3D disk models to the data. For six out of the eight galaxies we were able to derive a consistent thin/thick disk model. The mean scaleheight of the thick disk is 3.6 times larger than that of the thin disk. The scalelength of the thick disk is about twice, and its central luminosity density between 3-10% of, the thin disk value. Both thin and thick disk are truncated at similar radii. This implies that thick disks extend over fewer scalelengths than thin disks, and turning a thin disk into a thick one requires therefore vertical but little radial heating. All these structural parameters are similar to thick disk parameters for later Hubble-type galaxies previously studied. We discuss our data in respect to present models for the origin of thick disks, either as pre- or post-thin-disk structures, providing new observational constraints.
On the set of dissipative solutions to the multi-dimensional isentropic Euler equations we introduce a quasi-order by comparing the acceleration at all times. This quasi-order is continuous with respect to a suitable notion of convergence of dissipative solutions. We establish the existence of minimal elements. Minimizing the acceleration amounts to selecting dissipative solutions that are as close to being a weak solution as possible.
As true as it is that a bricklayer needs a plumb line and a T-square, so it is that a physicist using general relativity needs how to draw geodesics and use fields of congruent vector frames of reference. While the first part of the preceding statement depends on the Christoffel connection and related metric and curvature concepts, the second part depends on the Weitzenb\"{o}ck connection and the concept of torsion. This dual structure has been considered before as a possibility of using either one of them to describe General relativity. We claim here that both structures have to be correlated to produce useful interpretations of any space-time model.
We report the first observation of above-threshold maser oscillation in a whispering-gallery(WG)-mode resonator, whose quasi-transverse-magnetic, 17th azimuthal-order WG mode, at a frequency of approx. 12.038 GHz, with a loaded Q of several hundred million, is supported on a cylinder of mono-crystalline sapphire. An electron spin resonance (ESR) associated with Fe3+ ions, that are substitutively included within the sapphire at a concentration of a few parts per billion, coincides in frequency with that of the (considerably narrower) WG mode. By applying a c.w. `pump' to the resonator at a frequency of approx. 31.34 GHz, with no applied d.c. magnetic field, the WG (`signal') mode is energized through a three-level maser scheme. Preliminary measurements demonstrate a frequency stability (Allan deviation) of a few times 1e-14 for sampling intervals up to 100 s.
Magnetic properties of stechiometric YTiO3 has been calculated within the single-ion-based paradigm taking into account the low-symmetry crystal field and the intra-atomic spin-orbit coupling of the Ti3+ ion. Despite of the very simplified approach the calculations reproduce perfectly the value of the magnetic moment and its direction as well as temperature dependence of the magnetic susceptibility chi(T). It turns out that the spin-orbit coupling is fundamentally important for 3d magnetism and magnetic properties are determined by lattice distortions.
In this paper, we tackle a fully unsupervised super-resolution problem, i.e., neither paired images nor ground truth HR images. We assume that low resolution (LR) images are relatively easy to collect compared to high resolution (HR) images. By allowing multiple LR images, we build a set of pseudo pairs by denoising and downsampling LR images and cast the original unsupervised problem into a supervised learning problem but in one level lower. Though this line of study is easy to think of and thus should have been investigated prior to any complicated unsupervised methods, surprisingly, there are currently none. Even more, we show that this simple method outperforms the state-of-the-art unsupervised method with a dramatically shorter latency at runtime, and significantly reduces the gap to the HR supervised models. We submitted our method in NTIRE 2020 super-resolution challenge and won 1st in PSNR, 2nd in SSIM, and 13th in LPIPS. This simple method should be used as the baseline to beat in the future, especially when multiple LR images are allowed during the training phase. However, even in the zero-shot condition, we argue that this method can serve as a useful baseline to see the gap between supervised and unsupervised frameworks.
We performed a detailed comparison between predicted He burning phases and multiband photometry of the Carina dwarf spheroidal galaxy. We found a good agreement with the predictions computed assuming an {\alpha}-enhanced chemical mixture, indicating a mean metallicity [Fe/H] ~ -1.8 with a raw observed peak-to-peak spread in iron abundance of 0.4\pm0.2 dex.
We give necessary and sufficient conditions for the existence of weak solutions of a parabolic problem corresponding to the Kolmogorov operators perturbed by a multipolar inverse square potential with respect to the Gaussian probability measure which is the unique invariant measure for Ornstein-Uhlenbeck type operators. We state the optimality of the constant and, then, the nonexistence of positive exponentially bounded solutions to the parabolic problem.
Image segmentation is the process of partitioning an image into a set of meaningful regions according to some criteria. Hierarchical segmentation has emerged as a major trend in this regard as it favors the emergence of important regions at different scales. On the other hand, many methods allow us to have prior information on the position of structures of interest in the images. In this paper, we present a versatile hierarchical segmentation method that takes into account any prior spatial information and outputs a hierarchical segmentation that emphasizes the contours or regions of interest while preserving the important structures in the image. Several applications are presented that illustrate the method versatility and efficiency.
I discuss the Boltzmann-Penrose question of why the initial conditions for cosmology have low entropy. The modern version of Boltzmann's answer to this question, due to Dyson, Kleban and Susskind, seems to imply that the typical intelligent observer arises through thermal fluctuation, rather than cosmology and evolution. I investigate whether this can be resolved within the string landscape. I end with a review of the suggestion that Holographic Cosmology provides a simpler answer to the problem. This paper is a revision of unpublished work from the spring of 2006, combined with my talk at the Madrid conference on String theory and Cosmology, Nov 2006.
We investigate $\mathbb{Q}$-ranks of the elliptic curve $E_t$: $y^2+txy=x^3+tx^2-x+1$ where $t$ is a rational parameter. We prove that for infinitely many values of $t$ the rank of $E_t(\mathbb{Q})$ is at least 4.
We propose a physical interpretation of our novel fermionic solution for the IKKT matrix model which obtained in our previous paper hep-th/0307236. We extend the configuration space of bosonic field to supernumbers space and obtain the noncommutative parameter which is not bi-grassmann but an ordinary number. This establishes the connection between Seiberg's noncommutative superspace and our solution of the IKKT matrix model.
Given a quasi-projective variety X with only Kawamata log terminal singularities, we study the obstructions to extending finite \'etale covers from the smooth locus $X_{\mathrm{reg}}$ of $X$ to $X$ itself. A simplified version of our main results states that there exists a Galois cover $Y \rightarrow X$, ramified only over the singularities of $X$, such that the \'etale fundamental groups of $Y$ and of $Y_{\mathrm{reg}}$ agree. In particular, every \'etale cover of $Y_{\mathrm{reg}}$ extends to an \'etale cover of $Y$.   As first major application, we show that every flat holomorphic bundle defined on $Y_{\mathrm{reg}}$ extends to a flat bundle that is defined on all of $Y$. As a consequence, we generalise a classical result of Yau to the singular case: every variety with at worst terminal singularities and with vanishing first and second Chern class is a finite quotient of an Abelian variety. As a further application, we verify a conjecture of Nakayama and Zhang describing the structure of varieties that admit polarised endomorphisms.
We calculate the bulk contribution for the doubly degenerated largest eigenvalue of the transfer matrix of the eight vertex model with an odd number of lattice sites N in the disordered regime using the generic equation for roots proposed by Fabricius and McCoy. We show as expected that in the thermodynamic limit the result coincides with the one in the N even case.
We consider various possibilities for generating neutrino masses in supersymmetric models with an additional U(1)' gauge symmetry. One class of models involves two extra U(1)' x U(1)'' gauge symmetries, with U(1)'' breaking at an intermediate scale and yielding small Dirac masses through high-dimensional operators. The right-handed neutrinos N^c_i can naturally decouple from the low energy U(1)', avoiding cosmological constraints. A variant version can generate large Majorana masses for N^c_i and an ordinary see-saw. We secondly consider models with a pair of heavy triplets which couple to left-handed neutrinos. After integrating out the heavy triplets, a small neutrino Majorana mass matrix can be generated by the induced non-renormalizable terms. We also study models involving the double-see-saw mechanism, in which heavy Majorana masses for N^c_i are associated with the TeV-scale of U(1)' breaking. We give the conditions to avoid runaway directions in such models and discuss simple patterns for neutrino masses.
Bevan established that the growth rate of a monotone grid class of permutations is equal to the square of the spectral radius of a related bipartite graph. We give an elementary and self-contained proof of a generalization of this result using only Stirling's Formula, the method of Lagrange multipliers, and the singular value decomposition of matrices.
Focusing on the efficient probe and manipulation of single-particle spin states, we investigate the coupled spin and orbital dynamics of a spin 1/2 particle in a harmonic potential subject to ultrastrong spin-orbit interaction and external magnetic field. The advantage of these systems is the clear visualization of the strong spin-orbit coupling in the orbital dynamics. We also investigate the effect of a time-dependent coupling: Its nonadiabatic change causes an interesting interplay of spin and orbital motion which is related to the direction and magnitude of the applied magnetic field. This result suggests that orbital state manipulation can be realized through ultrastrong spin-orbit interactions, becoming a useful tool for handling entangled spin and orbital degrees of freedom to produce, for example, spin desirable polarizations in time interesting for spintronics implementations.
We present all-sky modelling of the high resolution Planck, IRAS, and WISE infrared (IR) observations using the physical dust model presented by Draine and Li in 2007 (DL). We study the performance and results of this model, and discuss implications for future dust modelling. The present work extends the DL dust modelling carried out on nearby galaxies using Herschel and Spitzer data to Galactic dust emission. We employ the DL dust model to generate maps of the dust mass surface density, the optical extinction Av, and the starlight intensity parametrized by Umin. The DL model reproduces the observed spectral energy distribution (SED) satisfactorily over most of the sky, with small deviations in the inner Galactic disk and in low ecliptic latitude areas. We compare the DL optical extinction Av for the diffuse interstellar medium with optical estimates for 2 10^5 quasi-stellar objects (QSOs) observed in the Sloan digital sky survey. The DL Av estimates are larger than those determined towards QSOs by a factor of about 2, which depends on Umin. The DL fitting parameter Umin, effectively determined by the wavelength where the SED peaks, appears to trace variations in the far-IR opacity of the dust grains per unit Av, and not only in the starlight intensity. To circumvent the model deficiency, we propose an empirical renormalization of the DL Av estimate, dependent of Umin, which compensates for the systematic differences found with QSO observations. This renormalization also brings into agreement the DL Av estimates with those derived for molecular clouds from the near-IR colours of stars in the 2 micron all sky survey. The DL model and the QSOs data are used to compress the spectral information in the Planck and IRAS observations for the diffuse ISM to a family of 20 SEDs normalized per Av, parameterized by Umin, which may be used to test and empirically calibrate dust models.