3D Motion Magnification: Visualizing Subtle Motions with Time Varying
  Radiance Fields
Authors: name: Brandon Y. Feng; name: Hadi Alzayer; name: Michael Rubinstein; name: William T. Freeman; name: Jia-Bin Huang
Published: 2023-08-07 17:59:59

Abstract: Motion magnification helps us visualize subtle, imperceptible motion.
However, prior methods only work for 2D videos captured with a fixed camera. We
present a 3D motion magnification method that can magnify subtle motions from
scenes captured by a moving camera, while supporting novel view rendering. We
represent the scene with time-varying radiance fields and leverage the Eulerian
principle for motion magnification to extract and amplify the variation of the
embedding of a fixed point over time. We study and validate our proposed
principle for 3D motion magnification using both implicit and tri-plane-based
radiance fields as our underlying 3D scene representation. We evaluate the
effectiveness of our method on both synthetic and real-world scenes captured
under various camera setups.