Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection
Authors: name: Subhajit Maity; name: Ayan Kumar Bhunia; name: Subhadeep Koley; name: Pinaki Nath Chowdhury; name: Aneeshan Sain; name: Yi-Zhe Song
Published: 2025-07-10 17:59:49

Abstract: Keypoint detection, integral to modern machine perception, faces challenges
in few-shot learning, particularly when source data from the same distribution
as the query is unavailable. This gap is addressed by leveraging sketches, a
popular form of human expression, providing a source-free alternative. However,
challenges arise in mastering cross-modal embeddings and handling user-specific
sketch styles. Our proposed framework overcomes these hurdles with a
prototypical setup, combined with a grid-based locator and prototypical domain
adaptation. We also demonstrate success in few-shot convergence across novel
keypoints and classes through extensive experiments.