Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
DmitryRyuminΒ 
posted an update 18 days ago
Post
1315
πŸš€πŸŽ­πŸŒŸ New Research Alert - CVPR 2024 (Avatars Collection)! πŸŒŸπŸŽ­πŸš€
πŸ“„ Title: EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars πŸ”

πŸ“ Description: EMOPortraits is an enhanced multimodal one-shot head avatar model that achieves SOTA performance in emotion transfer and audio-driven facial animation tasks by improving the training pipeline and architecture to better handle intense and asymmetric facial expressions, while also proposing a novel multiview video dataset containing a wide range of such expressions.

πŸ‘₯ Authors: Nikita Drobyshev, Antoni Bigata Casademunt, Konstantinos Vougioukas, Zoe Landgraf, Stavros Petridis, and Maja Pantic

πŸ“… Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA πŸ‡ΊπŸ‡Έ

πŸ“„ Paper: EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars (2404.19110)

🌐 GitHub Page: https://neeek2303.github.io/EMOPortraits

πŸ“š More Papers: more cutting-edge research presented at other conferences in the DmitryRyumin/NewEraAI-Papers curated by @DmitryRyumin

πŸš€ Added to the Avatars Collection: DmitryRyumin/avatars-65df37cdf81fec13d4dbac36

πŸ” Keywords: #EMOPortraits #EmotionalTransfer #FacialAnimation #HeadAvatar #MultimodalLearning #OneShotLearning #AsymmetricFacialExpressions #IntenseFacialExpressions #NovelDataset #CVPR2024 #DeepLearning #ComputerVision #Innovation

Interesting.
Awesome.
How can we use this?

Β·

The authors plan to release the Dataset itself in June and the code in July, apparently during CVPR.