Face2Face: Real-Time Facial Reenactment
In computer animation, animating human faces is an art itself, but transferring expressions from one human to someone else is an even more complex task. One has to take into consideration the geometry, the reflectance properties, pose, and the illumination of both faces, and make sure that mouth movements and wrinkles are transferred properly. The fact that the human eye is very keen on catching artificial changes makes the problem even more difficult. This paper describes a real-time solution to this animation problem.

______________________

The paper "Face2Face: Real-time Face Capture and Reenactment of RGB Videos" is available here:
http://www.graphics.stanford.edu/~niessner/thies2016face.html

Recommended for you:
Real-Time Facial Expression Transfer (previous work) - https://www.youtube.com/watch?v=mkI6qfpEJmI

WE WOULD LIKE TO THANK OUR GENEROUS SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
Sunil Kim, Vinay S.
https://www.patreon.com/TwoMinutePapers

Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz

The background of the thumbnail image was created by DonkeyHotey (CC BY 2.0) - https://flic.kr/p/aPiKLe
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/

#Deepfake #Face2Face
 Dear Fellow Scholars, this is two-minute papers with Karo Zsolnai-Fehir. There was a previous episode on a technique where the inputs were a source video of ourselves and a target actor, and the output was a video of this target actor with our facial gestures. With such an algorithm, one can edit pre-recorded videos in real time, and the current version only needs a consumer webcam to do that. This new version addresses two major shortcomings. One, the previous work relied on depth information, which means that we needed to know how far different parts of the image were from the camera. This newer version only relies on color information and does not need anything beyond that. Whoa! And two, previous techniques often resulted to copying the footage from the mouth and adding synthetic proxies for teeth, not anymore with this one. A tip my hat to the authors who came up with a vastly improved version of their previous method so quickly, and it is probably needless to say that the ramifications of such an existing technique are far reaching, and are hopefully pointed in a positive direction. However, we should bear in mind that from now on, we may be one step closer to an era where a video of something happening won't be taken as proper evidence. I wonder how this will affect legal decision-making in the future. Thanks for watching and for your generous support, and I'll see you next time.
[{"start": 0.0, "end": 4.38, "text": " Dear Fellow Scholars, this is two-minute papers with Karo Zsolnai-Fehir."}, {"start": 4.38, "end": 9.76, "text": " There was a previous episode on a technique where the inputs were a source video of ourselves"}, {"start": 9.76, "end": 16.240000000000002, "text": " and a target actor, and the output was a video of this target actor with our facial gestures."}, {"start": 16.240000000000002, "end": 20.96, "text": " With such an algorithm, one can edit pre-recorded videos in real time,"}, {"start": 20.96, "end": 24.6, "text": " and the current version only needs a consumer webcam to do that."}, {"start": 24.6, "end": 27.96, "text": " This new version addresses two major shortcomings."}, {"start": 27.96, "end": 31.560000000000002, "text": " One, the previous work relied on depth information,"}, {"start": 31.560000000000002, "end": 36.88, "text": " which means that we needed to know how far different parts of the image were from the camera."}, {"start": 36.88, "end": 42.760000000000005, "text": " This newer version only relies on color information and does not need anything beyond that."}, {"start": 42.760000000000005, "end": 44.2, "text": " Whoa!"}, {"start": 44.2, "end": 49.28, "text": " And two, previous techniques often resulted to copying the footage from the mouth"}, {"start": 49.28, "end": 53.96, "text": " and adding synthetic proxies for teeth, not anymore with this one."}, {"start": 53.96, "end": 60.76, "text": " A tip my hat to the authors who came up with a vastly improved version of their previous method so quickly,"}, {"start": 60.76, "end": 66.96000000000001, "text": " and it is probably needless to say that the ramifications of such an existing technique are far reaching,"}, {"start": 66.96000000000001, "end": 69.76, "text": " and are hopefully pointed in a positive direction."}, {"start": 69.76, "end": 75.4, "text": " However, we should bear in mind that from now on, we may be one step closer to an era"}, {"start": 75.4, "end": 79.28, "text": " where a video of something happening won't be taken as proper evidence."}, {"start": 79.28, "end": 82.96000000000001, "text": " I wonder how this will affect legal decision-making in the future."}, {"start": 82.96, "end": 87.55999999999999, "text": " Thanks for watching and for your generous support, and I'll see you next time."}]