Face2Face: Real-time Face Capture and Reenactment of RGB Videos

From Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt and Matthias Nießner:

We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination... (full paper)

 

Comments (0)

This post does not have any comments. Be the first to leave a comment below.


Post A Comment

You must be logged in before you can post a comment. Login now.

Featured Product

ATI Industrial Automation at IMTS 2018

ATI Industrial Automation at IMTS 2018

ATI Industrial Automation's MC-10 Manual Tool Changer provides a cost-effective solution for quickly changing tools by hand. Its compact yet robust design is optimized for collaborative robot applications. The ergonomic twist-collar locking mechanism ensures a secure attachment of the tool and easy manual operation with tactile feedback. This Manual Tool Changer can carry payloads of up to 22 lbs and includes multiple fail-safe features that resist vibration and prevent loosening. The MC-10 Manual Tool Changer has integrated air pass-through connections and options to connect electrical utilities if needed. ATI will feature the new MC-10 along with a variety of other robotic demonstrations and product displays at this year's IMTS show in Chicago (Booth #236417).