Face2Face: Real-time Face Capture and Reenactment of RGB Videos

From Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt and Matthias Nießner: We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination... (full paper)  

Records 1 to 1 of 1

Featured Product

WIND RIVER - ROS 2 for VxWorks

WIND RIVER - ROS 2 for VxWorks

Develop new robotic capabilities with ROS 2 for VxWorks. ROS 2 for VxWorks® project provides custom modifications and build scripts to integrate the Robot Operating System 2 (ROS 2) framework with VxWorks 7. ROS 2 is a set of software libraries and tools that aid in building robot applications. Build ROS 2 for VxWorks using 1) with a VxWorks SDK that is available on the site under a free non-commercial use license; or via 2) with a commercially-licensed VxWorks product.