Face2Face: Real-time Face Capture and Reenactment of RGB Videos

From Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt and Matthias Nießner: We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination... (full paper)  

Records 1 to 1 of 1

Featured Product

SCHUNK's New Safety Gripping System EGN

SCHUNK's New Safety Gripping System EGN

With the SLS, SOS, and STO functionalities, the SCHUNK EGN gripping system certified in accordance with DIN EN ISO 13849 enables safe human/machine collaboration. If the production process is interrupted by an emergency shut-off, the SCHUNK EGN goes into either a safely limited speed mode or a safe stop mode depending on the activated protection zone. In contrast to other solutions available on the market, the SCHUNK safety gripping system is continuously powered even in the safe operating stop so that the gripped parts are reliably held even without mechanical maintenance of gripping force. As soon as the protection zone is released, the gripper immediately switches back to the regular operating mode without the system having to be restarted.