Virtual Immortality: Reanimating characters from TV shows

From James Charles, Derek Magee, David Hogg:

The objective of this work is to build virtual talking avatars of characters fully automatically from TV shows. From this unconstrained data, we show how to capture a character’s style of speech, visual appearance and language in an effort to construct an interactive avatar of the person and effectively immortalize them in a computational model. We make three contributions (i) a complete framework for producing a generative model of the audiovisual and language of characters from TV shows; (ii) a novel method for aligning transcripts to video using the audio; and (iii) a fast audio segmentation system for silencing nonspoken audio from TV shows. Our framework is demonstrated using all 236 episodes from the TV series Friends (≈ 97hrs of video) and shown to generate novel sentences as well as character specific speech and video... (full paper) 

Featured Product

Nion: Next-level time-of-flight

Nion: Next-level time-of-flight

The new Nion 3D camera advances Time-of-Flight (ToF) technology with exceptional resolution, speed, and industrial robustness. Designed for demanding applications such as logistics, warehousing, industrial automation, and robotics, Nion delivers high-resolution depth data with real-time performance for faster, safer, and more flexible operations. At its core is the 1.2-megapixel Time-of-Flight sensor AF0130 from onsemi's Hyperlux ID family, offering up to four times the resolution of conventional VGA-based ToF cameras and significantly higher data density. Active 940-nm laser illumination ensures accurate and stable measurements in low-light conditions, artificial lighting, and even direct sunlight. With an IP67-rated housing, Nion is built for reliable operation in dusty, wet, and thermally challenging industrial environments. A user-friendly API with IDS peak support and compliance with the GigE Vision standard enable fast integration and flexible deployment in high-resolution 3D applications. The Nion 3D camera is now available from IDS Imaging Development Systems.