Artistic Style Transfer for Videos

From Manuel Ruder, Alexey Dosovitskiy, Thomas Brox of the University of Freiburg:

In the past, manually re-drawing an image in a certain artistic style required a professional artist and a long time. Doing this for a video sequence single-handed was beyond imagination. Nowadays computers provide new possibilities. We present an approach that transfers the style from one image (for example, a painting) to a whole video sequence. We make use of recent advances in style transfer in still images and propose new initializations and loss functions applicable to videos. This allows us to generate consistent and stable stylized video sequences, even in cases with large motion and strong occlusion. We show that the proposed method clearly outperforms simpler baselines both qualitatively and quantitatively... (pdf paper)

 

Featured Product

Boston Dynamics Webinar - Why Humanoids Are the Future of Manufacturing

Boston Dynamics Webinar - Why Humanoids Are the Future of Manufacturing

Join us November 18th for this Webinar as we reflect on what we've learned by observing factory floors, and why we've grown convinced that chasing generalization in manipulation—both in hardware and behavior—isn't just interesting, but necessary. We'll discuss AI research threads we're exploring at Boston Dynamics to push this mission forward, and highlight opportunities our field should collectively invest more in to turn the humanoid vision, and the reinvention of manufacturing, into a practical, economically viable product.