University of Cambridge > Talks.cam > Rainbow Group Seminars > Enhancing Video Generation with Explicit 3D Guidance for Accurate Motion Simulation

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Enhancing Video Generation with Explicit 3D Guidance for Accurate Motion Simulation

Download to your calendar using vCal

If you have a question about this talk, please contact Rafal Mantiuk .

Video generation is currently a highly popular task. However, common video generation models rely solely on large-scale data training to implicitly simulate motion, which can sometimes result in inaccuracies. To address this problem, we propose utilizing explicit 3D guidance to guide the video generation process. Given a single image and the user’s motion demands, we model the object and motion in 3D, allowing for rendering from various viewpoints. Subsequently, we inject the motion prior from these rendered views into the video generation model in producing high-quality videos with the desired motion.

Zoom link: https://cam-ac-uk.zoom.us/j/89792055791?pwd=OTYyQXdnUXZMcnU4VmZWL2p4dUhZdz09

This talk is part of the Rainbow Group Seminars series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Cambridge Picturehouse Cinema, St Andrew's Street, Cambridge Harrods Room, Emmanuel College, St Andrew’s Street, Cambridge CB2 3AP FW11, Computer Laboratory, William Gates Building

Other talks

Max Perutz Lecture - Title TBC Talk TBC Using numerical simulations for solving spectral geometry problems Title TBC Group Work Decoding genomic chaos - a pancancer compendium of chromosomal instability
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity