University of Cambridge > Talks.cam > Artificial Intelligence Research Group Talks (Computer Laboratory) > Constraining Variational Inference with Geometric Jensen-Shannon Divergence

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Constraining Variational Inference with Geometric Jensen-Shannon Divergence

Download to your calendar using vCal

If you have a question about this talk, please contact Mateja Jamnik .

Join us on Zoom

We examine the problem of controlling divergences for latent space regularisation in variational autoencoders. Specifically, when aiming to reconstruct example x∈ℝm via latent space z∈ℝn (n≤m), while balancing this against the need for generalisable latent representations. We present a regularisation mechanism based on the skew geometric-Jensen-Shannon divergence (JSGα). We find a variation in JSG α, motivated by limiting cases, which leads to an intuitive interpolation between forward and reverse KL in the space of both distributions and divergences. We motivate its potential benefits for VAEs through low-dimensional examples, before presenting quantitative and qualitative results. Our experiments demonstrate that skewing our variant of JSG α, in the context of JSG α-VAEs, leads to better reconstruction and generation when compared to several baseline VAEs. Our approach is entirely unsupervised and utilises only one hyperparameter which can be easily interpreted in latent space.

This talk is part of the Artificial Intelligence Research Group Talks (Computer Laboratory) series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Average on weekdays: 8930.00454545 kWh 17 Mill Lane, Seminar Room G Clinical School, Seminar Room 19

Other talks

CUSCRS and Renal Medicine Argentina 2005 The Imagined Conflict: On Science and God TBC Title to be confirmed Title TBC
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity