University of Cambridge > Talks.cam > Machine Learning @ CUED > Rotation Invariant Householder Parameterization for Bayesian PCA

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Rotation Invariant Householder Parameterization for Bayesian PCA

Download to your calendar using vCal

If you have a question about this talk, please contact Robert Peharz .

We consider probabilistic PCA and related factor models from a Bayesian perspective. These models are in general not identifiable as the likelihood has a rotational symmetry. This gives rise to complicated posterior distributions with continuous subspaces of equal density and thus hinders efficiency of inference as well as interpretation of obtained parameters. In particular, posterior averages over factor loadings become meaningless and only model predictions are unambiguous. In our paper, we propose a parameterization based on Householder transformations, which remove the rotational symmetry of the posterior. Furthermore, by relying on results from random matrix theory, we establish the parameter distribution which leaves the model unchanged compared to the original rotationally symmetric formulation. In particular, we avoid the need to compute the Jacobian determinant of the parameter transformation. This allows us to efficiently implement probabilistic PCA in a rotation invariant fashion in any state of the art toolbox. We implemented our model in the probabilistic programming language Stan and illustrate it on several examples.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Webinar & FW11, Computer Laboratory, William Gates Building. Autism Genetics Centre for Mathematical Sciences, Meeting Room 5 (centre building, basement)

Other talks

Teams Announced Non-stationarity in structural dynamics, challenges and implications for modelling and structural health monitoring Cambridge RNA Club - ONLINE title abstract tba Quantum graphs with a time asymmetry: spectral optimization and spectral statistics Title and abstract tba
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity