University of Cambridge > Talks.cam > Machine Learning Journal Club > A Hierarchical Bayesian Language Model based on Pitman-Yor Processes

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

A Hierarchical Bayesian Language Model based on Pitman-Yor Processes

Download to your calendar using vCal

If you have a question about this talk, please contact Hanna Wallach .

Paper (also Tech. report)

We propose a new hierarchical Bayesian n-gram model of natural languages. Our model makes use of a generalization of the commonly used Dirichlet distributions called Pitman-Yor processes which produce power-law distributions more closely resembling those in natural languages. We show that an approximation to the hierarchical Pitman-Yor language model recovers the exact formulation of interpolated Kneser-Ney, one of the best smoothing methods for n-gram language models. Experiments verify that our model gives cross entropy results superior to interpolated Kneser-Ney and comparable to modified Kneser-Ney.

This talk is part of the Machine Learning Journal Club series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Lecture room 4, Engineering Department Herchel Smith Building for Brain and Mind Sciences, Forvie Site, Addenbrooke’s zoom-- Contact organiser for the link

Other talks

Title to be confirmed Group Work Title to be confirmed The organisational management of traumatic stress Title TBC Title to be confirmed
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity