Statistical Risk Characterization of Penalized Likelihood Procedures: An Information-Theoretic Determination
- đ¤ Speaker: Andrew Barron, Yale University
- đ Date & Time: Friday 15 November 2013, 14:30 - 15:30
- đ Venue: MR12, Centre for Mathematical Sciences, Wilberforce Road, Cambridge
Abstract
We review theory for the Minimum Description Length principle, penalized likelihood and its statistical risk. An information theoretic condition on a penalty pen(f) yields the conclusion that the optimizer of the penalized log likelihood criterion log 1/likelihood(f) + pen(f) has risk not more than the index of resolvability, corresponding to the accuracy of the optimizer of the expected value of the criterion. For the linear span of a dictionary of candidate terms, we develop the information theoretic validity of penalties based on the l_1 norm of the coefficients in regression and log-density estimation settings. New results are presented for Gaussian graphical models. This represents joint work with Xi Luo and Sabyasachi Chatterjee.
Series This talk is part of the Statistics series.
Included in Lists
- All CMS events
- All Talks (aka the CURE list)
- bld31
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Chris Davis' list
- CMS Events
- custom
- DPMMS info aggregator
- DPMMS lists
- DPMMS Lists
- Guy Emerson's list
- Hanchen DaDaDash
- Interested Talks
- Machine Learning
- MR12, Centre for Mathematical Sciences, Wilberforce Road, Cambridge
- rp587
- School of Physical Sciences
- Statistical Laboratory info aggregator
- Statistics
- Statistics Group
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Andrew Barron, Yale University
Friday 15 November 2013, 14:30-15:30