Sharp convergence guarantees for iterative (non)-convex empirical risk minimization with random data
- 👤 Speaker: Dr. Kabir Verchand, University of Cambridge 🔗 Website
- 📅 Date & Time: Wednesday 11 October 2023, 14:00 - 15:00
- 📍 Venue: MR5, CMS Pavilion A
Abstract
Fitting a model to data typically involves applying an iterative algorithm to minimize an empirical risk. However, given a particular empirical risk minimization problem, the process of algorithm selection is often performed via either expensive trial-and-error or appeal to (potentially) conservative worst case efficiency estimates and it is unclear how to compare and contrast algorithms in a principled and meaningful manner. In this talk, we present one potential avenue to obtain fine-grained, principled comparisons between iterative algorithms. We provide a framework—based on Gaussian comparison inequalities—to characterize the trajectory of an iterative algorithm run with sample-splitting on a set of nonconvex model-fitting problems with Gaussian data. We use this framework to demonstrate concrete separations in the convergence behavior of several algorithms as well as to reveal some nonstandard convergence phenomena.
Series This talk is part of the Information Theory Seminar series.
Included in Lists
- All CMS events
- All Talks (aka the CURE list)
- bld31
- CMS Events
- DPMMS info aggregator
- DPMMS lists
- DPMMS Lists
- Hanchen DaDaDash
- Information Theory Seminar
- Interested Talks
- MR5, CMS Pavilion A
- School of Physical Sciences
- Statistical Laboratory info aggregator
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Dr. Kabir Verchand, University of Cambridge 
Wednesday 11 October 2023, 14:00-15:00