Algorithmic stability for regression and classification
- 👤 Speaker: Rina Foygel Barber (Chicago)
- 📅 Date & Time: Thursday 13 March 2025, 16:30 - 17:30
- 📍 Venue: Centre for Mathematical Sciences MR2
Abstract
In a supervised learning setting, a model fitting algorithm is unstable if small perturbations to the input (the training data) can often lead to large perturbations in the output (say, predictions returned by the fitted model). Algorithmic stability is a desirable property with many important implications such as generalization and robustness, but testing the stability property empirically is known to be impossible in the setting of complex black-box models. In this work, we establish that bagging any black-box regression algorithm automatically ensures that stability holds, with no assumptions on the algorithm or the data. Furthermore, we construct a new framework for defining stability in the context of classification, and show that using bagging to estimate our uncertainty about the output label will again allow stability guarantees for any black-box model. This work is joint with Jake Soloff and Rebecca Willett.
A wine reception in the Central Core will follow this lecture
Series This talk is part of the Peter Whittle Lecture series.
Included in Lists
- All CMS events
- All Talks (aka the CURE list)
- bld31
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Centre for Mathematical Sciences MR2
- Chris Davis' list
- CMS Events
- custom
- DAMTP Departmental Seminar
- DAMTP info aggregator
- DPMMS info aggregator
- DPMMS lists
- DPMMS Lists
- Faculty of Mathematics Lectures
- Guy Emerson's list
- Hanchen DaDaDash
- Interested Talks
- Machine Learning
- ndb35's list
- Peter Whittle Lecture
- Probability
- rp587
- School of Physical Sciences
- Statistical Laboratory info aggregator
- Statistics
- Statistics Group
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Rina Foygel Barber (Chicago)
Thursday 13 March 2025, 16:30-17:30