University of Cambridge > Talks.cam > Statistics > Distribution-Free, Risk-Controlling Prediction Sets

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Distribution-Free, Risk-Controlling Prediction Sets

Download to your calendar using vCal

If you have a question about this talk, please contact Dr Sergio Bacallado .

To enable valid statistical inference in prediction tasks, we show how to generate set-valued predictions for black-box predictors that control the expected loss on future test points at a user-specified level. Our approach provides explicit finite-sample guarantees for any distribution by using a holdout set to calibrate the size of the prediction sets, generalizing conformal prediction to control more complex notions of error such as the false rejection rate. We demonstrate our procedure in five large-scale problems: (1) classification problems where some mistakes are more costly than others; (2) multi-label classification, where each observation has multiple associated labels; (3) classification problems where the labels have a hierarchical structure; (4) image segmentation, where we wish to predict a set of pixels containing an object of interest; and (5) protein structure prediction.

This talk is part of the Statistics series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Room GS15 at the William Gates Building and on Zoom: https://cl-cam-ac-uk.zoom.us/j/4361570789?pwd=Nkl2T3ZLaTZwRm05bzRTOUUxY3Q4QT09&from=addon JDB Second Floor Meeting Room JD2-18, CUED Goldsmiths 1, Lecture Theatre, Department of Materials Science & Metallurgy

Other talks

title abstract tbc Talk title TBC TBC Group Work Title to follow Title TBC
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity