Efficient and Structured Uncertainty: Challenges and Opportunities
- π€ Speaker: Andrey Malinin, Yandex Research π Website
- π Date & Time: Wednesday 22 July 2020, 11:00 - 12:00
- π Venue: Virtual (see abstract for Zoom link)
Abstract
Uncertainty estimation is important for ensuring safety and robustness of AI systems. Ensembles of models yield improvements in system performance as well as principled and interpretable uncertainty estimates. However, ensemble-based uncertainty estimation comes at a computational and memory cost which may be prohibitive for many applications. This has limited both practical application and the scale of problems which are examined in research. In this talk we examine pushing the scale-limit of ensemble-based uncertainty estimation in two ways. Firstly, we introduce the task of “Ensemble Distribution Distillation”. Here, the goal is to distill an ensemble into a single model such that it emulates the ensemble, retaining both its improved predictive performance and interpretable uncertainty estimates. Secondly, we investigate principled ensemble-based uncertainty estimation for autoregressive structured prediction tasks, such as machine translation and speech recognition, an area which has received limited attention so far. Through the lens of these two scale-limits we pose possible directions of future research.
Zoom meeting: https://yandex.zoom.us/j/93618382511?pwd=cHJ0MkhZWXhobzZteG9YTUVJV25iUT09
Series This talk is part of the Machine Learning @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge Neuroscience Seminars
- Cambridge talks
- CBL important
- Chris Davis' list
- Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Joint Machine Learning Seminars
- Life Science
- Life Sciences
- Machine Learning @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- Required lists for MLG
- rp587
- Seminar
- Simon Baker's List
- Stem Cells & Regenerative Medicine
- Trust & Technology Initiative - interesting events
- Virtual (see abstract for Zoom link)
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)



Wednesday 22 July 2020, 11:00-12:00