Supervising Robot Learning with Language and Video from the Web
- 👤 Speaker: Suraj Nair, Stanford University
- 📅 Date & Time: Thursday 18 November 2021, 15:00 - 16:00
- 📍 Venue: https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
Abstract
While deep reinforcement learning applied to robotics has seen a number of recent successes in constrained environments, generalist robots that can operate in diverse real world settings have remained out of reach. Critically, robot learning algorithms have yet to be able to learn from a sufficient breadth of data that can enable broad generalization across tasks and environments. In this talk, I’ll discuss the paradigm of offline learning for robotics as a path towards generalist robots, and how we might supervise this offline learning process in a scalable way using crowdsourced language and videos of humans. Specifically, I’ll cover two recent papers which learn reward functions for offline reinforcement learning through language annotations of pre-collected robot datasets and human video datasets which exist on the web.
Series This talk is part of the Language Technology Lab Seminars series.
Included in Lists
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Chris Davis' list
- Guy Emerson's list
- https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
- Interested Talks
- Language Sciences for Graduate Students
- Language Technology Lab Seminars
- ndk22's list
- ob366-ai4er
- rp587
- Simon Baker's List
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Thursday 18 November 2021, 15:00-16:00