Computational Neuroscience Journal Club
- š¤ Speaker: Yul Kang (CBL)
- š Date & Time: Tuesday 26 June 2018, 16:00 - 17:00
- š Venue: Cambridge University Engineering Department, CBL, BE4-38 (http://learning.eng.cam.ac.uk/Public/Directions)
Abstract
Yul Kang will cover:
⢠The successor representation in human reinforcement learning
⢠I. Momennejad, E. M. Russek, J. H. Cheong, M. M. Botvinick, N. D. Daw & S. J. Gershman
⢠Nature Human Behaviour (2017)
⢠https://www.nature.com/articles/s41562-017-0180-8
Abstract: Theories of reward learning in neuroscience have focused on two families of algorithms thought to capture deliberative versus habitual choice. āModel-basedā algorithms compute the value of candidate actions from scratch, whereas āmodel-freeā algorithms make choice more efficient but less flexible by storing pre-computed action values. We examine an intermediate algorithmic family, the successor representation, which balances flexibility and efficiency by storing partially computed action values: predictions about future events. These pre-computation strategies differ in how they update their choices following changes in a task. The successor representationās reliance on stored predictions about future states predicts a unique signature of insensitivity to changes in the taskās sequence of events, but flexible adjustment following changes to rewards. We provide evidence for such differential sensitivity in two behavioural studies with humans. These results suggest that the successor representation is a computational substrate for semi-flexible choice in humans, introducing a subtler, more cognitive notion of habit.
Series This talk is part of the Computational Neuroscience series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Neuroscience Seminars
- CamBridgeSens
- Cambridge talks
- Cambridge University Engineering Department, CBL, BE4-38 (http://learning.eng.cam.ac.uk/Public/Directions)
- CBL important
- Chris Davis' list
- Computational and Biological Learning Seminar Series
- Computational Neuroscience
- custom
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Life Science
- Life Science Interface Seminars
- Life Sciences
- Life Sciences
- ME Seminar
- my_list
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- other talks
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- se456's list
- Stem Cells & Regenerative Medicine
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Yul Kang (CBL)
Tuesday 26 June 2018, 16:00-17:00