Reactivation in biological and artificial neural networks
- 👤 Speaker: Gido van de Ven, PhD; Baylor College of Medicine
- 📅 Date & Time: Tuesday 11 September 2018, 10:00 - 11:00
- 📍 Venue: Cambridge University Engineering Dept., Board Room (2nd floor, Baker building)
Abstract
The brain’s ability to retain memories over a lifespan is thought to rely on the reactivation of memory-representing cell assemblies. To experimentally test this, for my PhD I performed multi-unit recordings in the hippocampus of mice exploring novel environments. We found that selectively disrupting reactivation by closed-loop optogenetic silencing of sharp-wave/ripples impaired the later reinstatement of recently-formed place cell assemblies, thereby providing the first direct evidence that reactivation stabilizes new cell assemblies. To gain deeper insight into the computational role of reactivation, for my postdoc I turned to machine learning. Current state-of-the-art artificial neural networks are my ideal “model organism” as they can perform extremely well on a wide variety of individual tasks, but they struggle to retain old information when trained on new tasks. Could reactivation improve memory consolidation in artificial neural networks? To test this, we equipped deep feed-forward networks for classification with feedback connections trained to have generative capability. We found that interleaving “reactivation” generated by these feedback connections with new task data substantially reduced the catastrophic forgetting of old tasks. Notably, for classification of MNIST -digits, this approach outperforms and is more widely applicable then current deep learning strategies for alleviating catastrophic forgetting. To finish, I will discuss (1) why I believe this approach could scale to more complicated inputs and (2) how I plan to use further insights from the brain to achieve this.
Series This talk is part of the Computational Neuroscience series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Neuroscience Seminars
- CamBridgeSens
- Cambridge talks
- Cambridge University Engineering Dept., Board Room (2nd floor, Baker building)
- CBL important
- Chris Davis' list
- Computational and Biological Learning Seminar Series
- Computational Neuroscience
- custom
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Life Science
- Life Science Interface Seminars
- Life Sciences
- Life Sciences
- ME Seminar
- my_list
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- other talks
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- se456's list
- Stem Cells & Regenerative Medicine
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Gido van de Ven, PhD; Baylor College of Medicine
Tuesday 11 September 2018, 10:00-11:00