Towards a theory of layered neural circuit architectures
- 👤 Speaker: Alireza Alemi (École Normale Supérieure)
- 📅 Date & Time: Tuesday 31 May 2016, 11:30 - 12:30
- 📍 Venue: Cambridge University Engineering Department, CBL, BE-438 (http://learning.eng.cam.ac.uk/Public/Directions)
Abstract
A main challenge in neuroscience is finding a general computational principle that explains why cortical circuits are organized in particular structures. I will start out with the optimal storage principle as a guideline to derive optimal neural architecture. For optimal storage, one needs to have the maximal capacity of a neural network and a learning rule to achieve the capacity. For conventional recurrent neural networks, the maximal capacity is known as the Gardner bound, and this bound is achieved via the Three-Threshold Learning Rule (3TLR). However, calculating the storage capacity of hierarchical neural circuits has been problematic. I will present my recent results suggesting that the capacity of an expansive autoencoder increases superlinearly with the expansion ratio using simulations and Gardner’s replica theory. I will discuss some of the theoretical challenges and limitations of these networks.
Series This talk is part of the Computational Neuroscience series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Neuroscience Seminars
- CamBridgeSens
- Cambridge talks
- Cambridge University Engineering Department, CBL, BE-438 (http://learning.eng.cam.ac.uk/Public/Directions)
- CBL important
- Chris Davis' list
- Computational and Biological Learning Seminar Series
- Computational Neuroscience
- custom
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Life Science
- Life Science Interface Seminars
- Life Sciences
- Life Sciences
- ME Seminar
- my_list
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- other talks
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- se456's list
- Stem Cells & Regenerative Medicine
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Alireza Alemi (École Normale Supérieure)
Tuesday 31 May 2016, 11:30-12:30