Modern Neural Networks: the Hinton Camp
- đ¤ Speaker: Richard Turner, Mark van der Wilk
- đ Date & Time: Thursday 15 November 2012, 14:30 - 16:00
- đ Venue: Engineering Department, CBL Room 438
Abstract
Historically, neural networks with multiple hidden layers have been avoided because they are difficult to train. For example, training the networks with back-propagation yielded disappointing results, which were often worse than those obtained using shallower models. In this RCC we will present an alternative approach to training neural networks – a form of deep learning developed by Geoffrey Hinton. The main idea is to train deep generative models layer-by-layer in a greedy unsupervised fashion making use of a theoretical connection with Restrictive Boltzmann Machines (RBM’s). This network can then be augmented with an additional layer to perform classification, which gives a greatly increased performance over older training methods. We will focus on showing the need for deep models, describing practical algorithms, and unpacking some of the theoretical analogies used to justify the design choices.
Series This talk is part of the Machine Learning Reading Group @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Cambridge University Engineering Department Talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- custom
- Engineering Department, CBL Room 438
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- ob366-ai4er
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Thursday 15 November 2012, 14:30-16:00