Learning Symmetries in Neural Networks
- π€ Speaker: James Allingham and Bruno Mlodozeniec
- π Date & Time: Wednesday 21 February 2024, 11:00 - 12:30
- π Venue: Cambridge University Engineering Department, CBL Seminar room BE4-38.
Abstract
While the importance of incorporating symmetries into NNs has been well understood for some time, until recently, the standard approach has been to incorporate these inductive biases into the architecture of the neural networks (e.g., CNNs have translation, or even rotation, invariance). Unfortunately, this requires prior knowledge of which symmetries are present in the dataset. To motivate why this might be a problem, consider a model trained to classify digits. If this model is fully rotationally invariant, it cannot distinguish between some 6s and 9s. But, there is certainly some rotation invariance due to natural variations in handwriting. Thus, we need to learn how invariant our classifier should be to rotations. This reading group will explore methods to learn such invariances directly from the data. We will tackle invariance learning in both the supervised and unsupervised settings.
Required reading: None
Series This talk is part of the Machine Learning Reading Group @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Cambridge University Engineering Department, CBL Seminar room BE4-38.
- Cambridge University Engineering Department Talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- custom
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- ob366-ai4er
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

James Allingham and Bruno Mlodozeniec
Wednesday 21 February 2024, 11:00-12:30