BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:The Continual Learning (CL) Theory - Sasha Rivkind\; Nicolas Angui
 ta
DTSTART:20250304T150000Z
DTEND:20250304T163000Z
UID:TALK229012@talks.cam.ac.uk
CONTACT:124819
DESCRIPTION:The Continual Learning (CL) Theory journal club meeting next T
 uesday will focus on the following three papers (updated also at the JC do
 cument):\nIntroduction will loosely follow the review paper Continual task
  learning in natural and artificial agents.\n1. "Continual Learning Throug
 h Synaptic Intelligence":https://arxiv.org/pdf/1703.04200 : - This paper p
 resents Synaptic Intelligence\, a method allowing CL by assigning importan
 ce to synapses which is partially theoretically tractable.\n2. "A Theoreti
 cal Analysis of Catastrophic Forgetting through the NTK Overlap Matrix":ht
 tps://arxiv.org/pdf/2010.04003 – This paper provides a theoretical analy
 sis of catastrophic forgetting in wide neural networks under vanilla gradi
 ent descent\, as well as its CL-friendly variants.\n3. "How catastrophic c
 an catastrophic forgetting be in linear regression?":https://arxiv.org/pdf
 /2205.09588 – This paper establishes bounds on forgetting in linear regr
 ession with task repetitions using projection theory.\n4. "Order parameter
 s and phase transitions of continual learning in deep neural networks":htt
 ps://arxiv.org/pdf/2407.10315 – This paper offers a statistical mechanic
 s framework for both retrograde and anterograde effects in a teacher-stude
 nt setting.\n
LOCATION:CBL Seminar Room\, Engineering Department\, 4th floor Baker build
 ing
END:VEVENT
END:VCALENDAR