BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:The Quarks of Attention - Professor Pierre Baldi - Distinguished P
 rofessor\, Department of Computer Science Director\, Institute for Genomic
 s and Bioinformatics Associate Director\, Center for Machine Learning and 
 Intelligent Systems\, University of California\, Irvine
DTSTART:20220126T150500Z
DTEND:20220126T155500Z
UID:TALK166579@talks.cam.ac.uk
CONTACT:Ben Karniely
DESCRIPTION:Attention plays a fundamental role in both natural and artific
 ial intelligence systems. In deep learning\, several attention-based neura
 l network architectures have been proposed to tackle problems in natural l
 anguage processing (NLP)  and beyond\, including transformer architectures
  which currently achieve state-of-the-art performance in NLP tasks. In thi
 s presentation we will: \n1) identify and classify the most fundamental bu
 ilding blocks (quarks) of attention\, both within and beyond the standard 
 model of deep learning\; 2) identify how these building blocks are used in
  all current attention-based architectures\, including transformers\; 3) d
 emonstrate how transformers can effectively be applied to new problems in 
 physics\, from particle physics to astronomy\; and 4) present a mathematic
 al theory of attention capacity where\, paradoxically\, one of the main to
 ols in the proofs is itself an attention mechanism.\n\n\nLink to join: htt
 ps://cl-cam-ac-uk.zoom.us/j/97767639783?pwd=T09GcVJxZUNEUFEvRnZnbWwxeEwzQT
 09\n\nA recording of this talk is available at the following link: https:/
 /www.cl.cam.ac.uk/seminars/wednesday/video/
LOCATION:Online
END:VEVENT
END:VCALENDAR