BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:Probing Language Models for Paraphrastic Representations of Negati
 on and Antonymy - Teemu Vahtola\, University of Helsinki
DTSTART:20230518T100000Z
DTEND:20230518T110000Z
UID:TALK201211@talks.cam.ac.uk
CONTACT:Panagiotis Fytas
DESCRIPTION:The ability of large language models to represent essential li
 nguistic properties makes them applicable across a wide range of tasks. Ho
 wever\, it is still an open question how well they address systematic comp
 ositionality and to what level of abstraction they reflect the actual mean
 ing behind a given sentence. I present work on constructing a dedicated ch
 allenge set focusing on a specific linguistic phenomenon. In particular\, 
 the challenge set assesses the ability of language models to properly repr
 esent paraphrasticity realised in expressions that incorporate antonymy an
 d negation.\n\nI present a large-scale evaluation of publicly available pr
 e-trained language models on the proposed challenge set\, showing large va
 riation between models fine-tuned for different downstream tasks.
LOCATION:GR05\, English Faculty Building\, 9 West Road\, Sidgwick Site
END:VEVENT
END:VCALENDAR