BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:Rethinking Benchmarking in AI - Douwe Kiela\, Facebook AI Research
DTSTART:20210304T170000Z
DTEND:20210304T180000Z
UID:TALK157798@talks.cam.ac.uk
CONTACT:Marinela Parovic
DESCRIPTION:The current benchmarking paradigm in AI has many issues: bench
 marks saturate quickly\, are susceptible to overfitting\, contain exploita
 ble annotator artifacts\, have unclear or imperfect evaluation metrics\, a
 nd do not measure what we really care about. I will talk about my work in 
 trying to rethink the way we do benchmarking in AI\, specifically in natur
 al language processing\, focusing mostly on the recently launched Dynabenc
 h platform.
LOCATION:https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBd
 XVpOXFvdz09
END:VEVENT
END:VCALENDAR