BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:Real-world task assistance with GRILLBot\, the winning Amazon Alex
 a Prize TaskBot. - Carlos Gemmell\, University of Glasgow
DTSTART:20230316T110000Z
DTEND:20230316T120000Z
UID:TALK198475@talks.cam.ac.uk
CONTACT:Panagiotis Fytas
DESCRIPTION:Effective virtual assistants have to guide users through long 
 and complex tasks\, be engaging\, and help solve unpredictable problems al
 ong the way. This talk presents GRILLBot\, a multi-modal task-oriented ass
 istant\, as the winning system in the 2022 Amazon Alexa Prize TaskBot chal
 lenge. GRILLBot personalizes assistance in cooking\, DIY\, and crafts by l
 everaging TaskGraphs\, a novel task representation. TaskGrahps unify steps
 \, requirements\, and curated domain knowledge into dynamic graphs enablin
 g detailed contextual explanations and adaptable task execution. Further a
 ugmentations with segmented videos and linked step images allow full use o
 f the multi-modal experience. We will explore the critical roles language 
 models play in GRILLBot both in offline task augmentations like contextual
  jokes and in online settings with knowledge-grounded question answering a
 nd a semantic parsing approach to dialogue management. We will finally dis
 cuss the lessons learned from a full year of real-world users and showcase
  GRILLBot in action.
LOCATION:English Faculty Building\, second floor\, SR24
END:VEVENT
END:VCALENDAR