BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:Real-world task assistance with GRILLBot\, the winning Amazon Alex
 a Prize TaskBot. - Carlos Gemmell\, University of Glasgow
DTSTART:20230316T110000Z
DTEND:20230316T120000Z
UID:TALK200599@talks.cam.ac.uk
CONTACT:Panagiotis Fytas
DESCRIPTION:Effective virtual assistants have to guide users through long 
 and complex tasks\, be engaging\, and help solve unpredictable problems al
 ong the way. This talk presents GRILL Bot\, a multi-modal task-oriented as
 sistant\, as the winning system in the 2022 Amazon Alexa Prize TaskBot cha
 llenge. GRILL Bot personalizes assistance in cooking\, DIY \, and crafts b
 y leveraging TaskGraphs\, a novel task representation. TaskGrahps unify st
 eps\, requirements\, and curated domain knowledge into dynamic graphs enab
 ling detailed contextual explanations and adaptable task execution. Furthe
 r augmentations with segmented videos and linked step images allow full us
 e of the multi-modal experience. We will explore the critical roles langua
 ge models play in GRILL Bot both in offline task augmentations like contex
 tual jokes and in online settings with knowledge-grounded question answeri
 ng and a semantic parsing approach to dialogue management. We will finally
  discuss the lessons learned from a full year of real-world users and show
 case GRILL Bot in action.
LOCATION:SR 24
END:VEVENT
END:VCALENDAR