BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:Evaluating User-Adaptive Systems: Lessons from Experiences with a 
 Personalized Meeting Scheduling Assistant - Neil Yorke-Smith\, American Un
 iversity of Beirut and SRI International
DTSTART:20120217T110000Z
DTEND:20120217T120000Z
UID:TALK36128@talks.cam.ac.uk
CONTACT:Microsoft Research Cambridge Talks Admins
DESCRIPTION:We present experiences from evaluating the learning performanc
 e of a user-adaptive personal assistant agent. This work was part of the C
 ALO project\, which led to spin-out Siri acquired by Apple in 2010. We dis
 cuss the challenge of designing adequate evaluation and the tension of col
 lecting adequate data without a fully functional\, deployed system.\nRefle
 ctions on negative and positive experiences point to the challenges of eva
 luating user-adaptive agent systems. Lessons learned concern early conside
 ration of evaluation and deployment\, characteristics of AI technology and
  domains that make controlled evaluations appropriate or not\, holistic ex
 perimental design\, implications of "in the wild" evaluation\, and the eff
 ect of AI-enabled functionality and its impact upon existing tools and wor
 k practices.
LOCATION:Small lecture theatre\, Microsoft Research Ltd\, 7 J J Thomson Av
 enue (Off Madingley Road)\, Cambridge
END:VEVENT
END:VCALENDAR