BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Talks.cam//talks.cam.ac.uk//
X-WR-CALNAME:Talks.cam
BEGIN:VEVENT
SUMMARY:A Proposal on Evaluation Measures for RTE - Richard Bergmair\, Com
 puter Laboratory\, University of Cambridge
DTSTART:20090710T110000Z
DTEND:20090710T114500Z
UID:TALK18992@talks.cam.ac.uk
CONTACT:Laura Rimell
DESCRIPTION:We outline problems with the interpretation of accuracy in the
  presence of bias\, arguing that the issue is a particularly pressing conc
 ern for RTE evaluation. Furthermore\, we argue that average precision scor
 es are unsuitable for RTE\, and should not be reported. We advocate mutual
  information as a new evaluation measure that should be reported in additi
 on to accuracy and confidence-weighted score.
LOCATION:SW01\, Computer Laboratory
END:VEVENT
END:VCALENDAR