University of Cambridge > Talks.cam > NLIP Seminar Series > Where did it all go wrong? New Tools for Automatic Error Analysis in NLP

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Where did it all go wrong? New Tools for Automatic Error Analysis in NLP

Download to your calendar using vCal

If you have a question about this talk, please contact Tamara Polajnar .

System performance is typically interpreted through metrics, which quantify errors, but do not analyse them. In this talk I will present new tools that automatically analyse system output, giving a linguistically intuitive breakdown of errors.

For parsing I will present results for English and Chinese, showing how error distributions vary between systems, what types of errors are being resolved by re-rankers, and what types are introduced when parsing out-of-domain text. For co-reference resolution I will present some preliminary results, comparing the errors made by systems in a recent shared task.

Jonathan is a PhD candidate at the University of California, Berkeley, advised by Dan Klein

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Machine Learning and Inference (One day meeting) Average on Saturdays: 7576.3974359 kWh Hoyle Committee Room, IoA

Other talks

TBC The elephant in the room: Machine Learning directly into physical models Talk title TBC Cambridge AI in Medicine Seminar - July 2026 Title to be confirmed CUSCRS and Renal Medicine
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity