Linguistic Yardsticks: Evaluating Language Technology Using Insights from Linguistic Theory
- π€ Speaker: Laura Rimell (DeepMind) π Website
- π Date & Time: Tuesday 21 November 2017, 16:45 - 17:15
- π Venue: Cripps Court, Magdalene College
Abstract
Language technology has achieved remarkable success on practical tasks, such as machine translation and sentiment analysis, while incorporating very little theoretical linguistic knowledge. However, the appearance of success may be deceiving, because standard evaluation metrics for language technology under-represent relatively rare but linguistically interesting phenomena. Poor performance in these areas will be increasingly noticeable as technology advances and users expect more human-like behaviour. I will describe work that evaluates language technology using linguistic yardsticks: datasets designed to focus on specific phenomena, such as the semantic understanding of relative clauses, and I will consider how they may point the way toward improvements in natural language processing.
Series This talk is part of the Cambridge Language Sciences Annual Symposium series.
Included in Lists
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge Language Sciences Annual Symposium
- Cambridge talks
- Chris Davis' list
- Cripps Court, Magdalene College
- Guy Emerson's list
- Interested Talks
- Language Sciences for Graduate Students
- ndk22's list
- ob366-ai4er
- rp587
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Laura Rimell (DeepMind) 
Tuesday 21 November 2017, 16:45-17:15