University of Cambridge > Talks.cam > Language Technology Lab Seminars > Measuring Factuality in Text Generation: When Language Models Are Twisting the Facts

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Measuring Factuality in Text Generation: When Language Models Are Twisting the Facts

Download to your calendar using vCal

If you have a question about this talk, please contact Marinela Parovic .

Text generation is at the core of many NLP tasks like question answering, dialog generation, machine translation or text summarization. While current text generation models produce text that seems fluent and informative, their outputs often contain factual inconsistencies with respect to the inputs they rely on (a.k.a. “hallucinations”), making it hard to deploy such models in real-world applications.

In this talk I will present two of our recent works tackling those issues. First, I will describe KOBE (Gekhman et al., EMNLP Findings 2020), a knowledge-based approach for evaluating the quality of machine translation models, which uses multilingual entity resolution instead of human reference translations. I will then present Q^2 (Honovich et al., EMNLP 2021 ), an automatic evaluation metric that combines question generation, question answering and natural language inference to validate the outputs of dialogue generation models.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

John Bradfield Room, Darwin College and Zoom Seminar Room, Department of Psychology, Downing Site, Cambridge Hicks & Mead Rooms, University Centre, Granta Place

Other talks

Emergency Medicine and Metabolic Medicine Climate, uncertainty, and the slippery measurement of Antarctic ice The Magic of Magnetism Title to be confirmed LMB Seminar - Mechanisms of mRNA packaging and export Afternoon Break
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity