University of Cambridge > Talks.cam > NLIP Seminar Series > General-Purpose Representation Learning from Words to Sentences

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

General-Purpose Representation Learning from Words to Sentences

Download to your calendar using vCal

If you have a question about this talk, please contact Kris Cao .

***PLEASE NOTE CHANGED (DIFFERENT) TIME***

Real-valued vector representations of words (aka embeddings) that are trained on naturally occurring data by optimising general-purpose objectives are useful for a range of downstream language tasks. However, the picture is less clear for larger linguistic units such as phrases or sentences. Phrases and sentences typically encode the facts and propositions that constitute the ‘general knowledge’ missing from many NLP systems at present, so the potential benefit of making representation-learning work for these units is huge. I will present a systematic comparison of different ways of inducing such representations with neural language models from unlabelled data. The study demonstrates clear and interesting differences between the representations learned by different methods; in particular, more elaborate or computationally expensive methods are not necessarily best. I’ll also discuss a key challenge facing all research in unsupervised or representation learning for NLP - the lack of robust evaluations.

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

This talk has been cancelled. Goldsmiths 2 & https://us06web.zoom.us/j/81688365420?pwd=b3RpdHgxNVhWbWQrbXluMUxYNWVtQT09 Meeting ID: 816 8836 5420 Passcode: 047859 Barns Hotel, Cardington Road, Bedford MK44 3SA

Other talks

Group Work Christmas Social Evening & Annual General Meeting Talk title TBC Quantifying the unquantifiable? Assessing the importance of almsgiving in early modern France and Spain Title to be confirmed Title to be confirmed
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity