Sentence Generation using a Dynamic Canvas
- đ¤ Speaker: David Barber (University College London)
- đ Date & Time: Thursday 30 November 2017, 11:00 - 12:00
- đ Venue: SR-24, English Faculty Building, 9 West Road (Sidgwick Site)
Abstract
I will discuss the Attentive Unsupervised Text Writer (AUTR), a word level generative model for natural language. It uses a recurrent neural network with a dynamic attention and canvas memory mechanism to iteratively construct sentences. By viewing the state of the memory at intermediate stages and where the model is placing its attention, we gain insight into how it constructs sentences. We demonstrate that AUTR learns a useful latent representation for each sentence and achieves competitive log-likelihood lower bounds whilst being computationally efficient. It is effective at generating and reconstructing sentences, as well as imputing missing words.
Series This talk is part of the Language Technology Lab Seminars series.
Included in Lists
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Chris Davis' list
- Guy Emerson's list
- Interested Talks
- Language Sciences for Graduate Students
- Language Technology Lab Seminars
- ndk22's list
- ob366-ai4er
- rp587
- Simon Baker's List
- SR-24, English Faculty Building, 9 West Road (Sidgwick Site)
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Thursday 30 November 2017, 11:00-12:00