Optimal control and optimal sampling: A statistical physics perspective.
- ๐ค Speaker: Bert Kappen, Radboud University Nijmegen, and UCL London
- ๐ Date & Time: Tuesday 21 October 2014, 14:30 - 15:30
- ๐ Venue: Cambridge University Engineering Department, LR12
Abstract
Intelligent systems, whether natural or artificial, must act in a world that is highly unpredictable. To plan actions with uncertainty is a stochastic optimal control problem. However, there are two fundamental problems: the optimal control solution is intractable to compute and intractable to represent due the non-trivial state dependence of the optimal control. This has prevented large scale application of stochastic optimal control theory sofar. The path integral control theory describes a class of control problems whose solution can be computed as an inference computation. In this presentation we formalize the intuitive notion that the efficiency of the inference computation is related to the proximity of the sampling control to the optimal control. Secondly, we show new results that allow approximate computation of state dependent optimal controls in terms of basis functions. These two ingredients together suggest a novel adaptive sampling procedure. We illustrate the results on a few examples.
Series This talk is part of the CUED Control Group Seminars series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge Neuroscience Seminars
- Cambridge talks
- Cambridge University Engineering Department, LR12
- Cambridge University Engineering Department Talks
- CBL important
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
- CUED Control Group Seminars
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Joint Machine Learning Seminars
- Life Science
- Life Sciences
- Machine Learning @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- Probabilistic Systems, Information, and Inference Group Seminars
- Required lists for MLG
- rp587
- School of Technology
- Seminar
- Simon Baker's List
- Stem Cells & Regenerative Medicine
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Bert Kappen, Radboud University Nijmegen, and UCL London
Tuesday 21 October 2014, 14:30-15:30