University of Cambridge > Talks.cam > Statistics > Large-scale convex optimization for machine learning

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Large-scale convex optimization for machine learning

Download to your calendar using vCal

If you have a question about this talk, please contact Richard Samworth .

Many machine learning and signal processing problems are traditionally cast as convex optimization problems. A common difficulty in solving these problems is the size of the data, where there are many observations (“large n”) and each of these is large (“large p”). In this setting, online algorithms which pass over the data only once, are usually preferred over batch algorithms, which require multiple passes over the data. In this talk, I will present several recent results, showing that in the ideal infinite-data setting, online learning algorithms based on stochastic approximation should be preferred (both in terms of running speed and generalization performance), but that in the practical finite-data setting, an appropriate combination of batch and online algorithms leads to unexpected behaviors, such as a linear convergence rate with an iteration cost similar to stochastic gradient descent.

This is joint work with Nicolas Le Roux, Eric Moulines and Mark Schmidt.

This talk is part of the Statistics series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Room GS15 at the William Gates Building and on Zoom: https://cl-cam-ac-uk.zoom.us/j/4361570789?pwd=Nkl2T3ZLaTZwRm05bzRTOUUxY3Q4QT09&from=addon https://us02web.zoom.us/j/81177193310?pwd=QTVKcWQvTWtPU0ZVbGlpZFhzNTJIdz09 Francis Crick Auditorium, WTGC

Other talks

Cambridge RNA Club - IN PERSON Toward affordable preventive healthcare Proteomics: Expression Analysis and Subcellular Localisation Talk title TBC Polar Oceans Seminar Talk Non-stationarity in structural dynamics, challenges and implications for modelling and structural health monitoring
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity