University of Cambridge > Talks.cam > Machine Learning Reading Group @ CUED > Learning polynomials with Neural Networks

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Learning polynomials with Neural Networks

Download to your calendar using vCal

If you have a question about this talk, please contact Yingzhen Li .

We study the effectiveness of learning low degree polynomials using neural networks by the gradient descent method. While neural networks have been shown to have great expressive power, and gradient descent has been widely used in prac- tice for learning neural networks, few theoretical guarantees are known for such methods. In particular, it is well known that gradient descent can get stuck at local minima, even for simple classes of target functions. In this paper, we present several positive theoretical results to support the effectiveness of neural networks. We focus on two- layer neural networks where the bottom layer is a set of non-linear hidden nodes, and the top layer node is a linear function, similar to Bar- ron (1993). We show that for a randomly initialized neural network with sufficiently many hidden units, the generic gradient descent algorithm learns any low degree polynomial, assuming we initialize the weights randomly

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Friends of Peterhouse Seminar Room, Peterhouse Seminar time is 1pm BST in Room FW 11, Willam Gates Hall. Zoom link: https://cl-cam-ac-uk.zoom.us/j/4361570789?pwd=Nkl2T3ZLaTZwRm05bzRTOUUxY3Q4QT09&from=addon Trustworthy and Responsible Machine Learning / AI

Other talks

Topology of the Ritz energy landscape Director's Briefing Topic Film, TV shows for Medical Education, ‘The Wire’ as a case study Group Work Why people with schizophrenia die earlier? Mortality and accelerated ageing Quantifying the unquantifiable? Assessing the importance of almsgiving in early modern France and Spain
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity