From parallel computing to parallel machine learning: Harness the power of parallelism for distributed optimization processes
- π€ Speaker: Maxwell Cai (Intel Corporation)
- π Date & Time: Thursday 17 October 2024, 14:00 - 15:00
- π Venue: East 2 room - West Hub
Abstract
Parallel computing has transformed the way we approach computational problems by breaking down complex tasks into smaller ones that can be solved simultaneously across multiple processing units. Building on this paradigm, parallel machine learning extends the concept of parallel computing with a specific focus on optimizing multivariate objective functions in machine learning models. As AI applications continue to scale up and confront vast amounts of data and/or complex models, an imperative question arises: how do we train AI models that are bigger than the maximum capacity of a single computer? In this context, parallel machine learning emerges as a critical pathway for addressing these challenges efficiently. In this presentation, I will outline the key principles underlying parallel machine learning, highlighting its reliance not only on efficient divide-and-conquer strategies but also on effective collective communication among distributed computational nodes.
Series This talk is part of the Data Intensive Science Seminar Series series.
Included in Lists
- bld31
- Cambridge Astronomy Talks
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge talks
- Chris Davis' list
- Combined External Astrophysics Talks DAMTP
- Cosmology, Astrophysics and General Relativity
- East 2 room - West Hub
- Institute of Astronomy Extra Talks
- Institute of Astronomy Talk Lists
- Interested Talks
- ndk22's list
- ob366-ai4er
- rp587
- Titel: TBC
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Maxwell Cai (Intel Corporation)
Thursday 17 October 2024, 14:00-15:00