![[Search]](/static/images/search.gif){kind=small}
![[A-Z Index]](/static/images/az.gif){kind=small}
![[Contact]](/static/images/contact.gif){kind=small}
![[University of Cambridge]](/static/images/identifier2.gif){kind=small}
![[Talks.cam]](/static/images/talkslogosmall.gif)
Malte Schwarzkopf (University of Cambridge)
Wednesday 10 April 2013, 13:00-14:00
Omega: flexible, scalable schedulers for large compute clusters
- 👤 Speaker: Malte Schwarzkopf (University of Cambridge)
- 📅 Date & Time: Wednesday 10 April 2013, 13:00 - 14:00
- 📍 Venue: LT2, Computer Laboratory, William Gates Builiding
Abstract
Increasing scale and the need for rapid response to changing requirements are hard to meet with current monolithic cluster scheduler architectures. This restricts the rate at which new features can be deployed, decreases efficiency and utilization, and will eventually limit cluster growth. In this talk, I will present a novel approach to address these needs using parallelism, shared state, and lock-free optimistic concurrency control. I will compare this approach to existing cluster scheduler designs, evaluate how much interference between schedulers occurs and how much it matters in practice, present some techniques to alleviate it, and finally discuss a use case highlighting the advantages of the shared-state approach – all driven by real-life Google production workloads.
Note that this is a practice talk on the EuroSys 2013 paper on my work done while interning at Google in 2011/12.
Series This talk is part of the Computer Laboratory Systems Research Group Seminar series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge talks
- Chris Davis' list
- CL's SRG seminar
- Computer Laboratory Systems Research Group Seminar
- Department of Computer Science and Technology talks and seminars
- Interested Talks
- LT2, Computer Laboratory, William Gates Builiding
- ndk22's list
- ob366-ai4er
- rp587
- School of Technology
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.