University of Cambridge > Talks.cam > Wednesday Seminars - Department of Computer Science and Technology > Kafka and Samza: distributed stream processing in practice

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Kafka and Samza: distributed stream processing in practice

Download to your calendar using vCal

If you have a question about this talk, please contact David Greaves .

Stream processing is an old idea, but it is currently being rediscovered in industry due to pressures from increasing data volumes (throughput), increasingly diverse data sources (complexity) and increasing impatience (latency).

Apache Samza and Apache Kafka, two open source projects that originated at LinkedIn, are being successfully used at scale in production. Kafka is a fault-tolerant message broker, and Samza provides a scalable processing model on top of it. They have an interesting “back to basics” approach which questions many assumptions from the last few decades of data management practice.

In particular, their design is informed by the experience of operating large-scale systems under heavy load, and the challenges that arise in a large organisation with hundreds or even thousands of software engineers. This talk will introduce the architecture of Samza and Kafka, and explain some of the reasoning behind their underlying design decisions.

This talk is part of the Wednesday Seminars - Department of Computer Science and Technology series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Faculty of Education, 184 Hills Road, Cambridge, CB2 8PQ, (Rm 2S3, Donald McIntyre Building) In person - location TBC Average on Saturdays: 7745.94755245 kWh

Other talks

TBC Using Light for Cancer Detection How bubble acoustics can help in three apocalypses Why people with schizophrenia die earlier? Mortality and accelerated ageing What’s my reproduction number? Life history strategies: an interdisciplinary perspective Title to be confirmed
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity