Session Details

Session Details2019-01-07T06:21:08+00:00

Kafka the hard parts.

Presented by: Chris Keathley
Time: Thursday, Jan. 10, 1:00 PM - 2:00 PM

Kafka has become a go to tool for a number of operations. Whether its stream processing, log aggregation, micro service communication, or simple queuing operations Kafka can fit the bill. But adopting Kafka can bring along a number of challenges such as monitoring and alerting, data consistency, messaging guarantees, and capacity planning. In this talk we'll discuss the hard parts of adopting any streaming technology and describe solutions for each. Specifically we'll talk about how to do monitoring correctly, how to use Kafka's consistent ordering to your advantage, how to choose message delivery guarantees, how to properly handle errors, and the benefits of immutable data and functional programming when dealing with large scale processing systems.

Room: Salon ATags: Big Data, Functional ProgrammingLevel: Intermediate