Kafka

By default each consumer only sees messages after it joined.

Kafka ensured global ordering per partition

Kafka will assign non overlapping partitions to consumers.

TALK / Francesco Tisiot / Event-driven applications: Apache Kafka and Python : pycon (opens new window)

Kafka can have multiple topics Kafak is composed of multiple nodes/brokers A kafka event can be anything: tempaerature or pizza order

Kadfa Producer:

• needs to know hostname, authentication, encoding

Kafka Consumer:

• needs to know offset

Kafka Connects has sources/sinks to popular tools

Notebook link (opens new window) Slides (opens new window)

2007: 70+ services major releases once a month