Kaffe v1.10.0 Kaffe.GroupManager

This is the main process for bootstrapping the full supervision tree to consume a Kafka topic via a subscriber/worker combo per topic per partition as part of a consumer group.

See Kaffe.GroupMemberSupervisor for distinct components.

The process begins by starting the client connection to Kafka. Then group members are created for each of the configured topics.

Note that this module is is not involved in any message processing, rather it’s role is to ensure that all of the relevant services are running.

Summary

Functions

List the currently subscribed topics

Start the subscribers and workers to process message sets

List of currently subscribed topics

Dynamically subscribe to topics in addition to the configured topics. Returns the newly subscribed topics. This may not include all values if any are already subscribed to

Functions

handle_call(msg, from, state)

List the currently subscribed topics

handle_cast(msg, state)

Start the subscribers and workers to process message sets

Worker are booted before the subscribers so when the subscribers receive the first messages, we know there will be a worker to do the actual processing work

list_subscribed_topics()

List of currently subscribed topics.

start_link()
subscribe_to_topics(topics)

Dynamically subscribe to topics in addition to the configured topics. Returns the newly subscribed topics. This may not include all values if any are already subscribed to.