Skip to content

Repository files navigation

Kemux - Kafka Demultiplexer

Documentation Status Code linting Integration tests License: MIT Python 3.11

Kemux is a Kafka demultiplexer that allows to route messages from one topic to another based on a set of rules.

How it works

Kemux is a Python library that uses Robinhood's Faust to process messages from one topic and route them to another topic based on a set of rules.

The rules are defined within a Stream object, that defines input and output topics, schema of their messages, as well as a set of filters and transformations that are applied to messages.

Installation

Kemux can be installed via pip:

pip install kemux

Usage

Running as a standalone application

Kemux can be run as a standalone application, using the Manager class:

from kemux.manager import Manager

kemux_manager = Manager(
  ...
)
kemux_manager.start()

Running as a Docker container

Kemux can be deployed as a standalone Docker container. The process is described in the Docker section of the documentation.

Further reading

For more information about Kemux, please refer to the documentation.

About

A mini framework for defining rules of splitting entries in a target Kafka Topic into subtopics

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Used by

Contributors

Languages