Launchpad itself

~cjwatson/launchpad:db-kafka-offset

Git
lp:~cjwatson/launchpad
db-kafka-offset

Last commit made on 2023-03-13

Get this branch:: git clone -b db-kafka-offset https://git.launchpad.net/~cjwatson/launchpad

Only Colin Watson can upload to this branch. If you are Colin Watson please log in for upload directions.

Branch merges

Ready for review for merging into launchpad:db-devel

Ines Almeida: Approve on 2023-05-12

William Grant: Pending (db) requested 2023-03-13

Launchpad code reviewers: Pending (db) requested 2023-03-13

Branch information

Name:: db-kafka-offset

Repository:: lp:~cjwatson/launchpad

Recent commits

ee8a49c... by Colin Watson on 2023-03-13

Add KafkaOffset table

In order to consume events from Kafka, we'll need a way to keep track of
our position in any given event stream. This is tracked by topic name
and partition (with the number of partitions depending on the number of
parallel consumers of any given topic). Updating a table of (topic,
partition, offset) in the same transaction as we handle whatever else we
need to do for that event gives us exactly-once event delivery, and
seems to integrate quite nicely into the rest of Launchpad.