Skip to content

chore: test against kafka 3.7 and remove old versions of kafka from CI #1381

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
May 6, 2025

Conversation

petedannemann
Copy link
Contributor

@petedannemann petedannemann commented May 1, 2025

Testing against this many kafka versions makes our CI pipeline a lot more fragile and overall it seems really unnecessary. We need to add newer versions of kafka to our testing matrix to support them and we have hit a breaking point where adding more makes things fail significantly more often

There is some transaction tests that do not work on Kafka > 3.0 and I am not sure why. Given transaction support was never completed, I think we can just disable that test for now and revisit that when transaction work is resumed

@petedannemann petedannemann changed the title remove old versions of kafka chore: test against kafka 3.7 and remove old versions of kafka May 1, 2025
@petedannemann petedannemann force-pushed the kafka-versions-cleanup branch from e616813 to dc189f2 Compare May 1, 2025 15:50
@petedannemann petedannemann mentioned this pull request May 1, 2025
@petedannemann petedannemann force-pushed the kafka-versions-cleanup branch 3 times, most recently from 4632ff9 to 50a2986 Compare May 1, 2025 16:07
@petedannemann petedannemann force-pushed the kafka-versions-cleanup branch from 50a2986 to 1a0694f Compare May 1, 2025 16:09
@petedannemann petedannemann marked this pull request as ready for review May 1, 2025 16:16
hhahn-tw
hhahn-tw previously approved these changes May 1, 2025
@petedannemann petedannemann marked this pull request as draft May 1, 2025 16:24
@petedannemann petedannemann force-pushed the kafka-versions-cleanup branch from f9780ef to 2684515 Compare May 1, 2025 16:27
@petedannemann petedannemann changed the title chore: test against kafka 3.7 and remove old versions of kafka chore: test against kafka 3.7 and remove old versions of kafka from CI May 1, 2025
@petedannemann petedannemann marked this pull request as ready for review May 6, 2025 14:38
@petedannemann petedannemann merged commit ab44858 into main May 6, 2025
8 checks passed
@petedannemann petedannemann deleted the kafka-versions-cleanup branch May 6, 2025 14:39
LeonHartley pushed a commit to LeonHartley/kafka-go that referenced this pull request May 15, 2025
segmentio#1381)

* remove old versions of kafka

* add kafka 3.7.0

* fix test

* --amend

* actually runs tests for kafka 3.7.0 in CI

* skip test on kafka > 3.0.0

* wait for coordinator instead of sleeping

* simplify test to make it not fail sporadically

* skip transaction tests on kafka 3.0+

* skip more transaction tests

* skip more transaction tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants