build(deps): bump the franz-go group across 1 directory with 3 updates

[dependabot]

Bumps the franz-go group with 2 updates in the / directory: github.com/twmb/franz-go and github.com/twmb/franz-go/pkg/kadm.

Updates github.com/twmb/franz-go from 1.20.7 to 1.21.0

Changelog

Sourced from github.com/twmb/franz-go's changelog.

v1.21.0

This is a relatively "major" minor release. It adds support for Kafka 4.2, adds full support for KIP-932 share groups, adds KIP-881 rack-aware partition assignment, adds a handful of other features / options, and fixes several niche bugs.

The companion kfake package has also been significantly extended; it now supports everything except delegation tokens, streams APIs, and broker internal APIs. kfake can be used as a dumb localhost broker; it has an option to persist to disk to tolerate restarts (and it even handles quick restarts without interrupting any client state). See the run_tests.sh script and the main.go file in pkg/kfake if you want to see about bootstrapping this yourself. I may create some tiny 'dumbkafka' binary that supports running on localhost with a few options. Regardless, kfake is quite neat.

The kadm package has been extended with new share APIs. See the incoming kadm tag for full details.

As a meta note, this was a significant time investment (>4w most evenings and weekends for KIP-932 alone). I hope future releases require less work; 932 is the last major feature this library has been missing for a while, and of upcoming KIPs, only transactional support for 932 looks to maybe be some effort. That said, if you get a lot of value from this and have a spare quarter, please consider sponsoring.

API additions

Share groups (KIP-932)

franz-go now fully supports KIP-932 share groups for consuming. Share groups are the "queue-like" alternative to consumer groups: many consumers can share a single partition, records are individually acknowledged, and unacknowledged records are automatically redelivered.

The new share group API mirrors the existing consumer group shape; see full documentation on pkg.go.dev:

type AckStatus int8
const (
AckAccept  AckStatus = 1
AckRelease AckStatus = 2
AckReject  AckStatus = 3
AckRenew   AckStatus = 4
</tr></table>

... (truncated)

Commits

• 897f85b Merge pull request #1307 from twmb/cl
• 412faf7 README: note rack aware assignment
• 1b12988 v1.21.0 changelog
• 2b4a838 Merge pull request #1306 from twmb/kgo-miscs
• bd77779 run_tests.sh: archive failure logs into a timestamped subdir
• 12889e1 kfake: persist classic group state, re-rebalance on reload if non-Stable
• 71f970e kfake: fix orphan-server crash and bound saved fetch sessions
• 8854973 kfake,kgo: harden state across restart for run_tests.sh --restart
• 2a935ef kadm: round out new share/ByID APIs; fix UpdateFeatures v0/v2
• 7810717 Merge pull request #1305 from dferstay/dferstay/pr/abnormal-ai-uses-franz-go
• Additional commits viewable in compare view

Updates github.com/twmb/franz-go/pkg/kadm from 1.17.2 to 1.18.0

Changelog

Sourced from github.com/twmb/franz-go/pkg/kadm's changelog.

v1.18.0

This release adds support for Kafka 3.7, adds a few community requested APIs, some internal improvements, and fixes two bugs. One of the bugfixes is for a deadlock; it is recommended to bump to this release to ensure you do not run into the deadlock. The features in this release are relatively small.

This adds protocol support for KIP-890 and KIP-994, and adds further protocol support for [KIP-848][KIP-848]. If you are using transactions, you may see a new kerr.TransactionAbortable error, which signals that your ongoing transaction should be aborted and will not be successful if you try to commit it.

Lastly, there have been a few improvements to pkg/sr that are not mentioned in these changelog notes.

Bug fixes

• If you canceled the context used while producing while your client was at the maximum buffered records or bytes, it was possible to experience deadlocks. This has been fixed. See #832 for more details.

• Previously, if using GetConsumeTopics while regex consuming, the function would return all topics ever discovered. It now returns only the topics that are being consumed.

Improvements

• The client now internaly ignores OutOfOrderSequenceNumber errors that are encountered when consuming if possible. If a producer produces very infrequently, it is possible the broker forgets the producer by the next time the producer produces. In this case, the producer receives an OutOfOrderSequenceNumber error. The client now internally resets properly so that you do not see the error.

Features

• AllowRebalance and CloseAllowingRebalance have been added to GroupTransactSession.
• The FetchTopic type now has includes the topic's TopicID.
• The ErrGroupSession internal error field is now public, allowing you to test how you handle the internal error.
• You may now receive a kerr.TransactionAbortable error from many functions while using transactions.

Relevant commits

• 0fd1959d kgo: support Kafka 3.8's kip-890 modifications
• 68163c55 bugfix kgo: do not add all topics to internal tps map when regex consuming
• 3548d1f7 improvement kgo: ignore OOOSN where possible

... (truncated)

Commits

• 0a9996b Merge pull request #841 from twmb/1.18-changelog
• 835c682 CHANGELOG: note incoming release
• d771ddf Merge pull request #838 from twmb/810
• 04356d7 Merge pull request #835 from twmb/819
• 3d71b14 Merge pull request #834 from twmb/805
• 019799a Merge pull request #829 from andrewstucki/sr-client-opts
• 3a0f09a Merge pull request #814 from noamcohen97/new-offset-helper
• 6028e72 Merge pull request #794 from twmb/790
• 581d7ef Merge pull request #789 from sbuliarca/errgroupsession-export-err
• fd084a5 Merge pull request #760 from twmb/753
• Additional commits viewable in compare view

Updates github.com/twmb/franz-go/pkg/kmsg from 1.12.0 to 1.13.1

Changelog

Sourced from github.com/twmb/franz-go/pkg/kmsg's changelog.

v1.13.1

This patch release fixes a bug where a producer could enter a deadlock if a topic is deleted and recreated very quickly while producing.

• 769e02f producer: avoid deadlock when when quickly recreating a topic

v1.13.0

This release contains a few new APIs, two rare bug fixes, updates to plugins, and changes the library to now require 1.18.

Go version

This library has supported Go 1.15 since the beginning. There have been many useful features that this library has not been able to use because of continued backcompat for 1.15. There is really no reason to support such an old version of Go, and Go itself does not support releases prior to 1.18 -- and 1.18 is currently only supported for security backports. Switching to 1.18 allows this library to remove a few 1.15 / 1.16 backcompat files, and allows switching this library from interface{} to any.

Behavior changes

If group consuming fails with an error that looks non-retryable, the error is now injected into polling as a fake errored fetch. Multiple people have ran into problems where their group consumers were failing due to ACLs or due to network issues, and it is hard to detect these failures: you either have to pay close attention to logs, or you have to hook into HookGroupManageError. Now, the error is injected into polling.

Bug fixes

This release contains two bug fixes, one of which is very rare to encounter, and one of which is very easy to encounter but requires configuring the client in a way that (nearly) nobody does.

Rare: If you were using EndAndBeginTransaction, there was an internal race that could result in a deadlock.

Rare configuration: If you configured balancers manually, and you configured CooperativeSticky with any other eager balancer, then the client would internally sometimes think it was eager consuming, and sometimes think it was cooperative consuming. This would result in stuck partitions while consuming.

Features

... (truncated)

Commits

• 1a59c2d Merge pull request #404 from twmb/bugfix
• 5e0ba1c document incoming v1.13.1, update readme, fix golangci-lint
• d984c21 Merge pull request #401 from bgranvea/fix-segment-bench
• 769e02f producer: avoid deadlock when when quickly recreating a topic
• 5c2a90c set async commit
• 8cb298d Merge pull request #399 from twmb/dependabot/go_modules/examples/hooks_and_lo...
• 1141ce4 Merge pull request #397 from twmb/dependabot/go_modules/examples/hooks_and_lo...
• d5ef6e0 Merge pull request #398 from twmb/dependabot/go_modules/examples/bench/google...
• 8215a54 Merge pull request #400 from twmb/dependabot/go_modules/plugin/kprom/google.g...
• 6fdb469 build(deps): bump google.golang.org/protobuf in /plugin/kprom
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore <dependency name> major version will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
• @dependabot ignore <dependency name> minor version will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
• @dependabot ignore <dependency name> will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
• @dependabot unignore <dependency name> will remove all of the ignore conditions of the specified dependency
• @dependabot unignore <dependency name> <ignore condition> will remove the ignore condition of the specified dependency and ignore conditions