Release 205

New revisions of Charmed Apache Kafka and Charmed Apache Kafka K8s have been published to their 3/stable channels.

Check the documentation on how to upgrade between minor versions on VM, and on K8s

Highlights

• Upgraded Apache Kafka version from 3.6.1 → 3.9.0
  • Check the official Apache Kafka Version 3.7.0 release notes
  • Check the official Apache Kafka Version 3.8.0 release notes
  • Check the official Apache Kafka Version 3.9.0 release notes
• Added support for the KRaft consensus protocol, removing the need for Apache ZooKeeper
  • Check the documentation for a guide on setting up a KRaft cluster
• Added support for partition rebalancing using Cruise Control
  • Check the documentation for a tutorial on partition rebalancing and reassignment using Cruise Control
• Created the karapace and karapace-k8s charms as a drop-in replacement for Schema Registry
  • Check the documentation on how to manage message schemas using Karapace
• Upgraded Apache ZooKeeper version from 3.8.2 → 3.9.2
  • Check the official Apache ZooKeeper Version 3.9.0 release notes
• Adding backup/restore support using S3

Features

• DPE-2872 - feat: partition rebalancing with Cruise Control #219
• DPE-4328 - feat: support KRaft #232
• DPE-6574 - feat: support cross-model K8s relations with juju expose #309
• DPE-6260 - feat: trust multi-certificate ca-chains #297
• DPE-6636 - feat: support non-unit/port extra_listeners #315

Improvements

• DPE-4956 - test: stabilise integration tests #229
• DPE-5226 - refactor: make ‘broker’ the central relation #244
• DPE-5591 - refactor: rework status handling #254
• DPE-5945 - chore: rename expose_external configuration option #274
• DPE-5553 - feat: don’t restart server on keystore/truststore updates #272
• DPE-5349 - feat: add internal user and SASL/SCRAM authentication #284
• DPE-6138 - chore: update zookeeper client lib #282
• DPE-6266 - chore: prepare charm for charmcraft 3 #293
• DPE-5232;DPE-5233 - chore: support for scaling operations in KRaft mode (single & multi-app) #281
• DPE-6247 - test/cicd: stabalise int-test ci #320

Bug fixes

• DPE-4703 - chore: sync vm + k8s w. nodeport feature #226
• DPE-4951 - fix: re-enable prefixed topic names during relations #227
• DPE-5208 - fix: secure written znodes #231
• DPE-5218 - chore: enable compatibility with ZK restore feature #243
• DPE-5686 - test: fix flakey CI
• DPE-5611 - fix: remove cruise-control metrics reporter if no balancer #250
• DPE-5826 - fix: remove lost+found from new storages #275
• DPE-6261 - fix: remove ‘/’ character from generated SANs for Digicert #297
• DPE-6498 - fix: gracefully handle rebalance action when role not set #313
• DPE-6547 - fix: KRaft multi-mode scaling bug on broker side #319

Charmed Apache ZooKeeper

New revisions of Charmed Apache ZooKeeper and Charmed Apache ZooKeeper K8s have been published to their 3/stable channels.

Features

• DPE-5216 - feat: S3 integration #151
• DPE-5987 - feat: add expose-external configuration option #172
• DPE-5438 - feat: enable digest auth #173
• DPE-6262 - feat: support TLS certificate chains #181

Improvements

• DPE-3477 - chore: reload stores #152
• DPE-5373 - chore: create backup action #156
• DPE-5126 - chore: use admin server instead of the 4lw commands #154
• DPE-5373 - chore: implement list-backups action #157
• DPE-5549 - chore: enable TLS v1.2 for client communication #161
• DPE-5218 - chore: implement restore flow #162
• DPE-5874 - test/refactor: Unit test migration #171

Bug fixes

• DPE-5208 - fix: enforce client auth #150
• DPE-5463;DPE-5462 - fix: quote SERVER_JVMFLAGS, safe rm tls files #160
• DPE-5462 - fix: handle NoNodeError during relation-broken #168
• DPE-6157 - fix: don’t erase previous records from /etc/hosts #175