[//]: # (This file is auto-generated by bin/refresh_remote_content) [//]: # (Do not edit manually - changes will be overwritten) # Rdkafka Changelog ## Rdkafka Changelog / 0.31.0 (Unreleased) - [Feature] Add `status`, `latency` and `broker_id` to `Producer::DeliveryReport`, with `#persisted?`, `#possibly_persisted?` and `#not_persisted?`, so a failed delivery tells whether a retry may duplicate the message. - [Feature] Add `Admin#describe_cluster` to get the cluster id, controller and broker nodes (with racks) without a full metadata request. - [Feature] Add `Admin#describe_topics` to get topic ids, partition leaders and replicas, and per-topic errors. Both methods can also return the operations the client is authorized to perform. - [Feature] Add `Admin#describe_consumer_groups` to read the state, type, coordinator, authorized operations and members (with their current and target partition assignments) of consumer groups. - [Enhancement] Bump librdkafka to `2.15.1` for OpenSSL and libcurl security fixes. It changes how IPv6 addresses are formatted and validated against broker certificates. - [Enhancement] Bump the bundled OpenSSL to `3.5.9` (LTS) for its security fixes. - [Change] Build the precompiled `macos_arm64` library on macOS 26 with the minimum macOS pinned to 14.0, instead of inheriting it from the build host. - [Change] Build the precompiled `aarch64-linux-musl` gem on Alpine `3.24` (was `3.23`), matching `x86_64-linux-musl`. ## Rdkafka Changelog / 0.30.0 (2026-09-25) - [Feature] Add `Admin#alter_consumer_group_offsets` and `Admin#delete_consumer_group_offsets` to set or clear a consumer group's committed offsets from the admin client. - [Enhancement] Bump the bundled zlib to `1.3.2`. - [Enhancement] Bump librdkafka to `2.15.0`. - [Enhancement] Bump the bundled MIT Kerberos (krb5) to `1.22.2`. - [Enhancement] Add `Rdkafka::Config.partitioner_key_uses_bytesize` to hash partition keys by byte length, matching other Kafka clients for multibyte keys. Defaults to `false`. - [Maintenance] Derive the zlib `CHECKSUMS` entry from `ZLIB_VERSION`. - [Maintenance] Drop the unused `dist/openssl-3.0.16.tar.gz` build cache. - [Fix] Honor the `isolation_level:` argument to `Admin#list_offsets`, which was silently ignored. - [Fix] Return correct results for every item of a multi-item topic, partition, group or ACL admin request, not just the first. - [Maintenance] Fix a use-after-free in the multi-item admin integration test that read result-name pointers after librdkafka had destroyed the background event, which made it flaky on newer glibc (e.g. Debian trixie). - [Maintenance] Stabilize consumer specs on slow CI runners: wait longer for a partition assignment, raise the `TestTopics.create` admin timeout and drop the fixed 60s limit of the long-running consumption spec. - [Maintenance] Raise the `TestTopics.create` admin timeout to 30s so a loaded CI runner no longer hits `create topic timed out` (which also tripped the leaked-handle guard). ## Rdkafka Changelog / 0.29.2 (2026-09-11) - [Fix] Close live clients from an `at_exit` hook before Ruby's shutdown finalization, so librdkafka is no longer `dlclose`d while its native threads are still running (which could segfault on exit). - [Fix] Make client construction exception-safe and destroy the native handle when setup fails after `rd_kafka_new`, so a later error no longer orphans the native client. - [Fix] Fix a double-free in `Consumer#poll_batch`/`#poll_batch_nb` that could abort the process when building a message raised a non-`RdkafkaError`. - [Fix] Free native resources when `Admin#describe_configs`/`#incremental_alter_configs` raise while building their request (e.g. a non-String resource name). - [Fix] Raise `ConfigError` instead of segfaulting when `Admin#describe_configs`/`#incremental_alter_configs` get an empty resource name or a negative resource type. ## Rdkafka Changelog / 0.29.1 (2026-09-04) - [Enhancement] Add `Admin#delete_records` to delete all messages in a partition up to a given offset. - [Enhancement] Add `Admin#list_consumer_groups` to list the cluster's consumer groups. - [Enhancement] Name the failing topic and partition in the `RdkafkaError` raised for per-partition `list_offsets` errors. - [Enhancement] Add `Consumer#list_offsets` to query partition offsets on an existing consumer handle without opening a dedicated admin connection. - [Fix] Make `NativeKafka#close` fork-aware so a forked child no longer segfaults on exit. - [Fix] Stabilize the `to_native_tpl` leak integration spec. - [Fix] Stabilize the flaky partitions count cache statistics spec. - [Fix] Use global allocator in topic_partition_list for pointer freed by librdkafka. ## Rdkafka Changelog / 0.29.0 (2026-07-10) - [Enhancement] Bump librdkafka to `2.14.2` - [Enhancement] Add `Consumer#metadata` and `Producer#metadata`, mirroring `Admin#metadata`, to fetch cluster metadata without a separate admin connection. - [Enhancement] Support offset-commit metadata via `Consumer#store_offset(message, metadata)`, readable through `Consumer::Partition#metadata` and `Consumer#committed`. - [Enhancement] Expose `replicas` and `isrs` (in-sync replica broker ids) on each partition in topic metadata; both were previously dropped from the `Metadata#topics` partition hashes. - [Enhancement] Extract the admin background-event result handlers into one class per operation under `lib/rdkafka/callbacks/`. Internal reorganization with no API or behavior change. - [Enhancement] Reuse per-thread scratch pointers in `Consumer::Headers.from_native`, removing the per-message native allocations from the consumer hot path. - [Enhancement] Remove the unused `DeliveryHandle` `:topic_name` struct field and its per-message allocation. Use `DeliveryHandle#topic` or `DeliveryReport#topic_name`, both unchanged. - [Fix] Cache the partition count for a missing topic, so `produce` with a `partition_key` to a missing topic no longer re-runs a blocking metadata query on every message. - [Fix] Let `PartitionsCountCache` adopt a lower partition count once the cached entry has expired, so a topic recreated with fewer partitions no longer fails `produce` until process restart. - [Fix] Surface per-message build errors inline in `Consumer#poll_batch`/`#poll_batch_nb` instead of discarding the batch, preserving the messages that built successfully. - [Fix] Bound the `Metadata` retry loop to about 5 seconds, so a synchronous metadata fetch can no longer block for minutes. - [Fix] Synchronize `AbstractHandle::REGISTRY` mutations with a mutex, which could otherwise lose a write on JRuby and leave a handle unregistered or leaked. - [Fix] Raise `ConfigError` instead of `NameError` in `Admin#delete_group`, `#delete_acl` and `#describe_acl` when the background queue is unavailable. - [Fix] Actually populate `ConfigBindingResult#synonyms`. The synonym loop built the synonym binding objects and discarded them, so `#synonyms` was always an empty array; they are now appended. - [Fix] Stop leaking the native `rd_kafka_topic_conf_t` in `Producer#set_topic_config` when a per-topic config value is rejected. - [Fix] Raise `ClosedConsumerError` from `Consumer#position` on a closed consumer, like the other consumer methods. - [Fix] Guard the OAuthBearer token refresh callback against a NULL client pointer before calling `rd_kafka_name` on it. - [Fix] Fully close a consumer collected without an explicit `close`, preventing a hang or leak. - [Fix] Free the librdkafka-allocated string in `Consumer#cluster_id` and `Consumer#member_id`, and fix the `rd_kafka_clusterid` arity. `Consumer#cluster_id` now accepts a `timeout_ms`. - [Fix] Attach `rd_kafka_query_watermark_offsets` with `blocking: true` so it releases the GVL; it previously froze every other Ruby thread for up to `timeout_ms`. - [Fix] Stop leaking the native `rd_kafka_conf_t` when client creation fails, a multi-KB leak per failed attempt for supervisors retrying on transient SASL/SSL misconfiguration. - [Fix] Stop `Metadata` from leaking the native metadata struct on every retried fetch; each attempt now frees its own native resources. - [Fix] Stop `Producer#produce` from orphaning the delivery handle in the process-global registry when it fails after registering it. - [Fix] Guard the message delivery callback so a raising user `delivery_callback` can no longer leave the handle locked or crash the producer; exceptions are now logged and swallowed. - [Fix] Stop `describe_configs`, `incremental_alter_configs` and `list_offsets` from leaking native resources when their arguments are rejected. - [Fix] Stop `TopicPartitionList#to_native_tpl` from leaking the native list when building it fails partway. - [Fix] Raise instead of silently dropping a rejected `incremental_alter_configs` entry, which previously left the alter request reporting success. - [Fix] Allocate the admin result-count out-parameter as `:size_t` instead of `:int32`, fixing a 4-byte overflow on every admin result parse. - [Fix] Stabilize the flaky `Consumer#lag` "calculates the consumer lag" spec on overloaded CI. - [Fix] Return the real error from an admin operation that fails at the operation level (e.g. brokers unreachable) instead of blocking until `wait` times out. - [Fix] Stop every admin operation from leaking its result event. The internal FFI struct fields on admin handles are removed; use `handle.wait` and the returned report objects, which are unchanged. ## Rdkafka Changelog / 0.28.0 (2026-06-03) - [Enhancement] Bump librdkafka to `2.14.1` - [Enhancement] Replace version-gated `Warning[:performance]` with dynamic `Warning.categories` opt-in in spec helper so new Ruby warning categories are automatically enabled without manual updates. - [Enhancement] `poll_batch` and `poll_batch_nb` now return errors inline as `RdkafkaError` objects instead of raising on the first one. The return type is `Array`, so callers must handle errors in the result. ## Rdkafka Changelog / 0.27.0 (2026-05-07) - [Feature] Add `Consumer#poll_batch(timeout_ms, max_items:)` and `Consumer#poll_batch_nb(timeout_ms, max_items:)` for batch message polling via `rd_kafka_consume_batch_queue`. - [Feature] Add `Config#describe_properties` to dump all librdkafka configuration properties (including defaults and hidden properties) as a Hash via `rd_kafka_conf_dump`. - [Enhancement] Bump librdkafka to `2.14.0` - [Fix] Fix resource leak in `Admin#describe_configs` and `Admin#incremental_alter_configs` where `admin_options_ptr` and `queue_ptr` were not destroyed in the ensure block. - [Fix] Fix leaked queue reference in `Config#native_kafka` where `rd_kafka_queue_get_main` return value was not destroyed after passing to `rd_kafka_set_log_queue`. - [Fix] Fix native topic partition list leak in `Consumer#position` where `tpl` was never destroyed. ## Rdkafka Changelog / 0.26.0 (2026-04-02) - [Enhancement] Bump librdkafka to `2.13.2` - [Enhancement] Embed a per-file SPEC_HASH in test topic and consumer group names for tracing Kafka warnings back to specific spec files. - [Fix] Register `ObjectSpace.define_finalizer` in `Rdkafka::Consumer` to prevent segfaults when a consumer is GC'd without being explicitly closed (jturkel). - [Fix] Remove dead `#finalizer` instance methods from `Consumer` and `Admin` that could never work as GC finalizers. - [Fix] Prevent cascading test failures in admin specs when a single handle leaks into the registry. - [Feature] Extend `Rdkafka::RdkafkaError` with `instance_name` attribute containing the `rd_kafka_name` for tying errors back to specific native Kafka instances (#181). ## Rdkafka Changelog / 0.25.1 (2026-02-26) - [Feature] Support `rd_kafka_ListOffsets` admin API for querying partition offsets by specification (earliest, latest, max_timestamp, or by timestamp) without requiring a consumer group (#613). - [Enhancement] Use native ARM64 runners instead of QEMU emulation for Alpine musl aarch64 builds, improving build performance and reliability. - [Enhancement] Enable parallel compilation (`make -j$(nproc)`) for ARM64 Alpine musl builds. - [Enhancement] Add `enable_queue_io_events` and `enable_background_queue_io_events` to `Consumer`, `Producer` and `Admin` for non-blocking file descriptor monitoring with fiber schedulers (Falcon, Async) and custom event loops. - [Enhancement] Add non-blocking poll methods (`poll_nb`, `events_poll_nb`) on `Consumer` that skip GVL release for efficient fiber scheduler integration when using `poll(0)`. - [Enhancement] Add `events_poll_nb_each` method on `Producer`, `Consumer`, and `Admin` for polling events in a single GVL/mutex session. Yields count after each iteration, caller returns `:stop` to break. - [Enhancement] Add `poll_nb_each` method on `Consumer` for non-blocking message polling with proper resource cleanup, yielding each message and supporting early termination via `:stop` return value. ## Rdkafka Changelog / 0.25.0 (2026-01-20) - **[Deprecation]** `AbstractHandle#wait` parameter `max_wait_timeout:` (seconds) is deprecated in favor of `max_wait_timeout_ms:` (milliseconds). The old parameter still works but will be removed in v1.0.0. - **[Deprecation]** `PartitionsCountCache` constructor parameter `ttl` (seconds) is deprecated in favor of `ttl_ms:` (milliseconds). The old parameter still works but will be removed in v1.0.0. - [Enhancement] Extract all timeout defaults to `Rdkafka::Defaults` module for discoverability and per-call overrides (#310). All time-related values are now in milliseconds for consistency. - [Enhancement] Add `timeout_ms` parameter to `Consumer#each` for configurable poll timeout. - [Enhancement] Extract non-time configuration values (`METADATA_MAX_RETRIES`, `PARTITIONS_COUNT_CACHE_TTL_MS`) to `Rdkafka::Defaults` module. - [Enhancement] Bump librdkafka to `2.12.1` - [Enhancement] Add descriptive error messages for glibc compatibility issues with instructions for resolution (#654) - [Enhancement] Replace magic numbers with named constants throughout codebase for improved readability and maintainability ## Rdkafka Changelog / 0.24.2 (2025-10-31) - [Enhancement] Force lock FFI to 1.17.1 or higher to include critical bug fixes around GCC, write barriers, and thread restarts for forks. - [Fix] Fix for Core dump when providing extensions to oauthbearer_set_token (dssjoblom) ## Rdkafka Changelog / 0.24.1 (2025-10-10) - [Fix] Fix Github Action Ruby reference preventing non-compiled releases. ## Rdkafka Changelog / 0.24.0 (2025-10-10) - [Enhancement] Bump librdkafka to `2.11.1` ## Rdkafka Changelog / 0.23.1 (2025-09-25) - [Enhancement] Improve sigstore attestation for precompiled releases. - [Fix] Fix incorrectly set default SSL certs dir. - [Fix] Disable OpenSSL Heartbeats during compilation. ## Rdkafka Changelog / 0.23.0 (2025-09-04) - **[EOL]** Drop support for Ruby 3.1 to move forward with the fiber scheduler work. - [Enhancement] Bump librdkafka to `2.11.0` - [Enhancement] Support explicit Debian testing due to lib issues. - [Enhancement] Support ARM64 Gnu precompilation. - [Enhancement] Improve what symbols are exposed outside of the precompiled extensions. - [Enhancement] Introduce an integration suite layer for non RSpec specs execution. - [Fix] Add `json` gem as a dependency (was missing but used). ## Rdkafka Changelog / 0.22.2 (2025-07-21) - [Enhancement] Drastically increase number of platforms in the integration suite - [Fix] Support Ubuntu `22.04` and older Alpine precompiled versions - [Fix] FFI::DynamicLibrary.load_library': Could not open library - [Change] Add new CI action to trigger auto-doc refresh. ## Rdkafka Changelog / 0.22.1 (2025-07-17) - [Fix] Fix `Rakefile` being available in the precompiled versions causing build failures. ## Rdkafka Changelog / 0.22.0 (2025-07-17) - **[Feature]** Add precompiled `x86_64-linux-gnu` setup. - **[Feature]** Add precompiled `x86_64-linux-musl` setup. - **[Feature]** Add precompiled `macos_arm64` setup. - [Fix] Fix a case where using empty key on the `musl` architecture would cause a segfault. - [Fix] Fix for null pointer reference bypass on empty string being too wide causing segfault. - [Enhancement] Allow for producing to non-existing topics with `key` and `partition_key` present. - [Enhancement] Replace TTL-based partition count cache with a global cache that reuses `librdkafka` statistics data when possible. - [Enhancement] Support producing and consuming of headers with mulitple values (KIP-82). - [Enhancement] Allow native Kafka customization poll time. - [Enhancement] Roll out experimental jruby support. - [Enhancement] Run all specs on each of the platforms with and without precompilation. - [Enhancement] Support transactional id in the ACL API. - [Fix] Fix issue where post-closed producer C topics refs would not be cleaned. - [Fix] Fiber causes Segmentation Fault. - [Change] Move to trusted-publishers and remove signing since no longer needed. **Note**: Precompiled extensions are a new feature in this release. While they significantly improve installation speed and reduce build dependencies, they should be thoroughly tested in your staging environment before deploying to production. If you encounter any issues with precompiled extensions, you can fall back to building from sources. For more information, see the [Native Extensions](https://karafka.io/docs/Development-Native-Extensions/). ## Rdkafka Changelog / 0.21.0 (2025-02-13) - [Enhancement] Bump librdkafka to `2.8.0` ## Rdkafka Changelog / 0.20.0 (2025-01-07) - **[Breaking]** Deprecate and remove `#each_batch` due to data consistency concerns. - [Enhancement] Bump librdkafka to `2.6.1` - [Enhancement] Expose `rd_kafka_global_init` to mitigate macos forking issues. - [Enhancement] Avoid clobbering LDFLAGS and CPPFLAGS if in a nix prepared environment (secobarbital). - [Patch] Retire no longer needed cooperative-sticky patch. ## Rdkafka Changelog / 0.19.0 (2024-10-01) - **[EOL]** Drop Ruby 3.0 support - [Enhancement] Update `librdkafka` to `2.5.3` - [Enhancement] Use default oauth callback if none is passed (bachmanity1) - [Fix] Fix incorrectly behaving CI on failures. - [Patch] Patch with "Add forward declaration to fix compilation without ssl" fix ## Rdkafka Changelog / 0.18.0 (2024-09-02) - [Enhancement] Update `librdkafka` to `2.5.0` - [Enhancement] Do not release GVL on `rd_kafka_name` (ferrous26) - [Patch] Patch cooperative-sticky assignments in librdkafka. - [Fix] Mitigate a case where FFI would not restart the background events callback dispatcher in forks - [Fix] Fix unused variable reference in producer (lucasmvnascimento) ## Rdkafka Changelog / 0.17.0 (2024-08-03) - [Feature] Add `#seek_by` to be able to seek for a message by topic, partition and offset (zinahia) - [Enhancement] Update `librdkafka` to `2.4.0` - [Enhancement] Support ability to release patches to librdkafka. - [Change] Remove old producer timeout API warnings. - [Fix] Switch to local release of librdkafka to mitigate its unavailability. ## Rdkafka Changelog / 0.16.1 (2024-07-10) - [Fix] Switch to local release of librdkafka to mitigate its unavailability. ## Rdkafka Changelog / 0.16.0 (2024-06-13) - **[EOL]** Retire support for Ruby 2.7. - **[Breaking]** Messages without headers returned by `#poll` contain frozen empty hash. - **[Breaking]** `HashWithSymbolKeysTreatedLikeStrings` has been removed so headers are regular hashes with string keys. - **[Feature]** Support incremental config describe + alter API. - **[Feature]** Oauthbearer token refresh callback (bruce-szalwinski-he) - **[Feature]** Provide ability to use topic config on a producer for custom behaviors per dispatch. - [Enhancement] Use topic config reference cache for messages production to prevent topic objects allocation with each message. - [Enhancement] Provide `Rrdkafka::Admin#describe_errors` to get errors descriptions (mensfeld) - [Enhancement] Replace time poll based wait engine with an event based to improve response times on blocking operations and wait (nijikon + mensfeld) - [Enhancement] Allow for usage of the second regex engine of librdkafka by setting `RDKAFKA_DISABLE_REGEX_EXT` during build (mensfeld) - [Enhancement] name polling Thread as `rdkafka.native_kafka#` (nijikon) - [Enhancement] Save two objects on message produced and lower CPU usage on message produced with small improvements. - [Change] Allow for native kafka thread operations deferring and manual start for consumer, producer and admin. - [Change] The `wait_timeout` argument in `AbstractHandle.wait` method is deprecated and will be removed in future versions without replacement. We don't rely on it's value anymore (nijikon) - [Fix] Background logger stops working after forking causing memory leaks (mensfeld) - [Fix] Fix bogus case/when syntax. Levels 1, 2, and 6 previously defaulted to UNKNOWN (jjowdy) ## Rdkafka Changelog / 0.15.2 (2024-07-10) - [Fix] Switch to local release of librdkafka to mitigate its unavailability. ## Rdkafka Changelog / 0.15.1 (2024-01-30) - [Enhancement] Provide support for Nix OS (alexandriainfantino) - [Enhancement] Replace `rd_kafka_offset_store` with `rd_kafka_offsets_store` (mensfeld) - [Enhancement] Alias `topic_name` as `topic` in the delivery report (mensfeld) - [Enhancement] Provide `label` producer handler and report reference for improved traceability (mensfeld) - [Enhancement] Include the error when invoking `create_result` on producer handle (mensfeld) - [Enhancement] Skip intermediate array creation on delivery report callback execution (one per message) (mensfeld). - [Enhancement] Report `-1` instead of `nil` in case `partition_count` failure (mensfeld). - [Fix] Fix return type on `#rd_kafka_poll` (mensfeld) - [Fix] `uint8_t` does not exist on Apple Silicon (mensfeld) - [Fix] Missing ACL `RD_KAFKA_RESOURCE_BROKER` constant reference (mensfeld) - [Fix] Partition cache caches invalid nil result for `PARTITIONS_COUNT_TTL` (mensfeld) - [Change] Rename `matching_acl_pattern_type` to `matching_acl_resource_pattern_type` to align the whole API (mensfeld) ## Rdkafka Changelog / 0.15.0 (2023-12-03) - **[Feature]** Add `Admin#metadata` (mensfeld) - **[Feature]** Add `Admin#create_partitions` (mensfeld) - **[Feature]** Add `Admin#delete_group` utility (piotaixr) - **[Feature]** Add Create and Delete ACL Feature To Admin Functions (vgnanasekaran) - **[Feature]** Support `#assignment_lost?` on a consumer to check for involuntary assignment revocation (mensfeld) - [Enhancement] Expose alternative way of managing consumer events via a separate queue (mensfeld) - [Enhancement] **Bump** librdkafka to 2.3.0 (mensfeld) - [Enhancement] Increase the `#lag` and `#query_watermark_offsets` default timeouts from 100ms to 1000ms. This will compensate for network glitches and remote clusters operations (mensfeld) - [Change] Use `SecureRandom.uuid` instead of `random` for test consumer groups (mensfeld) ## Rdkafka Changelog / 0.14.1 (2024-07-10) - [Fix] Switch to local release of librdkafka to mitigate its unavailability. ## Rdkafka Changelog / 0.14.0 (2023-11-21) - [Enhancement] Add `raise_response_error` flag to the `Rdkafka::AbstractHandle`. - [Enhancement] Allow for setting `statistics_callback` as nil to reset predefined settings configured by a different gem (mensfeld) - [Enhancement] Get consumer position (thijsc & mensfeld) - [Enhancement] Provide `#purge` to remove any outstanding requests from the producer (mensfeld) - [Enhancement] Update `librdkafka` to `2.2.0` (mensfeld) - [Enhancement] Introduce producer partitions count metadata cache (mensfeld) - [Enhancement] Increase metadata timeout request from `250 ms` to `2000 ms` default to allow for remote cluster operations via `rdkafka-ruby` (mensfeld) - [Enhancement] Introduce `#name` for producers and consumers (mensfeld) - [Enhancement] Include backtrace in non-raised binded errors (mensfeld) - [Fix] Reference to Opaque is not released when Admin, Consumer or Producer is closed (mensfeld) - [Fix] Trigger `#poll` on native kafka creation to handle oauthbearer cb (mensfeld) - [Fix] `#flush` does not handle the timeouts errors by making it return `true` if all flushed or `false` if failed. We do **not** raise an exception here to keep it backwards compatible (mensfeld) - **[EOL]** Remove support for Ruby 2.6 due to it being EOL and WeakMap incompatibilities (mensfeld) - [Change] Update Kafka Docker with Confluent KRaft (mensfeld) - [Change] Update librdkafka repo reference from edenhill to confluentinc (mensfeld) ## Rdkafka Changelog / 0.13.1 (2024-07-10) - [Fix] Switch to local release of librdkafka to mitigate its unavailability. ## Rdkafka Changelog / 0.13.0 (2023-07-24) - Support cooperative sticky partition assignment in the rebalance callback (methodmissing) - Support both string and symbol header keys (ColinDKelley) - Handle tombstone messages properly (kgalieva) - Add topic name to delivery report (maeve) - Allow string partitioner config (mollyegibson) - Fix documented type for DeliveryReport#error (jimmydo) - Bump librdkafka to 2.0.2 (lmaia) - Use finalizers to cleanly exit producer and admin (thijsc) - Lock access to the native kafka client (thijsc) - Fix potential race condition in multi-threaded producer (mensfeld) - Fix leaking FFI resources in specs (mensfeld) - Improve specs stability (mensfeld) - Make metadata request timeout configurable (mensfeld) - call_on_partitions_assigned and call_on_partitions_revoked only get a tpl passed in (thijsc) ## Rdkafka Changelog / 0.12.1 (2024-07-11) - [Fix] Switch to local release of librdkafka to mitigate its unavailability. ## Rdkafka Changelog / 0.12.0 (2022-06-17) - Bumps librdkafka to 1.9.0 - Fix crash on empty partition key (mensfeld) - Pass the delivery handle to the callback (gvisokinskas) ## Rdkafka Changelog / 0.11.0 (2021-11-17) - Upgrade librdkafka to 1.8.2 - Bump supported minimum Ruby version to 2.6 - Better homebrew path detection ## Rdkafka Changelog / 0.10.0 (2021-09-07) - Upgrade librdkafka to 1.5.0 - Add error callback config ## Rdkafka Changelog / 0.9.0 (2021-06-23) - Fixes for Ruby 3.0 - Allow any callable object for callbacks (gremerritt) - Reduce memory allocations in Rdkafka::Producer#produce (jturkel) - Use queue as log callback to avoid unsafe calls from trap context (breunigs) - Allow passing in topic configuration on create_topic (dezka) - Add each_batch method to consumer (mgrosso) ## Rdkafka Changelog / 0.8.1 (2020-12-07) - Fix topic_flag behaviour and add tests for Metadata (geoff2k) - Add topic admin interface (geoff2k) - Raise an exception if @native_kafka is nil (geoff2k) - Option to use zstd compression (jasonmartens) ## Rdkafka Changelog / 0.8.0 (2020-06-02) - Upgrade librdkafka to 1.4.0 - Integrate librdkafka metadata API and add partition_key (by Adithya-copart) - Ruby 2.7 compatibility fix (by Geoff Thé)A - Add error to delivery report (by Alex Stanovsky) - Don't override CPPFLAGS and LDFLAGS if already set on Mac (by Hiroshi Hatake) - Allow use of Rake 13.x and up (by Tomasz Pajor) ## Rdkafka Changelog / 0.7.0 (2019-09-21) - Bump librdkafka to 1.2.0 (by rob-as) - Allow customizing the wait time for delivery report availability (by mensfeld) ## Rdkafka Changelog / 0.6.0 (2019-07-23) - Bump librdkafka to 1.1.0 (by Chris Gaffney) - Implement seek (by breunigs) ## Rdkafka Changelog / 0.5.0 (2019-04-11) - Bump librdkafka to 1.0.0 (by breunigs) - Add cluster and member information (by dmexe) - Support message headers for consumer & producer (by dmexe) - Add consumer rebalance listener (by dmexe) - Implement pause/resume partitions (by dmexe) ## Rdkafka Changelog / 0.4.2 (2019-01-12) - Delivery callback for producer - Document list param of commit method - Use default Homebrew openssl location if present - Consumer lag handles empty topics - End iteration in consumer when it is closed - Add support for storing message offsets - Add missing runtime dependency to rake ## Rdkafka Changelog / 0.4.1 (2018-10-19) - Bump librdkafka to 0.11.6 ## Rdkafka Changelog / 0.4.0 (2018-09-24) - Improvements in librdkafka archive download - Add global statistics callback - Use Time for timestamps, potentially breaking change if you rely on the previous behavior where it returns an integer with the number of milliseconds. - Bump librdkafka to 0.11.5 - Implement TopicPartitionList in Ruby so we don't have to keep track of native objects. - Support committing a topic partition list - Add consumer assignment method ## Rdkafka Changelog / 0.3.5 (2018-01-17) - Fix crash when not waiting for delivery handles - Run specs on Ruby 2.5 ## Rdkafka Changelog / 0.3.4 (2017-12-05) - Bump librdkafka to 0.11.3 ## Rdkafka Changelog / 0.3.3 (2017-10-27) - Fix bug that prevent display of `RdkafkaError` message ## Rdkafka Changelog / 0.3.2 (2017-10-25) - `add_topic` now supports using a partition count - Add way to make errors clearer with an extra message - Show topics in subscribe error message - Show partition and topic in query watermark offsets error message ## Rdkafka Changelog / 0.3.1 (2017-10-23) - Bump librdkafka to 0.11.1 - Officially support ranges in `add_topic` for topic partition list. - Add consumer lag calculator ## Rdkafka Changelog / 0.3.0 (2017-10-17) - Move both add topic methods to one `add_topic` in `TopicPartitionList` - Add committed offsets to consumer - Add query watermark offset to consumer ## Rdkafka Changelog / 0.2.0 (2017-10-13) - Some refactoring and add inline documentation ## Rdkafka Changelog / 0.1.x (2017-09-10) - Initial working version including producing and consuming --- *Last modified: 2026-10-08 18:56:48*