## Libraries and components

- [Karafka](https://github.com/karafka/karafka)
- [Karafka Web UI](https://github.com/karafka/karafka-web)
- [WaterDrop](https://github.com/karafka/waterdrop)
- [Karafka-Testing](https://github.com/karafka/karafka-testing)
- [Karafka-Core](https://github.com/karafka/karafka-core)
- [Karafka Rdkafka](https://github.com/karafka/karafka-rdkafka)
- [Rdkafka-Ruby](https://github.com/karafka/rdkafka-ruby)
- [Apache Kafka](http://kafka.apache.org/)
- [librdkafka](https://github.com/edenhill/librdkafka)

## Libraries and components / Articles and references about Karafka

!!! note

    Some of those might be outdated and may refer to previous Karafka versions. Keep that in mind.

- [WaterDrop Meets Ruby’s Async Ecosystem: Lightweight Concurrency Done Right](https://mensfeld.pl/2025/09/ruby-async-waterdrop-concurrency/)
- [The 60-Second Wait: How I Spent Months Solving the Ruby’s Most Annoying Gem Installation Problem](https://mensfeld.pl/2025/07/solving-ruby-rdkafka-installation-problem/)
- [Deimos — The Journey to Karafka](https://medium.com/@dmorner/deimos-the-journey-to-karafka-9a26daf42678)
- [Under the Hood: Enhancing Karafka’s CPU and Memory Efficiency](https://mensfeld.pl/2024/08/under-the-hood-enhancing-karafkas-cpu-and-memory-efficiency/)
- [The librdkafka Supply Chain Breakdown: rdkafka-ruby’s Darkest Hour](https://mensfeld.pl/2024/07/the-librdkafka-supply-chain-breakdown-rdkafka-rubys-darkest-hour/)
- [From Sleep to Speed: Making Rdkafka Sync Operations 16 Times Faster](https://mensfeld.pl/2024/05/from-sleep-to-speed-making-rdkafka-sync-operations-16-times-faster/)
- [Karafka 2.5 and Web UI 0.11: Next-Gen Consumer Control and Operational Excellence](https://mensfeld.pl/2025/06/karafka-2-5-and-web-ui-0-11-next-gen-consumer-control-and-operational-excellence/)
- [Karafka 2.4 Release Announcement: Advancing Kafka Processing for Ruby and Rails](https://mensfeld.pl/2024/04/karafka-2-4-release-announcement-advancing-kafka-processing-for-ruby-and-rails/)
- [Refactoring in Practice (Using Kafka and Karafka)](https://remimercier.com/refactoring-in-practice/)
- [Karafka Framework 2.3 + Web UI 0.8 Release Announcement](https://mensfeld.pl/2024/01/karafka-framework-2-3-web-ui-0-8-release-announcement/)
- [The Art of Forking: Unlocking Scalability in Ruby (Swarm)](https://mensfeld.pl/2024/02/the-art-of-forking-unlocking-scalability-in-ruby/)
- [Karafka framework 2.1 announcement](https://mensfeld.pl/2023/06/karafka-framework-2-1-announcement/)
- [Karafka Web UI announcement](https://mensfeld.pl/2023/02/karafka-web-ui-your-ruby-and-rails-out-of-the-box-kafka-ui/)
- [Karafka framework 2.0 announcement](https://mensfeld.pl/2022/08/karafka-framework-2-0-announcement/)
- [Monitoring Karafka Jobs Progress Using Web UI](https://mensfeld.pl/2023/10/monitoring-karafka-jobs-progress-using-web-ui/)
- [Enhancing Data Reliability Through Transactional Offsets with Karafka](https://mensfeld.pl/2023/06/inside-kafka-enhancing-data-reliability-through-transactional-offsets-with-karafka/)
- [Delaying Kafka Messages Processing with Karafka: A Deep Dive into Delayed Topics](https://mensfeld.pl/2023/04/delaying-kafka-messages-processing-with-karafka-a-deep-dive-into-delayed-topics/)
- [Kafka topics as a code – declarative Kafka topics management in Ruby](https://mensfeld.pl/2023/03/kafka-topics-as-a-code-declarative-kafka-topics-management-in-ruby/)
- [Batch Processing with Kafka using Karafka Batch](https://mamxalf.medium.com/batch-processing-with-kafka-using-karafka-batch-ac42b6e4a4a0)
- [Integration Patterns for Distributed Architecture - Intro to Kafka](https://www.smily.com/engineering/integration-patterns-for-distributed-architecture-intro-to-kafka)
- [Add a Kafka Consumer to Rails](https://danielabaron.me/blog/rails-kafka-consumer/)
- [An alternative approach to custom partition assignment strategy for Kafka consumers with Karafka](https://karolgalanciak.com/blog/2022/12/11/an-alternative-approach-to-custom-partition-assignment-strategy-for-kafka-consumers-with-karafka/)
- [Kafka on Rails: Using Kafka with Ruby on Rails - Part 1 - Kafka basics and its advantages](https://mensfeld.pl/2017/11/kafka-on-rails-using-kafka-with-ruby-on-rails-part-1-kafka-basics-and-its-advantages/)
- [Kafka on Rails: Using Kafka with Ruby on Rails - Part 2 - Getting started with Rails and Kafka](https://mensfeld.pl/2018/01/kafka-on-rails-using-kafka-with-ruby-on-rails-part-2-getting-started-with-ruby-and-kafka/)
- [Karafka example applications](https://github.com/karafka/example-apps)
- [Karafka (Ruby + Kafka) framework 1.4.0 Release Notes](https://mensfeld.pl/2020/09/karafka-framework-1-4-0-release-notes-ruby-kafka/)
- [Karafka (Ruby + Kafka) framework 1.3.0 Release Notes](https://mensfeld.pl/2019/09/karafka-framework-1-3-0-release-notes-ruby-kafka/)
- [Karafka – Ruby micro-framework for building Apache Kafka message-based applications](http://dev.mensfeld.pl/2015/08/karafka-ruby-micro-framework-for-building-apache-kafka-message-based-applications/)
- [Benchmarking Karafka – how does it handle multiple TCP connections](http://dev.mensfeld.pl/2015/11/benchmarking-karafka-how-does-it-handle-multiple-tcp-connections/)
- [Reduce your method calls by 99.9% by replacing Thread#pass with Queue#pop](https://mensfeld.pl/2022/01/reduce-your-method-calls-by-99-9-by-replacing-threadpass-with-queuepop/)
- [Karafka – Ruby framework for building Kafka message based applications (presentation)](http://mensfeld.github.io/karafka-framework-introduction/)

## Libraries and components / Videos

- [Startup Speed, Enterprise Scale: Rails Powers 3k Events/Sec Throughput - Doximity](https://www.youtube.com/watch?v=YUaE4niST-k)
- [RailsConf 2025 The Past, Present and Future of Background Jobs](https://www.youtube.com/watch?v=xf5mrEu5190)
- [Kafka with Ruby on Rails by CJ Avilla](https://www.youtube.com/watch?v=gXz1YtfeiJk)
- [RailsConf 2023 - Applying microservices patterns to a modular monolith by Guillermo Aguirre](https://www.youtube.com/watch?v=4zrQAJ0RlI4)
- [RubyConfTH 2023 - Event Streaming Patterns for Ruby Services by Brad Urani](https://www.youtube.com/watch?v=RBj4S9S-fJI)
- [Kafka For Rubyists YouTube series by Karol Galanciak](https://www.youtube.com/watch?v=OK8k-krza0Y&list=PLOnisdeJdKQ2jiUfFW-Lq4LZI3vovwVg5)
- [RedDotRubyConf 2017 - Spinning up micro-services using Ruby/Kafka by Ankita Gupta](https://www.youtube.com/watch?v=jGoVOJl7vZ4)
- [Pivorak - Karafka - Getting beyond HTTP by Maciej Mensfeld](https://www.youtube.com/watch?v=4o7LcBO_RkE)

## Libraries and components / General articles and references about working with Apache Kafka

- [Kafka topic naming conventions - 5 recommendations with examples](https://www.kadeck.com/blog/kafka-topic-naming-conventions-5-recommendations-with-examples)
- [Kafka Topic Naming Conventions](https://cnr.sh/essays/how-paint-bike-shed-kafka-topic-naming-conventions)
- [Should You Put Several Event Types in the Same Kafka Topic?](https://www.confluent.io/blog/put-several-event-types-kafka-topic/)
- [Kafka topic creation best-practice](https://stackoverflow.com/questions/48498414/kafka-topic-creation-best-practice)


---

*Last modified: 2025-09-26 21:19:28*