MemQ is a new PubSub system that augments Kafka

Last update: Dec 30, 2022

Related tags

Overview

MemQ: An efficient, scalable cloud native PubSub system

MemQ is a new PubSub system that augments Kafka at Pinterest. It uses a decoupled storage and serving architecture similar to Apache Pulsar and Facebook Logdevice; however, it relies on a pluggable replicated storage layer i.e. Object Store / DFS / NFS for storing data. The net result is a PubSub system that:

Handles GB/s traffic
Independently scales, writes, and reads
Doesn’t require expensive rebalancing to handle traffic growth
Is 90% more cost effective than our Kafka footprint

Getting Started

Checkout our Getting Started Guide

Usage

MemQ can be a valuable PubSub choice for the following use case families:

Large scale data ingestion
Bulk uploads
Near Real Time Analytics

Design

Detailed architecture docs can be found here

Blog

Please checkout the original MemQ blog for details and background.

Authors

Ambud Sharma

Ping Min-Lin

See contributors

License

MemQ distributed under Apache License, Version 2.0

Comments

Bump jackson-databind from 2.9.7 to 2.13.4.1 in /memq
Bumps jackson-databind from 2.9.7 to 2.13.4.1.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1
Bump jackson-databind from 2.9.7 to 2.12.6.1 in /memq
Bumps jackson-databind from 2.9.7 to 2.12.6.1.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1
Connection load balancing (Phase 1)

This PR introduces simple pluggable connection load balancing mechanisms. A new response code RECONNECT (303) is introduced to indicate that the server indicates that the packet to be dropped by the client and the client should upload the packet to another broker. Metric-based load balancing is still not available and will be added in the future. Currently there are several existing corner cases that might cause excessive connection closing (which already exists in the previous clients) and should be fixed in the future.

All tests have passed locally.

The original topic assignment balancer has been renamed to TopicAssigner to distinguish the topic and connection balancers.

opened by kabochya 1
Bump jackson-databind from 2.9.7 to 2.9.10.8 in /memq
Bumps jackson-databind from 2.9.7 to 2.9.10.8.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1
Optimize file system reads in MemQ to leverage channels to reduce memory copy

Optimize file system reads in MemQ to leverage channels and reduce memory copy by passing buffer to persistence layer directly and leveraging channels.

opened by ambud 0
Connection load balancing (Phase 1)

This PR introduces simple pluggable connection load balancing mechanisms. A new response code RECONNECT (303) is introduced to indicate that the server indicates that the packet to be dropped by the client and the client should upload the packet to another broker. Metric-based load balancing is still not available and will be added in the future. Currently there are several existing corner cases that might cause excessive connection closing (which already exists in the previous clients) and should be fixed in the future.

All tests have passed locally.

The original topic assignment balancer has been renamed to TopicAssigner to distinguish the topic and connection balancers.

opened by kabochya 0
Bump reactor-netty-http from 1.0.18 to 1.0.24 in /memq-commons
Bumps reactor-netty-http from 1.0.18 to 1.0.24.

Release notes

Sourced from reactor-netty-http's releases.

v1.0.24

Reactor Netty 1.0.24 is part of 2020.0.24 Release Train.

This is a recommended update for all Reactor Netty 1.0.x users.

What's Changed

:sparkles: New features and improvements

Depend on Reactor Core v3.4.24 by @chemicL in b820698cdd712ebac74530b1e7909a0823186d4e, see release notes.

Depend on Netty v4.1.82.Final by @violetagg in #2482

Depend on Netty QUIC Codec v0.0.33.Final by @violetagg in #2522

Set the trailing headers directly when constructing DefaultLastHttpContent by @violetagg in #2495

Defer the creation of the request/response object by @violetagg in #2496

Support HTTP errors 414 and 431 by @yuzawa-san in #2534

:lady_beetle: Bug fixes

Ensure HttpClientConfig#connectionProvider returns the original provider used to create HttpClient by @violetagg in #2483

Get SslHandler by name for ALPN in HttpClientChannelInitializer by @j-bahr in #2488

Close connection when a TLS close_notify is received and acknowledged by @pderop in #2518

Check for log level by @violetagg in #2528

Ensure logs are prefixed with channel information when possible by @violetagg in #2529

:book: Documentation, Tests and Build

Documentation:

Add missing package-info.java by @violetagg in #2530

Tests:

Ensure HTTP/2 tests comply with RFC requirements for HTTP/2 headers by @violetagg in #2501

Build:

Improve JapiCmp: avoid misses, improve reporting and exclusions by @simonbasle in #2497

:up: Dependency Upgrades

Bump com.diffplug.spotless to version 6.11.0 by @dependabot in #2487

Bump junit-platform-launcher to version 1.9.1 by @dependabot in #2493

Bump junitVersion to version 5.9.1 by @dependabot in #2494

Bump build-info-extractor-gradle to version 4.29.1 by @dependabot in #2512

Bump de.undercouch.download to version 5.2.1 by @dependabot in #2513

Bump braveVersion to version 5.14.1 by @dependabot in #2521

Bump tomcat-embed-core to version 9.0.68 by @dependabot in #2537

Full Changelog: https://github.com/reactor/reactor-netty/compare/v1.0.23...v1.0.24

v1.0.23

Reactor Netty 1.0.23 is part of 2020.0.23 Release Train.

This is a recommended update for all Reactor Netty 1.0.x users.

... (truncated)

Commits

b820698 [release] Prepare and release 1.0.24

a29aa82 Support HTTP errors 414 and 431 (#2534)

e898075 Bump tomcat-embed-core from 9.0.67 to 9.0.68 (#2537)

85e556d Polish

890e322 Polish

1afda75 Cleaning up logs

45f6ce8 Add missing package-info.java (#2530)

8fd5fc6 Ensure logs are prefixed with channel information when possible (#2529)

9662c6f Check for log level (#2528)

3723877 Polish

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 0
Bump jackson-databind from 2.9.7 to 2.12.7.1 in /memq
Bumps jackson-databind from 2.9.7 to 2.12.7.1.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 0
Bump gson from 2.8.6 to 2.8.9 in /memq-commons
Bumps gson from 2.8.6 to 2.8.9.

Release notes

Sourced from gson's releases.

Gson 2.8.9

Make OSGi bundle's dependency on sun.misc optional (#1993).

Deprecate Gson.excluder() exposing internal Excluder class (#1986).

Prevent Java deserialization of internal classes (#1991).

Improve number strategy implementation (#1987).

Fix LongSerializationPolicy null handling being inconsistent with Gson (#1990).

Support arbitrary Number implementation for Object and Number deserialization (#1290).

Bump proguard-maven-plugin from 2.4.0 to 2.5.1 (#1980).

Don't exclude static local classes (#1969).

Fix RuntimeTypeAdapterFactory depending on internal Streams class (#1959).

Improve Maven build (#1964).

Make dependency on java.sql optional (#1707).

Gson 2.8.8

Fixed issue with recursive types (#1390).

Better behaviour with Java 9+ and Unsafe if there is a security manager (#1712).

EnumTypeAdapter now works better when ProGuard has obfuscated enum fields (#1495).

Changelog

Sourced from gson's changelog.

Version 2.8.9

Make OSGi bundle's dependency on sun.misc optional (#1993).

Deprecate Gson.excluder() exposing internal Excluder class (#1986).

Prevent Java deserialization of internal classes (#1991).

Improve number strategy implementation (#1987).

Fix LongSerializationPolicy null handling being inconsistent with Gson (#1990).

Support arbitrary Number implementation for Object and Number deserialization (#1290).

Bump proguard-maven-plugin from 2.4.0 to 2.5.1 (#1980).

Don't exclude static local classes (#1969).

Fix RuntimeTypeAdapterFactory depending on internal Streams class (#1959).

Improve Maven build (#1964).

Make dependency on java.sql optional (#1707).

Version 2.8.8

Fixed issue with recursive types (#1390).

Better behaviour with Java 9+ and Unsafe if there is a security manager (#1712).

EnumTypeAdapter now works better when ProGuard has obfuscated enum fields (#1495).

Version 2.8.7

Fixed ISO8601UtilsTest failing on systems with UTC+X.

Improved javadoc for JsonStreamParser.

Updated proguard.cfg (#1693).

Fixed IllegalStateException in JsonTreeWriter (#1592).

Added JsonArray.isEmpty() (#1640).

Added new test cases (#1638).

Fixed OSGi metadata generation to work on JavaSE < 9 (#1603).

Commits

6a368d8 [maven-release-plugin] prepare release gson-parent-2.8.9

ba96d53 Fix missing bounds checks for JsonTreeReader.getPath() (#2001)

ca1df7f #1981: Optional OSGi bundle's dependency on sun.misc package (#1993)

c54caf3 Deprecate Gson.excluder() exposing internal Excluder class (#1986)

e6fae59 Prevent Java deserialization of internal classes (#1991)

bda2e3d Improve number strategy implementation (#1987)

cd748df Fix LongSerializationPolicy null handling being inconsistent with Gson (#1990)

fe30b85 Support arbitrary Number implementation for Object and Number deserialization...

1cc1627 Fix incorrect feature request template label (#1982)

7b9a283 Bump bnd-maven-plugin from 5.3.0 to 6.0.0 (#1985)

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 0

Releases(0.2.18)

0.2.18(Dec 6, 2022)
This is the first MemQ release with artifacts published to Maven Central. Please note that the shaded jars have not been published.

<dependency> <groupId>com.pinterest.memq</groupId> <artifactId>memq</artifactId> <version>0.2.18</version> </dependency>
Source code(tar.gz)
Source code(zip)

Owner

Pinterest's Open Source Projects

GitHub

A template and introduction for the first kafka stream application. The readme file contains all the required commands to run the Kafka cluster from Scrach

Kafka Streams Template Maven Project This project will be used to create the followings: A Kafka Producer Application that will start producing random

2 Jan 10, 2022

Demo project for Kafka Ignite streamer, Kafka as source and Ignite cache as sink

ignite-kafka-streamer **Description : Demo project for Kafka Ignite streamer, Kafka as source and Ignite cache as sink Step-1) Run both Zookeeper and

1 Feb 1, 2022

Kafka example - a simple producer and consumer for kafka using spring boot + java

1 Feb 18, 2022

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

Nakadi Event Broker Nakadi is a distributed event bus broker that implements a RESTful API abstraction on top of Kafka-like queues, which can be used

866 Dec 21, 2022

Mirror of Apache Kafka

Apache Kafka See our web site for details on the project. You need to have Java installed. We build and test Apache Kafka with Java 8, 11 and 15. We s

23.9k Jan 5, 2023

Fast and reliable message broker built on top of Kafka.

Hermes Hermes is an asynchronous message broker built on top of Kafka. We provide reliable, fault tolerant REST interface for message publishing and a

742 Jan 3, 2023

Kryptonite is a turn-key ready transformation (SMT) for Apache Kafka® Connect to do field-level 🔒 encryption/decryption 🔓 of records. It's an UNOFFICIAL community project.

Kryptonite - An SMT for Kafka Connect Kryptonite is a turn-key ready transformation (SMT) for Apache Kafka® to do field-level encryption/decryption of

53 Jan 3, 2023

Dataflow template which read data from Kafka (Support SSL), transform, and outputs the resulting records to BigQuery

Kafka to BigQuery Dataflow Template The pipeline template read data from Kafka (Support SSL), transform the data and outputs the resulting records to

12 Jun 1, 2021

A command line client for Kafka Connect

kcctl -- A CLI for Apache Kafka Connect This project is a command-line client for Kafka Connect. Relying on the idioms and semantics of kubectl, it al

274 Dec 19, 2022

A command line client for Kafka Connect

?? kcctl – Your Cuddly CLI for Apache Kafka Connect This project is a command-line client for Kafka Connect. Relying on the idioms and semantics of ku

274 Dec 19, 2022

Publish Kafka messages from HTTP

Kafka Bridge Publish Kafka messages from HTTP Configuration Example configuration for commonly used user + password authentication: kafka-bridge: ka

4 Nov 9, 2021

Implementação de teste com Kafka

TesteKafka01 Implementação de teste com Kafka Projeto criado para estudo e testes com Kafka Recursos que estarão disponiveis: -Envio de msg -Recebe Ms

3 Sep 17, 2021

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Firehose - Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

279 Dec 22, 2022

KC4Streams - a simple Java library that provides utility classes and standard implementations for most of the Kafka Streams pluggable interfaces

KC4Streams (which stands for Kafka Commons for Streams) is a simple Java library that provides utility classes and standard implementations for most of the Kafka Streams pluggable interfaces.

2 Mar 2, 2022

Output Keycloak Events and Admin Events to a Kafka topic.

keycloak-kafka-eventlistener Output Keycloak Events and Admin Events to a Kafka topic. Based on Keycloak 15.0.2+ / RH-SSO 7.5.0+ How to use the plugin

4 Oct 10, 2022

Aula sobre segurança no kafka usando SSL

Kafka4Devs - Segurança no Kafka com SSL Você sabe o que acontece por debaixo dos panos de uma aplicação segura? Sabe como empresas grandes que utiliza

4 Feb 28, 2022

Apache Pulsar - distributed pub-sub messaging system

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API. Learn more about Pulsar at https:

12.1k Jan 4, 2023

HornetQ is an open source project to build a multi-protocol, embeddable, very high performance, clustered, asynchronous messaging system.

HornetQ If you need information about the HornetQ project please go to http://community.jboss.org/wiki/HornetQ http://www.jboss.org/hornetq/ This file

245 Dec 3, 2022

A high available,high performance distributed messaging system.

#新闻 MetaQ 1.4.6.2发布。更新日志 MetaQ 1.4.6.1发布。更新日志 MetaQ 1.4.5.1发布。更新日志 MetaQ 1.4.5发布。更新日志 Meta-ruby 0.1 released: a ruby client for metaq. SOURCE #介绍 Meta

1.3k Dec 12, 2022

MemQ is a new PubSub system that augments Kafka

Related tags

Overview

MemQ: An efficient, scalable cloud native PubSub system

Getting Started

Usage

Design

Blog

Authors

License

Comments

v1.0.24

What's Changed

:sparkles: New features and improvements

:lady_beetle: Bug fixes

:book: Documentation, Tests and Build

:up: Dependency Upgrades

v1.0.23

Gson 2.8.9

Gson 2.8.8

Version 2.8.9

Version 2.8.8

Version 2.8.7

Releases(0.2.18)

0.2.18(Dec 6, 2022)

Owner

Pinterest

A template and introduction for the first kafka stream application. The readme file contains all the required commands to run the Kafka cluster from Scrach

Demo project for Kafka Ignite streamer, Kafka as source and Ignite cache as sink

Kafka example - a simple producer and consumer for kafka using spring boot + java

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

Mirror of Apache Kafka

Fast and reliable message broker built on top of Kafka.

Kryptonite is a turn-key ready transformation (SMT) for Apache Kafka® Connect to do field-level 🔒 encryption/decryption 🔓 of records. It's an UNOFFICIAL community project.

Dataflow template which read data from Kafka (Support SSL), transform, and outputs the resulting records to BigQuery

A command line client for Kafka Connect

A command line client for Kafka Connect

Publish Kafka messages from HTTP

Implementação de teste com Kafka

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

KC4Streams - a simple Java library that provides utility classes and standard implementations for most of the Kafka Streams pluggable interfaces

Output Keycloak Events and Admin Events to a Kafka topic.

Aula sobre segurança no kafka usando SSL

Apache Pulsar - distributed pub-sub messaging system

HornetQ is an open source project to build a multi-protocol, embeddable, very high performance, clustered, asynchronous messaging system.

A high available,high performance distributed messaging system.