IBM App Connect Enterprise (ACE) is a broker for developing and hosting high-throughput, high-scale integrations between a large number of applications and systems, including Apache Kafka.
In this post, I’ll describe how to use App Connect Enterprise to process Kafka messages that were serialized using Apache Avro schemas.
This is an update to an earlier version of this post, reflecting updates to the sample code.
Background
Best practice when using Apache Kafka is to define Apache Avro schemas with a definition of the structure of your Kafka messages, and to store those schemas in a central registry that client applications can access at runtime.
If you want to use IBM App Connect Enterprise to develop and host integrations for processing those Kafka messages, you need App Connect to know how to:
- retrieve the Avro schemas it needs using schema registry REST APIs
- use the schemas to turn the binary stream of bytes on your Kafka topics into structured objects that ACE can manipulate and process
(more…)