Does the AMQP Messaging Modular Input support AVRO as the transport format?

[hsesterhenn_spl]

Hi,

Customer has data in AMQP message bus. Data is encoded using AVRO.
Assume binary format, not JSON.

Questions:

Is there a need for an additional message handler described here?
https://github.com/damiendallimore/SplunkModularInputsJavaFramework/tree/master/amqp/src/com/splunk/...

What about scaling?
If it comes to hundreds of MB per second (>500k messages/second…) how would you architect a scaling ingestion tier?

Thanks,

Holger

[Damien_Dallimor]

1) to decode a binary payload such as Avro you will need to implement a custom message handler , such as this example . There are Avro deserialization libraries available , so this should be quite easy.

2) Read this slide deck from slide 20 to get an idea about horizontal scalability.