All Apps and Add-ons

JMS Messaging Modular Input: How to create multiple stanzas in inputs.conf to read data from multiple MQ queues?

nagaraju_chitta
Path Finder

Would like to create different stanzas for multiple MQ queues to read the messages. For example inputqueue,outputqueue,etc

Now I have created a [jms] stanzas in inputs.conf file as follows. But if I see in Data Inputs....all the INPUTQUEUES and OUTPUTQUEUES are creating for the sourcetype: OUTPUT_QUEUE.

[jms]
browse_frequency = -1
browse_mode = all
browse_queue_only = 0
durable = 0
hec_batch_mode = 0
hec_https = 0
index = testindex
index_message_header = 0
index_message_properties = 0
init_mode = jndi
jms_connection_factory_name = SplQueueConnectionFactory
jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
jndi_provider_url = file:/D:/mq_Bindings/
output_type = stdout
sourcetype = INPUT_QUEUE
strip_newlines = 1

[jms://queue/thread1:INPUTQUEUE]
disabled = 0
[jms://queue/thread2:INPUTQUEUE]
disabled = 0
[jms://queue/thread3:INPUTQUEUE]
disabled = 0
[jms://queue/thread4:INPUTQUEUE]
disabled = 0

[jms]
browse_frequency = -1
browse_mode = all
browse_queue_only = 0
durable = 0
hec_batch_mode = 0
hec_https = 0
index = testindex
index_message_header = 0
index_message_properties = 0
init_mode = jndi
jms_connection_factory_name = SplQueueConnectionFactory
jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
jndi_provider_url = file:/D:/mq_Bindings/
output_type = stdout
sourcetype = OUTPUT_QUEUE
strip_newlines = 1

[jms://queue/thread1:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread2:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread3:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread4:OUTPUTQUEUE]
disabled = 0

Can anyone suggest how to create multiple stanzas in JMS Modular inputs.conf for multiple MQ Queues to read the data from Multiple MQ Queues.

0 Karma
1 Solution

Damien_Dallimor
Ultra Champion
[jms]
 browse_frequency = -1
 browse_mode = all
 browse_queue_only = 0
 durable = 0
 hec_batch_mode = 0
 hec_https = 0
 index = testindex
 index_message_header = 0
 index_message_properties = 0
 init_mode = jndi
 jms_connection_factory_name = SplQueueConnectionFactory
 jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
 jndi_provider_url = file:/D:/mq_Bindings/
 output_type = stdout
 strip_newlines = 1

 [jms://queue/thread1:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread2:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread3:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread4:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread1:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread2:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread3:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread4:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE

View solution in original post

0 Karma

Damien_Dallimor
Ultra Champion
[jms]
 browse_frequency = -1
 browse_mode = all
 browse_queue_only = 0
 durable = 0
 hec_batch_mode = 0
 hec_https = 0
 index = testindex
 index_message_header = 0
 index_message_properties = 0
 init_mode = jndi
 jms_connection_factory_name = SplQueueConnectionFactory
 jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
 jndi_provider_url = file:/D:/mq_Bindings/
 output_type = stdout
 strip_newlines = 1

 [jms://queue/thread1:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread2:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread3:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread4:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread1:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread2:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread3:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread4:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
0 Karma

nagaraju_chitta
Path Finder

Hi Damien,

Thank you..it is rocking and with the same concept tried to use different index and this is also working. Is it a good practice?

0 Karma

nagaraju_chitta
Path Finder

Hi Damien,

From the above solution I have achieved the required connectivity. But I have an issue.

I am unable to connect more than 20 threads. Could not be able to add more than 20. Kindly Advise

For example: I have
[jms://queue/thread1:INPUTQUEUE]
[jms://queue/thread2:INPUTQUEUE]
[jms://queue/thread3:INPUTQUEUE]
[jms://queue/thread4:INPUTQUEUE]
[jms://queue/thread5:INPUTQUEUE]

[jms://queue/thread6:OUTPUTQUEUE]
[jms://queue/thread7:OUTPUTQUEUE]
[jms://queue/thread8:OUTPUTQUEUE]
[jms://queue/thread9:OUTPUTQUEUE]
[jms://queue/thread10:OUTPUTQUEUE]

[jms://queue/thread11:FAILUREQUEUE]
[jms://queue/thread12:FAILUREQUEUE]
[jms://queue/thread13:FAILUREQUEUE]
[jms://queue/thread14:FAILUREQUEUE]
[jms://queue/thread15:FAILUREQUEUE]

[jms://queue/thread16:FILTERQUEUE]
[jms://queue/thread17:FILTERQUEUE]
[jms://queue/thread18:FILTERQUEUE]
[jms://queue/thread19:FILTERQUEUE]
[jms://queue/thread20:FILTERQUEUE]

0 Karma

Damien_Dallimor
Ultra Champion

Perfectly plausible approach.

0 Karma

nagaraju_chitta
Path Finder

Thanks once again for the confirmation.

0 Karma
Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...