All Apps and Add-ons

JMS Messaging Modular Input: How to create multiple stanzas in inputs.conf to read data from multiple MQ queues?

nagaraju_chitta
Path Finder

Would like to create different stanzas for multiple MQ queues to read the messages. For example inputqueue,outputqueue,etc

Now I have created a [jms] stanzas in inputs.conf file as follows. But if I see in Data Inputs....all the INPUTQUEUES and OUTPUTQUEUES are creating for the sourcetype: OUTPUT_QUEUE.

[jms]
browse_frequency = -1
browse_mode = all
browse_queue_only = 0
durable = 0
hec_batch_mode = 0
hec_https = 0
index = testindex
index_message_header = 0
index_message_properties = 0
init_mode = jndi
jms_connection_factory_name = SplQueueConnectionFactory
jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
jndi_provider_url = file:/D:/mq_Bindings/
output_type = stdout
sourcetype = INPUT_QUEUE
strip_newlines = 1

[jms://queue/thread1:INPUTQUEUE]
disabled = 0
[jms://queue/thread2:INPUTQUEUE]
disabled = 0
[jms://queue/thread3:INPUTQUEUE]
disabled = 0
[jms://queue/thread4:INPUTQUEUE]
disabled = 0

[jms]
browse_frequency = -1
browse_mode = all
browse_queue_only = 0
durable = 0
hec_batch_mode = 0
hec_https = 0
index = testindex
index_message_header = 0
index_message_properties = 0
init_mode = jndi
jms_connection_factory_name = SplQueueConnectionFactory
jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
jndi_provider_url = file:/D:/mq_Bindings/
output_type = stdout
sourcetype = OUTPUT_QUEUE
strip_newlines = 1

[jms://queue/thread1:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread2:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread3:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread4:OUTPUTQUEUE]
disabled = 0

Can anyone suggest how to create multiple stanzas in JMS Modular inputs.conf for multiple MQ Queues to read the data from Multiple MQ Queues.

0 Karma
1 Solution

Damien_Dallimor
Ultra Champion
[jms]
 browse_frequency = -1
 browse_mode = all
 browse_queue_only = 0
 durable = 0
 hec_batch_mode = 0
 hec_https = 0
 index = testindex
 index_message_header = 0
 index_message_properties = 0
 init_mode = jndi
 jms_connection_factory_name = SplQueueConnectionFactory
 jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
 jndi_provider_url = file:/D:/mq_Bindings/
 output_type = stdout
 strip_newlines = 1

 [jms://queue/thread1:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread2:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread3:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread4:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread1:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread2:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread3:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread4:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE

View solution in original post

0 Karma

Damien_Dallimor
Ultra Champion
[jms]
 browse_frequency = -1
 browse_mode = all
 browse_queue_only = 0
 durable = 0
 hec_batch_mode = 0
 hec_https = 0
 index = testindex
 index_message_header = 0
 index_message_properties = 0
 init_mode = jndi
 jms_connection_factory_name = SplQueueConnectionFactory
 jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
 jndi_provider_url = file:/D:/mq_Bindings/
 output_type = stdout
 strip_newlines = 1

 [jms://queue/thread1:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread2:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread3:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread4:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread1:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread2:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread3:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread4:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
0 Karma

nagaraju_chitta
Path Finder

Hi Damien,

Thank you..it is rocking and with the same concept tried to use different index and this is also working. Is it a good practice?

0 Karma

nagaraju_chitta
Path Finder

Hi Damien,

From the above solution I have achieved the required connectivity. But I have an issue.

I am unable to connect more than 20 threads. Could not be able to add more than 20. Kindly Advise

For example: I have
[jms://queue/thread1:INPUTQUEUE]
[jms://queue/thread2:INPUTQUEUE]
[jms://queue/thread3:INPUTQUEUE]
[jms://queue/thread4:INPUTQUEUE]
[jms://queue/thread5:INPUTQUEUE]

[jms://queue/thread6:OUTPUTQUEUE]
[jms://queue/thread7:OUTPUTQUEUE]
[jms://queue/thread8:OUTPUTQUEUE]
[jms://queue/thread9:OUTPUTQUEUE]
[jms://queue/thread10:OUTPUTQUEUE]

[jms://queue/thread11:FAILUREQUEUE]
[jms://queue/thread12:FAILUREQUEUE]
[jms://queue/thread13:FAILUREQUEUE]
[jms://queue/thread14:FAILUREQUEUE]
[jms://queue/thread15:FAILUREQUEUE]

[jms://queue/thread16:FILTERQUEUE]
[jms://queue/thread17:FILTERQUEUE]
[jms://queue/thread18:FILTERQUEUE]
[jms://queue/thread19:FILTERQUEUE]
[jms://queue/thread20:FILTERQUEUE]

0 Karma

Damien_Dallimor
Ultra Champion

Perfectly plausible approach.

0 Karma

nagaraju_chitta
Path Finder

Thanks once again for the confirmation.

0 Karma
Get Updates on the Splunk Community!

Improve Your Security Posture

Watch NowImprove Your Security PostureCustomers are at the center of everything we do at Splunk and security ...

Maximize the Value from Microsoft Defender with Splunk

 Watch NowJoin Splunk and Sens Consulting for this Security Edition Tech TalkWho should attend:  Security ...

This Week's Community Digest - Splunk Community Happenings [6.27.22]

Get the latest news and updates from the Splunk Community here! News From Splunk Answers ✍️ Splunk Answers is ...