All Apps and Add-ons

JMS Messaging Modular Input: How to create multiple stanzas in inputs.conf to read data from multiple MQ queues?

nagaraju_chitta
Path Finder

Would like to create different stanzas for multiple MQ queues to read the messages. For example inputqueue,outputqueue,etc

Now I have created a [jms] stanzas in inputs.conf file as follows. But if I see in Data Inputs....all the INPUTQUEUES and OUTPUTQUEUES are creating for the sourcetype: OUTPUT_QUEUE.

[jms]
browse_frequency = -1
browse_mode = all
browse_queue_only = 0
durable = 0
hec_batch_mode = 0
hec_https = 0
index = testindex
index_message_header = 0
index_message_properties = 0
init_mode = jndi
jms_connection_factory_name = SplQueueConnectionFactory
jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
jndi_provider_url = file:/D:/mq_Bindings/
output_type = stdout
sourcetype = INPUT_QUEUE
strip_newlines = 1

[jms://queue/thread1:INPUTQUEUE]
disabled = 0
[jms://queue/thread2:INPUTQUEUE]
disabled = 0
[jms://queue/thread3:INPUTQUEUE]
disabled = 0
[jms://queue/thread4:INPUTQUEUE]
disabled = 0

[jms]
browse_frequency = -1
browse_mode = all
browse_queue_only = 0
durable = 0
hec_batch_mode = 0
hec_https = 0
index = testindex
index_message_header = 0
index_message_properties = 0
init_mode = jndi
jms_connection_factory_name = SplQueueConnectionFactory
jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
jndi_provider_url = file:/D:/mq_Bindings/
output_type = stdout
sourcetype = OUTPUT_QUEUE
strip_newlines = 1

[jms://queue/thread1:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread2:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread3:OUTPUTQUEUE]
disabled = 0
[jms://queue/thread4:OUTPUTQUEUE]
disabled = 0

Can anyone suggest how to create multiple stanzas in JMS Modular inputs.conf for multiple MQ Queues to read the data from Multiple MQ Queues.

0 Karma
1 Solution

Damien_Dallimor
Ultra Champion
[jms]
 browse_frequency = -1
 browse_mode = all
 browse_queue_only = 0
 durable = 0
 hec_batch_mode = 0
 hec_https = 0
 index = testindex
 index_message_header = 0
 index_message_properties = 0
 init_mode = jndi
 jms_connection_factory_name = SplQueueConnectionFactory
 jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
 jndi_provider_url = file:/D:/mq_Bindings/
 output_type = stdout
 strip_newlines = 1

 [jms://queue/thread1:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread2:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread3:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread4:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread1:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread2:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread3:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread4:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE

View solution in original post

0 Karma

Damien_Dallimor
Ultra Champion
[jms]
 browse_frequency = -1
 browse_mode = all
 browse_queue_only = 0
 durable = 0
 hec_batch_mode = 0
 hec_https = 0
 index = testindex
 index_message_header = 0
 index_message_properties = 0
 init_mode = jndi
 jms_connection_factory_name = SplQueueConnectionFactory
 jndi_initialcontext_factory = com.sun.jndi.fscontext.RefFSContextFactory
 jndi_provider_url = file:/D:/mq_Bindings/
 output_type = stdout
 strip_newlines = 1

 [jms://queue/thread1:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread2:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread3:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread4:INPUTQUEUE]
 disabled = 0
 sourcetype = INPUT_QUEUE
 [jms://queue/thread1:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread2:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread3:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
 [jms://queue/thread4:OUTPUTQUEUE]
 disabled = 0
 sourcetype = OUTPUT_QUEUE
0 Karma

nagaraju_chitta
Path Finder

Hi Damien,

Thank you..it is rocking and with the same concept tried to use different index and this is also working. Is it a good practice?

0 Karma

nagaraju_chitta
Path Finder

Hi Damien,

From the above solution I have achieved the required connectivity. But I have an issue.

I am unable to connect more than 20 threads. Could not be able to add more than 20. Kindly Advise

For example: I have
[jms://queue/thread1:INPUTQUEUE]
[jms://queue/thread2:INPUTQUEUE]
[jms://queue/thread3:INPUTQUEUE]
[jms://queue/thread4:INPUTQUEUE]
[jms://queue/thread5:INPUTQUEUE]

[jms://queue/thread6:OUTPUTQUEUE]
[jms://queue/thread7:OUTPUTQUEUE]
[jms://queue/thread8:OUTPUTQUEUE]
[jms://queue/thread9:OUTPUTQUEUE]
[jms://queue/thread10:OUTPUTQUEUE]

[jms://queue/thread11:FAILUREQUEUE]
[jms://queue/thread12:FAILUREQUEUE]
[jms://queue/thread13:FAILUREQUEUE]
[jms://queue/thread14:FAILUREQUEUE]
[jms://queue/thread15:FAILUREQUEUE]

[jms://queue/thread16:FILTERQUEUE]
[jms://queue/thread17:FILTERQUEUE]
[jms://queue/thread18:FILTERQUEUE]
[jms://queue/thread19:FILTERQUEUE]
[jms://queue/thread20:FILTERQUEUE]

0 Karma

Damien_Dallimor
Ultra Champion

Perfectly plausible approach.

0 Karma

nagaraju_chitta
Path Finder

Thanks once again for the confirmation.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...