All Apps and Add-ons

How I can configure start time in order to avoid duplicates?

rayar
Contributor

We ran the EventHub integration  on HF , after some time we want to move the App to another HF 

How I can configure start time in order to avoid duplicates 

[splunk@ilissplfwd11 local]$ cat inputs.conf
[mscs_azure_event_hub://amdocsazureadlogs]
account = splunk
consumer_group = $Default
event_hub_name = eventhub-name
event_hub_namespace = eventhub-name.servicebus.windows.net
index = amdocsazureadlogs
interval = 15
max_batch_size = 3000
max_wait_time = 10
sourcetype = mscs:azure:eventhub
use_amqp_over_websocket = 1
[splunk@ilissplfwd11 local]$

 

what will be the best configuration to handle a big amount of data  (interval/max_batch_size etc) 

Labels (1)
0 Karma

PaulPanther
Motivator

Could you please check if you can find any checkpoint file under 

$SPLUNK_HOME/var/lib/splunk/modinputs/mscs_azure_event_hub/

If yes that file/these files must be copied to your new HF and the naming must match.  

0 Karma

rayar
Contributor

thanks , it worked for me 

how I can improve the performance , I have a 24H gap now

the HF is running this integration only 

[mscs_azure_event_hub://eventhub]
account = splunk
consumer_group = $Default
event_hub_name = eventhub
event_hub_namespace = eventhub.servicebus.windows.net
index = amdocsazureadlogs
interval = 30
max_batch_size = 2000
max_wait_time = 10
sourcetype = mscs:azure:eventhub
use_amqp_over_websocket = 1
disabled = 0

0 Karma

rayar
Contributor

Hi

Please advise how we can improve the performance

the gap is now 36 hours  

Tags (1)
0 Karma
Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Dynamic formatting from XML events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...