Knowledge Management

Forwarding data to dynamic IPs

av_
Path Finder

I am trying to forward data from UF to few indexers but the indexes have dynamic IPs which keep changing. Now, how does the UF know where to forward the data
How can I tackle this problem?

Also, can someone explain what is a smartstore & how does it work?

Labels (1)
0 Karma

hrawat
Splunk Employee
Splunk Employee

If there is a NLB in between UF/HF and indexing tier, you don't have to worry as DNS should return static IPs for NLB.
If there is no NLB in between UF/HF and indexing tier and you are banking on DNS to return dynamic IPs and your possible outputs.conf config is

 

server=<DNS alias for dynamic idx IPs>:<splunktcp port>

 

you must reduce dnsResolutionInterval in outputs.conf as low as possible. It will decide how fast new dynamic IPs picked by UF/HF.

0 Karma

deepakc
Builder

I've never come across an Splunk environment that uses dynamic IP's for indexers (might be asking for trouble) , but there may be some use cases, I don't know, probably cloud environments. Normally one would use static IP's and DNS service and name's for UF to Indexers communications. You would then configure your outputs.conf with those DNS names. The UF's have inbuilt functionality to spray portions of the data across the Indexers. So DNS may be the way forward for you. 

Example outputs.conf 

 

[tcpout]
defaultGroup = my_indexers

[tcpout:my_indexers]
server = indexer1.example.com:9997, indexer2.example.com:9997 

 

If using Indexer cluster, you can use the Cluster Master Discovery Option - Read all about it here. 

https://docs.splunk.com/Documentation/Splunk/9.2.1/Indexer/indexerdiscovery 

 

Regarding Smart Store - Read all about it here. 

https://docs.splunk.com/Documentation/Splunk/9.2.1/Indexer/AboutSmartStore 

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...