Getting Data In

To use or not to use TCP as input method?

samiomer
Path Finder

Hi all,

I have a few custom remote sensors that I would like Splunk to monitor. These sensors do not use files or TCP to log (they use other forms like web services and other distributed messaging systems).

So, my question is, what would make the most sense in converting these logs? Should I write them to disk and have splunk monitor them as files or should I transport them via TCP and have Splunk monitor the port? When Splunk monitors a TCP port, does it write the data coming in to the file system before processing it? Because if so, it wouldn't make a difference (performance-wise) to convert my custom logs to files or stream through TCP, correct?

Thanks in advance.

Tags (2)
0 Karma
1 Solution

araitz
Splunk Employee
Splunk Employee

Have your application write to an appended log file, and have a Splunk universal forwarder take care of the monitoring and transport layer. The framework team has done a lot of work to get the forwarder where it is today, so why not take advantage of it? 🙂

View solution in original post

0 Karma

araitz
Splunk Employee
Splunk Employee

Have your application write to an appended log file, and have a Splunk universal forwarder take care of the monitoring and transport layer. The framework team has done a lot of work to get the forwarder where it is today, so why not take advantage of it? 🙂

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...