Getting Data In

To use or not to use TCP as input method?

samiomer
Path Finder

Hi all,

I have a few custom remote sensors that I would like Splunk to monitor. These sensors do not use files or TCP to log (they use other forms like web services and other distributed messaging systems).

So, my question is, what would make the most sense in converting these logs? Should I write them to disk and have splunk monitor them as files or should I transport them via TCP and have Splunk monitor the port? When Splunk monitors a TCP port, does it write the data coming in to the file system before processing it? Because if so, it wouldn't make a difference (performance-wise) to convert my custom logs to files or stream through TCP, correct?

Thanks in advance.

Tags (2)
0 Karma
1 Solution

araitz
Splunk Employee
Splunk Employee

Have your application write to an appended log file, and have a Splunk universal forwarder take care of the monitoring and transport layer. The framework team has done a lot of work to get the forwarder where it is today, so why not take advantage of it? 🙂

View solution in original post

0 Karma

araitz
Splunk Employee
Splunk Employee

Have your application write to an appended log file, and have a Splunk universal forwarder take care of the monitoring and transport layer. The framework team has done a lot of work to get the forwarder where it is today, so why not take advantage of it? 🙂

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Self-Healing Pipeline Is Now Generally Available: AI-Powered CIM Compliance

Maintaining data integrity across security and analytics pipelines is an ongoing challenge. Data ...

Meet Splunk Observability Studio: AI-Assisted OpenTelemetry Instrumentation Without ...

Instrumentation is usually the last step or even an afterthought when building out a project. The feature ...

Federated Search for Cisco Security and Analytics Logging (SAL) is now GA on Splunk ...

Federated Search for Cisco  Security Analytics and Logging (SAL) is now generally available as part of the ...