Getting Data In

DateParserVerbose - what is splunkd.log telling me?

mctester
Communicator

I'm trying to figure out what the number is at the end of the following internal DateParserVerbose log. Sometimes a number is there and sometimes not, sometimes a "\n"

04-20-2015 07:56:51.991 -0400 WARN DateParserVerbose - Time parsed (Mon Apr 20 04:17:19 2015) is too far away from the previous event's time (Mon Apr 20 07:56:40 2015) to be accepted. If this is a correct time, MAX_DIFF_SECS_AGO (3600) or MAX_DIFF_SECS_HENCE (604800) may be overly restrictive. Context: source::/var/log/host/cronlog|host::homer|cronlog-2|96256
1 Solution

Mick
Splunk Employee
Splunk Employee

What we have here is an internal identifier that we call the 'pipelinechannelset' and is used to ensure that data from a particular input stream is not mingled with data from another stream. This is primarily used for network inputs where we would have incoming streams from multiple sources via the same TCP port, 9997 by default.

In the case of local file inputs, it's not necessary to have an identifier like this as our default parsing machinery already has the ability to keep data from different files separate - so that explains why you will sometimes see '/n' versus a number.

The more incoming data-streams you have (i.e. the more forwarders in your deployment), the higher this number will be.

View solution in original post

Mick
Splunk Employee
Splunk Employee

What we have here is an internal identifier that we call the 'pipelinechannelset' and is used to ensure that data from a particular input stream is not mingled with data from another stream. This is primarily used for network inputs where we would have incoming streams from multiple sources via the same TCP port, 9997 by default.

In the case of local file inputs, it's not necessary to have an identifier like this as our default parsing machinery already has the ability to keep data from different files separate - so that explains why you will sometimes see '/n' versus a number.

The more incoming data-streams you have (i.e. the more forwarders in your deployment), the higher this number will be.

martin_mueller
SplunkTrust
SplunkTrust

So... don't cross the streams?

Mick
Splunk Employee
Splunk Employee

This comment deserves way more karma than I can currently allocate

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Community Content Calendar, September edition

Welcome to another insightful post from our Community Content Calendar! We're thrilled to continue bringing ...

Splunkbase Unveils New App Listing Management Public Preview

Splunkbase Unveils New App Listing Management Public PreviewWe're thrilled to announce the public preview of ...

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Are you leveraging automation to its fullest potential in your threat detection strategy?Our upcoming Security ...