Splunk Cloud Platform

How avoid the nullroute applying to just one specific source n windows?

abhi04
Communicator

I have logs being monitored form winodws as below:

 

[monitor://D:\Logs\*]
sourcetype = abc
index = def

I also currently have info logs being null routed which applies to  all the //D:\Logs\jkl.txt

and therefor we dont see any logs from //D:\Logs\jkl.txt in Splunk.

 

Now without modifying the nullroute in props and transforms, I want to ingest logs from //D:\Logs\jkl.txt, how can i avoid the null route to not apply on this specific logs?

Labels (1)
Tags (1)
0 Karma

abhi04
Communicator

Is there a way just to exclude specific sources form the transforms null-route?

0 Karma

abhi04
Communicator

@deepakc Sorry, I missed to mention, my monitor is:

[monitor://D:\Logs\*]

sourcetype = abc

index = def

 

and the transforms is set to:
REGEX=(Info|info|Information|debug|Debug|Verbose)
DEST_KEY = queue
FORMAT = nullQueue

 

And, my //D:\Logs\jkl.txt have all info logs and therefore does not ingest currently because of the transform but now I want to ingest this file but removing the transforms will ingest info logs from other sources as well which I dont want.
How can I proceed?

 

But now I want to ingest the 

0 Karma

deepakc
Builder

As your current inputs is set for scraping all the logs from the folder D:\logs and then you are sending various events from the those logs to null and now you want to be more selective in terms of one log file that you want for info level information and still keep the others from sending some type of events, this becomes a little tricky without testing and having a tinker.

Some options that may work:

Option 1 You might want to move that log (jkl.txt) to another folder or a sub folder and monitor it separately with another monitor, props and transforms so you can control it, this would leave the other's where they are and you can ingest this one now and filter on it as well.

Option 2 Rework your current props and transforms - you may be able to set by source in props, do this for all your other logs and send them to null, either way this all needs some level config and testing out.

 

[source::...my_otherlog.txt]

TRANSFORMS-my_otherlog = my_otherlog_file_null
0 Karma

deepakc
Builder

I don’t think you can.

Setting null routing should come first in your props and transforms (Left to right order) otherwise all the data will get discarded, so look at the order of your props, I'm sure the null is first order which defines the jkl.txt logs.  

What you want to do now is to explicitly add the jkl.txt for ingest, so the method would be to whitelist only the files you want to be logged as in the example below.

 

[monitor://D:\Logs\*]

sourcetype = abc

index = def

whitelist=(*jkl.txt|*myother_files.txt)

 

So, me thinks you may have to modify the null routing  or disable it.

0 Karma
Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Get the T-shirt to Prove You Survived Splunk University Bootcamp

As if Splunk University, in Las Vegas, in-person, with three days of bootcamps and labs weren’t enough, now ...

Wondering How to Build Resiliency in the Cloud?

IT leaders are choosing Splunk Cloud as an ideal cloud transformation platform to drive business resilience,  ...