Getting Data In

Can I "/dev/null" a sourcetype?

Steve_Litras
Path Finder

So I need to temporarily free up some indexing license. Rather than tweaking my deployment, I was hoping I could just route a few sourcetypes to /dev/null for a little while. Is there a way I can tell splunk to not index a sourcetype of a list of sourcetypes?

Thanks Steve

Tags (3)
1 Solution

ftk
Motivator

Yes you can by routing the undesired events to the nullQueue. Check this part of the documentation: http://www.splunk.com/base/Documentation/latest/Admin/Routeandfilterdata#Discard_specific_events_and...

Let's assume you don't want the sourcetype my_sourcetype. On your indexer, set up your props.conf:

[my_sourcetype]
TRANSFORMS-null= setnull

and then in transforms.conf:

[setnull]
REGEX = .
DEST_KEY = queue
FORMAT = nullQueue

You can of course tweak the REGEX to not be as greedy and just throw out specific events. But the example as is will discard everything coming in as the my_sourcetype sourcetype.

View solution in original post

ftk
Motivator

Yes you can by routing the undesired events to the nullQueue. Check this part of the documentation: http://www.splunk.com/base/Documentation/latest/Admin/Routeandfilterdata#Discard_specific_events_and...

Let's assume you don't want the sourcetype my_sourcetype. On your indexer, set up your props.conf:

[my_sourcetype]
TRANSFORMS-null= setnull

and then in transforms.conf:

[setnull]
REGEX = .
DEST_KEY = queue
FORMAT = nullQueue

You can of course tweak the REGEX to not be as greedy and just throw out specific events. But the example as is will discard everything coming in as the my_sourcetype sourcetype.

Steve_Litras
Path Finder

Worked like a charm! Thanks.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...

A Four-Part Event Series: Full Stack Observability For the AI Era

As AI reshapes applications, infrastructure, and the way teams operate, the traditional boundaries of ...