Getting Data In

Why is my sourcetype auto classified as too_small?

Simeon
Splunk Employee
Splunk Employee

When I load certain sets of data and don't specify a sourcetype, why is it always labeled as "sourcetype=too_small"?

1 Solution

Simeon
Splunk Employee
Splunk Employee

Splunk will automatically try to classify your data if you don't specify a sourcetype. For small sets of data, such as less than 100 events, Splunk will label the data as "too_small".

View solution in original post

risgupta_splunk
Splunk Employee
Splunk Employee

You can use settings in your props.conf as :

[too_small]
PREFIX_SOURCETYPE = false

This is will not grow the sourcetypes for your data.

0 Karma

Joffer
Path Finder

Will the sourcetype change when the index has more than 100 events?

If you start indexing with followTail = 1 in the config(s), there will never be 100 events the first time...

0 Karma

matthewcanty
Communicator

Can we force it to go away? What is the purpose of saying "too small"?

jrodman
Splunk Employee
Splunk Employee

Depends how fast your logs are growing!

0 Karma

Simeon
Splunk Employee
Splunk Employee

Splunk will automatically try to classify your data if you don't specify a sourcetype. For small sets of data, such as less than 100 events, Splunk will label the data as "too_small".

abhattacharya6
New Member

I am analyzing events in the range of 500-600k but still all the sourcetypes are ending with too_small. Any reason?

0 Karma

risgupta_splunk
Splunk Employee
Splunk Employee

use

[too_small]
PREFIX_SOURCETYPE = false

and check.

0 Karma

swdowiarz
Path Finder

Could you please explain where should I use it ?

0 Karma

rphillips_splk
Splunk Employee
Splunk Employee

apply to data input instance where data is first read by Splunk

props.conf

[too_small]
PREFIX_SOURCETYPE = false


PREFIX_SOURCETYPE = <boolean>
* NOTE: this setting is only relevant to the "[too_small]" sourcetype.
* Determines the source types that are given to files smaller than 100
  lines, and are therefore not classifiable.
* PREFIX_SOURCETYPE = false sets the source type to "too_small."
* PREFIX_SOURCETYPE = true sets the source type to "<sourcename>-too_small",
  where "<sourcename>" is a cleaned up version of the filename.
  * The advantage of PREFIX_SOURCETYPE = true is that not all small files
    are classified as the same source type, and wildcard searching is often
    effective.
  * For example, a Splunk search of "sourcetype=access*" retrieves
    "access" files as well as "access-too_small" files.
* This setting applies at input time, when data is first read by Splunk
  software, such as on a forwarder that has configured inputs acquiring the
  data.
* Default: true

 

0 Karma
Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...