Getting Data In

Sourcetype -too_small

matthewcanty
Communicator

Just wanted to know how I can stop this from appearing. I've seen other answers saying that its due to the number of events. Is it possible to find out how many events? They said 100 but I have a sourcetype with over 12000 events and still has the suffix -too_small...

Many thanks

Tags (1)
1 Solution

Drainy
Champion

From props.conf heres a definition;

#******************************************************************************
# Small file settings
#******************************************************************************

PREFIX_SOURCETYPE = [true|false]
* NOTE: this attribute is only relevant to the "[too_small]" sourcetype.
* Determines the source types that are given to files smaller than 100 lines, and are therefore
  not classifiable.
* PREFIX_SOURCETYPE = false sets the source type to "too_small."
* PREFIX_SOURCETYPE = true sets the source type to "<sourcename>-too_small", where "<sourcename>"
  is a cleaned up version of the filename.
        * The advantage of PREFIX_SOURCETYPE = true is that not all small files are classified as
          the same source type, and wildcard searching is often effective.
        * For example, a Splunk search of "sourcetype=access*" will retrieve "access" files as well
          as "access-too_small" files.
* Defaults to true.

I've not hit many too_small sourcetypes in my time but is it possible it was too small and thats now the sourcetype associated with it? My understanding is that if you provide a sourcetype in a config then it will use that instead of the too_small keyword.

http://docs.splunk.com/Documentation/Splunk/5.0.1/Data/Renamesourcetypes

It might be an idea to try that and then re-index your data.

View solution in original post

Drainy
Champion

From props.conf heres a definition;

#******************************************************************************
# Small file settings
#******************************************************************************

PREFIX_SOURCETYPE = [true|false]
* NOTE: this attribute is only relevant to the "[too_small]" sourcetype.
* Determines the source types that are given to files smaller than 100 lines, and are therefore
  not classifiable.
* PREFIX_SOURCETYPE = false sets the source type to "too_small."
* PREFIX_SOURCETYPE = true sets the source type to "<sourcename>-too_small", where "<sourcename>"
  is a cleaned up version of the filename.
        * The advantage of PREFIX_SOURCETYPE = true is that not all small files are classified as
          the same source type, and wildcard searching is often effective.
        * For example, a Splunk search of "sourcetype=access*" will retrieve "access" files as well
          as "access-too_small" files.
* Defaults to true.

I've not hit many too_small sourcetypes in my time but is it possible it was too small and thats now the sourcetype associated with it? My understanding is that if you provide a sourcetype in a config then it will use that instead of the too_small keyword.

http://docs.splunk.com/Documentation/Splunk/5.0.1/Data/Renamesourcetypes

It might be an idea to try that and then re-index your data.

matthewcanty
Communicator

Thank you. The rename source types half works. I now just have 3 source types with the same name...

0 Karma
Get Updates on the Splunk Community!

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI! Discover how Splunk’s agentic AI ...

[Puzzles] Solve, Learn, Repeat: Dereferencing XML to Fixed-length events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Stay Connected: Your Guide to December Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...