Splunk Search

When does the accelerated Data model's values get processed to tsidx?

clyde772
Communicator

Hey Experts!

We have a debate going on about when splunk punches in the field values when the data model acceleration is enabled. 2 ideas,

  1. The accelerated field values gets processed (put into tsidx) when the data gets indexed into an index.
  2. The accelerated field values gets processed (put into tsidx) when a user accesses a data model. Once the data model in accessed the processed values remains for the other users.

Which one is right? Also lookup, geo tag, regex attributes also gets put into accelerated tsidx?

Cheer~! Thanks for sharing your knowledge with people in need~!

Tags (3)
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

If you're talking about persistent acceleration, number 1 is more correct - every few minutes splunk will accelerate recently indexed data on the indexers.
If you're talking about ad-hoc acceleration when you did not explicitly enable acceleration for this datamodel, number 2 is more correct - when you run a pivot, temporary acceleration happens on the search head for your second run in that pivot editor session. However, other users don't benefit from this because it's only temporary to your dispatch directory.

More info on that here: http://docs.splunk.com/Documentation/Splunk/latest/Knowledge/Acceleratedatamodels

Concerning your other types of fields, I'm not certain. For lookups and geoinformation I'm guessing no, because those use external sources that may change without splunk knowing. For regex I'm guessing yes, because those don't change on their own. However, that's just my gut talking.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

If you're talking about persistent acceleration, number 1 is more correct - every few minutes splunk will accelerate recently indexed data on the indexers.
If you're talking about ad-hoc acceleration when you did not explicitly enable acceleration for this datamodel, number 2 is more correct - when you run a pivot, temporary acceleration happens on the search head for your second run in that pivot editor session. However, other users don't benefit from this because it's only temporary to your dispatch directory.

More info on that here: http://docs.splunk.com/Documentation/Splunk/latest/Knowledge/Acceleratedatamodels

Concerning your other types of fields, I'm not certain. For lookups and geoinformation I'm guessing no, because those use external sources that may change without splunk knowing. For regex I'm guessing yes, because those don't change on their own. However, that's just my gut talking.

tchen_splunk
Splunk Employee
Splunk Employee

I believe the geo-ip data is baked into the data model acceleration.

http://docs.splunk.com/Documentation/Splunk/6.2.0/Knowledge/AddageoIPattribute
Note: Geo IP attributes are added to your object as required attributes, and their Type values are predetermined. You cannot change these values.

0 Karma

clyde772
Communicator

Martin, Appreciate your answer! Every few minutes? I verified I was able to get values for tstat up to the very second of current time. That means it would rather immdiately as the data gets indexed, wouldn't you think? This data model could be used very well to cover up Splunk regular data call speeds.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...