Splunk Search

When does the accelerated Data model's values get processed to tsidx?

clyde772
Communicator

Hey Experts!

We have a debate going on about when splunk punches in the field values when the data model acceleration is enabled. 2 ideas,

  1. The accelerated field values gets processed (put into tsidx) when the data gets indexed into an index.
  2. The accelerated field values gets processed (put into tsidx) when a user accesses a data model. Once the data model in accessed the processed values remains for the other users.

Which one is right? Also lookup, geo tag, regex attributes also gets put into accelerated tsidx?

Cheer~! Thanks for sharing your knowledge with people in need~!

Tags (3)
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

If you're talking about persistent acceleration, number 1 is more correct - every few minutes splunk will accelerate recently indexed data on the indexers.
If you're talking about ad-hoc acceleration when you did not explicitly enable acceleration for this datamodel, number 2 is more correct - when you run a pivot, temporary acceleration happens on the search head for your second run in that pivot editor session. However, other users don't benefit from this because it's only temporary to your dispatch directory.

More info on that here: http://docs.splunk.com/Documentation/Splunk/latest/Knowledge/Acceleratedatamodels

Concerning your other types of fields, I'm not certain. For lookups and geoinformation I'm guessing no, because those use external sources that may change without splunk knowing. For regex I'm guessing yes, because those don't change on their own. However, that's just my gut talking.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

If you're talking about persistent acceleration, number 1 is more correct - every few minutes splunk will accelerate recently indexed data on the indexers.
If you're talking about ad-hoc acceleration when you did not explicitly enable acceleration for this datamodel, number 2 is more correct - when you run a pivot, temporary acceleration happens on the search head for your second run in that pivot editor session. However, other users don't benefit from this because it's only temporary to your dispatch directory.

More info on that here: http://docs.splunk.com/Documentation/Splunk/latest/Knowledge/Acceleratedatamodels

Concerning your other types of fields, I'm not certain. For lookups and geoinformation I'm guessing no, because those use external sources that may change without splunk knowing. For regex I'm guessing yes, because those don't change on their own. However, that's just my gut talking.

tchen_splunk
Splunk Employee
Splunk Employee

I believe the geo-ip data is baked into the data model acceleration.

http://docs.splunk.com/Documentation/Splunk/6.2.0/Knowledge/AddageoIPattribute
Note: Geo IP attributes are added to your object as required attributes, and their Type values are predetermined. You cannot change these values.

0 Karma

clyde772
Communicator

Martin, Appreciate your answer! Every few minutes? I verified I was able to get values for tstat up to the very second of current time. That means it would rather immdiately as the data gets indexed, wouldn't you think? This data model could be used very well to cover up Splunk regular data call speeds.

0 Karma
Get Updates on the Splunk Community!

Continuing Innovation & New Integrations Unlock Full Stack Observability For Your ...

You’ve probably heard the latest about AppDynamics joining the Splunk Observability portfolio, deepening our ...

Monitoring Amazon Elastic Kubernetes Service (EKS)

As we’ve seen, integrating Kubernetes environments with Splunk Observability Cloud is a quick and easy way to ...

Cloud Platform & Enterprise: Classic Dashboard Export Feature Deprecation

As of Splunk Cloud Platform 9.3.2408 and Splunk Enterprise 9.4, classic dashboard export features are now ...