Knowledge Management

Example of how to measure datastore latency?

sloshburch
Splunk Employee
Splunk Employee

Does anyone have examples of how to use Splunk to measure datastore latency?

Tags (1)
0 Karma
1 Solution

sloshburch
Splunk Employee
Splunk Employee

The Splunk Product Best Practices team helped produce this response. Read more about example use cases in the Splunk Platform Use Cases manual.

*For more information about this example see [Virtualization

Module KPIs and thresholds](https://docs.splunk.com/Documentation/ITSI/latest/IModules/VirtualizationModuleKPIsandthresholds) in the Splunk IT Service Intelligence Modules manual.*

System administration teams need to know the highest latency value across all disks used by the host. Latency measures the time taken to process an SCSI command issued by the guest OS to datastore. Set up this example use case to troubleshoot your virtualization infrastructure by searching and analysis of virtualization related logs, events, and metrics.

Load data

How to implement: This example use case depends on logs and events from virtualization platforms.

Install the appropriate add-ons for the platforms that exist in your environment.

You can find installation and configuration instructions in the Details tab of each Splunkbase item. Additional configuration details are available in the Virtualization Module configurations manual.

Best practice: For more granular results with scripted inputs, you can increase the frequency at which the input runs using the interval setting in inputs.conf. Running the input more frequently consumes more storage, and running it less frequently uses less, which can affect license consumption. The default interval is 60 seconds. See Scripted Input in the input.conf topic of the Splunk Enterprise Admin manual.

Best practice: For all of the data inputs, specify a desired target index to provide a more sustainable practice for data access controls and retention models. By default, Splunk collects the data in the default index named main.

Get insights

Run the following search.

index=* tag=datastore tag=storage tag=performance tag=virtualization
| timechart span=15min max(datastore_highest_latency) BY host

Best practice: In searches, replace the asterisk in index=* with the name of the index that contains the data. By default, Splunk stores data in the main index. Therefore, index=* becomes index=main. Use the OR operator to specify one or multiple indexes to search. For example, index=main OR index=security. See About managing indexes and How indexing works in Splunk docs for details.

Help

The Virtualization Module troubleshooting section in the Splunk IT Service Intelligence Modules manual lists troubleshooting resources that you can apply to this example use case.

If no results appear, it may be because the add-ons were not deployed to the search heads, so the needed tags and fields are not defined. Deploy the add-ons to the search heads to access the needed tags and fields. See About installing Splunk add-ons in the Splunk Add-ons manual.

For troubleshooting tips that you can apply to all add-ons, see Troubleshoot add-ons in the Splunk Add-ons manual.

For more support, post a question to the Splunk Answers community.

View solution in original post

0 Karma

sloshburch
Splunk Employee
Splunk Employee

The Splunk Product Best Practices team helped produce this response. Read more about example use cases in the Splunk Platform Use Cases manual.

*For more information about this example see [Virtualization

Module KPIs and thresholds](https://docs.splunk.com/Documentation/ITSI/latest/IModules/VirtualizationModuleKPIsandthresholds) in the Splunk IT Service Intelligence Modules manual.*

System administration teams need to know the highest latency value across all disks used by the host. Latency measures the time taken to process an SCSI command issued by the guest OS to datastore. Set up this example use case to troubleshoot your virtualization infrastructure by searching and analysis of virtualization related logs, events, and metrics.

Load data

How to implement: This example use case depends on logs and events from virtualization platforms.

Install the appropriate add-ons for the platforms that exist in your environment.

You can find installation and configuration instructions in the Details tab of each Splunkbase item. Additional configuration details are available in the Virtualization Module configurations manual.

Best practice: For more granular results with scripted inputs, you can increase the frequency at which the input runs using the interval setting in inputs.conf. Running the input more frequently consumes more storage, and running it less frequently uses less, which can affect license consumption. The default interval is 60 seconds. See Scripted Input in the input.conf topic of the Splunk Enterprise Admin manual.

Best practice: For all of the data inputs, specify a desired target index to provide a more sustainable practice for data access controls and retention models. By default, Splunk collects the data in the default index named main.

Get insights

Run the following search.

index=* tag=datastore tag=storage tag=performance tag=virtualization
| timechart span=15min max(datastore_highest_latency) BY host

Best practice: In searches, replace the asterisk in index=* with the name of the index that contains the data. By default, Splunk stores data in the main index. Therefore, index=* becomes index=main. Use the OR operator to specify one or multiple indexes to search. For example, index=main OR index=security. See About managing indexes and How indexing works in Splunk docs for details.

Help

The Virtualization Module troubleshooting section in the Splunk IT Service Intelligence Modules manual lists troubleshooting resources that you can apply to this example use case.

If no results appear, it may be because the add-ons were not deployed to the search heads, so the needed tags and fields are not defined. Deploy the add-ons to the search heads to access the needed tags and fields. See About installing Splunk add-ons in the Splunk Add-ons manual.

For troubleshooting tips that you can apply to all add-ons, see Troubleshoot add-ons in the Splunk Add-ons manual.

For more support, post a question to the Splunk Answers community.

0 Karma
Get Updates on the Splunk Community!

SignalFlow: What? Why? How?

What is SignalFlow? Splunk Observability Cloud’s analytics engine, SignalFlow, opens up a world of in-depth ...

Federated Search for Amazon S3 | Key Use Cases to Streamline Compliance Workflows

Modern business operations are supported by data compliance. As regulations evolve, organizations must ...

New Dates, New City: Save the Date for .conf25!

Wake up, babe! New .conf25 dates AND location just dropped!! That's right, this year, .conf25 is taking place ...