How to monitor multiple data pipelines?

[splunk_force_as]

I'm planning to introduce index parallelization into our Splunk deployment given the additional resources we have on our indexers. In looking at the DMC, specifically under Indexing Performance, I don't see that it accounts for multiple data pipelines running in parallel. What is the best way to monitor multiple data pipelines running on one indexer.

[splunk_force_as]

This also works: | rest splunk_server= ENTER HOST /services/server/introspection/queues

[a212830 · Accepted solution]

You need the DMC - Indexing Performance - Instance. It will show the pipelines for that instance, and you can then select individual ones.

[splunk_force_as]

Thanks for the comment. I do not see that when there are two or three Data Pipelines running in parallel.

"the pipelinesets setting in server.conf. When pipeline sets are used (that is, if pipelinesets is set to a value greater than 1), some panels in the DMC indexing performance dashboards will be blank." Is there a work around?

[MuS]

@a212830 is right, you can see it there. I just uploaded a screenshot where you can see the Parallel Data Pipelines. Did you check they are enabled and do you run DMC on the correct instance? This was take running a stand alone instance.

cheers, MuS

[splunk_force_as]

Thanks @MuS

[splunk_force_as]

It's the version. Looks like Parallel Data Pipelines are shown on the DMC for version 6.4.X. We are running version 6.3.2.