Getting Data In

How to monitor multiple data pipelines?

splunk_force_as
Path Finder

I'm planning to introduce index parallelization into our Splunk deployment given the additional resources we have on our indexers. In looking at the DMC, specifically under Indexing Performance, I don't see that it accounts for multiple data pipelines running in parallel. What is the best way to monitor multiple data pipelines running on one indexer.

0 Karma
1 Solution

a212830
Champion

You need the DMC - Indexing Performance - Instance. It will show the pipelines for that instance, and you can then select individual ones.

alt text

View solution in original post

splunk_force_as
Path Finder

This also works: | rest splunk_server= ENTER HOST /services/server/introspection/queues

0 Karma

a212830
Champion

You need the DMC - Indexing Performance - Instance. It will show the pipelines for that instance, and you can then select individual ones.

alt text

splunk_force_as
Path Finder

Thanks for the comment. I do not see that when there are two or three Data Pipelines running in parallel.

"the pipelinesets setting in server.conf. When pipeline sets are used (that is, if pipelinesets is set to a value greater than 1), some panels in the DMC indexing performance dashboards will be blank." Is there a work around?

0 Karma

MuS
SplunkTrust
SplunkTrust

@a212830 is right, you can see it there. I just uploaded a screenshot where you can see the Parallel Data Pipelines. Did you check they are enabled and do you run DMC on the correct instance? This was take running a stand alone instance.

cheers, MuS

0 Karma

splunk_force_as
Path Finder

Thanks @MuS

0 Karma

splunk_force_as
Path Finder

It's the version. Looks like Parallel Data Pipelines are shown on the DMC for version 6.4.X. We are running version 6.3.2.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...