Splunk Search

How to find common packages installed on many hosts?

Simeon
Splunk Employee
Splunk Employee

I am indexing rpm -qa outputs and want to find all of the packages that are common throughout my infrastructure. The dataset from each host looks as follows:

8:51:06.000 AM

Wed Feb 15 08:51:06 PST 2012
dhcpcd-1.3.22pl4-223.2
ntfsprogs-1.11.2-15.2
yast2-schema-2.13.2-13.2
libnscd-1.1-16.2
file-4.16-15.5

Tags (2)

marklaw2
Explorer

A different type of output show hosts and installed software:

sourcetype=package index=os
| multikv noheader=t
| rex field=_raw "^(?P[^ ]+)\s+(?P[^ ]+)\s+(?P[^ ]+)\s+(?P\w+)"
| search NOT NAME NOT VERSION NOT RELEASE NOT ARCH
| dedup host package version release arch
|table host package version release arch

0 Karma

Simeon
Splunk Employee
Splunk Employee

The solution to this is similar to finding out the most common values for any field across all hosts.

There are many pieces to getting this to work. First, you must expand the data using multikv:

sourcetype=rpm | multikv noheader=t

Add in the field extraction:

sourcetype=rpm | multikv noheader=t | rex "(?<package>\S+)"

Next, you need to find all of the hosts that exist for each package:

sourcetype=rpm | multikv noheader=t | rex "(?<package>\S+)" | stats dc(host) as dc by package

Find the maximum number of hosts that exist per package:

sourcetype=rpm | multikv noheader=t | rex "(?<package>\S+)" | stats dc(host) as dc by package | eventstats max(dc) as max

Search for the packages that meet the maximum number:

sourcetype=rpm | multikv noheader=t | rex "(?<package>\S+)" | stats dc(host) as dc by package | eventstats max(dc) as max | where dc = max

Finally, clean up your output to be a simple list:

sourcetype=rpm | multikv noheader=t | rex "(?<package>\S+)" | stats dc(host) as dc by package | eventstats max(dc) as max | where dc = max | table package

Here is another way to do this:

sourcetype=rpm | multikv noheader=t | rex "(?<package>\S+)" | stats count by package host | eventstats dc(host) as dc by package | eventstats max(dc) as max | where dc == max | xyseries package host count

Credit to Dr. Zhang for showing us how to do this.

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Unlock What’s Next: The Splunk Cloud Platform at .conf25

In just a few days, Boston will be buzzing as the Splunk team and thousands of community members come together ...