Splunk Search

How to find the delta, what values are missing in lookup table comparing the actual data?

innoce
Path Finder

Hi,

I am facing issues to find delta.

I have:

Lookup Table: testpolicies.csv

Field names in Lookup: policyname

index=test sourcetype =test_sourcetype policy=*

Field names :  policy

Now, need to compare Lookup table with  sourcetype using policy field and find all the records/rows which are not exist in Lookup table but in sourcetype. This comparison is based on policy field

Any recommendations will be highly appreciated. Thank you so much.

0 Karma

innoce
Path Finder

@ITWhisperer  Hi, This is the expected behaviour

data:
policy 1
policy 11
policy 111
policy 2
policy 22
policy 222

testpolicies.csv
policy 11
policy 22
policy 222

Expected result:
policy 1
policy 111
policy 2

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

Your expected result is the opposite of what you said you are trying to do 


@innoce wrote:

Now, need to compare Lookup table with  sourcetype using policy field and find all the records/rows which are not exist in Lookup table but in sourcetype. This comparison is based on policy field


Please clarify which way round you want it

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust
index=test sourcetype=test_sourcetype NOT [| inputlookup testpolicies.csv | rename policyname as policy | table policy]
0 Karma
Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Dynamic formatting from XML events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...