Getting Data In

How to combine lists of source and destination IPs into one unique list to match against a CSV file?

ststephe
Engager

I have a list of source and destination IPs that I'm trying to concatenate into one unique list and check against a CSV file. I'm trying to make a list of all the unique source IPs (I don't need the count, but it'd be nice), add that to a list of unique destination IPs, then take all that and display only the IPs that match a CSV file I have. Does anyone have an idea of how to do that?

Tags (3)
0 Karma
1 Solution

woodcock
Esteemed Legend

Like this:

... | dedup myIPfield | table myIPfield | eval dataSource="events" | appendpipe [|inputcsv myIPfile.csv | table myIPfield | eval dataSource="CSV"] | stats values(*) AS * dc(dataSource) AS numSources BY myIPfield ...

Then you can finish out with:

For inner join:

| where numSources=2

For left join:

| where dataSource="events"

For right join:

| where dataSource="CSV"

For outer join:

| where numSources=1

View solution in original post

somesoni2
Revered Legend

What you're trying to do is definitely possible but it would be tough to give a solution without knowing your data (is source and dest ip present in same event, how is the CSV file stored in splunk;)...

0 Karma

woodcock
Esteemed Legend

Like this:

... | dedup myIPfield | table myIPfield | eval dataSource="events" | appendpipe [|inputcsv myIPfile.csv | table myIPfield | eval dataSource="CSV"] | stats values(*) AS * dc(dataSource) AS numSources BY myIPfield ...

Then you can finish out with:

For inner join:

| where numSources=2

For left join:

| where dataSource="events"

For right join:

| where dataSource="CSV"

For outer join:

| where numSources=1
Get Updates on the Splunk Community!

.conf24 | Day 0

Hello Splunk Community! My name is Chris, and I'm based in Canberra, Australia's capital, and I travelled for ...

Enhance Security Visibility with Splunk Enterprise Security 7.1 through Threat ...

(view in My Videos)Struggling with alert fatigue, lack of context, and prioritization around security ...

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...