Splunk Search

using a inputlookup on string values - regex match?

sonicZ
Contributor

I am currently matching a list of "bad ips" with a search such as this

index=someindex NOT uri="/dot_clear.gif" [| inputlookup watchlist_ip_lookup.csv  | rename watch_ip as clientip | fields + clientip] | dedup clientip | lookup ga ip as clientip | table date_month, date_mday, date_hour, date_minute, date_year, clientip, country, org, status, referer, uri, host, source, sourcetype, index, other

how can i do a similar search with a partial text match in say the URI, say from sourcetype access_combined searching on a partial domain match like .*somedomain.com.* ?
I would like to use these domain strings in a inputlookup table like the ip list i attached above
possibly with a rex match on the uri? i am just not getting the format right.

Thanks.

Tags (2)
0 Karma
1 Solution

Ayn
Legend

If it's just a matter of using wildcards, you can let the regular search command take care of that.

index=someindex NOT [|inputlookup yourlookup | eval query="uri=*".domain."*" | fields query] | ...

View solution in original post

Ayn
Legend

If it's just a matter of using wildcards, you can let the regular search command take care of that.

index=someindex NOT [|inputlookup yourlookup | eval query="uri=*".domain."*" | fields query] | ...

sonicZ
Contributor

Ayn, another follow up question 🙂
If i wanted to match on a string anywhere in the _raw events, But seems rather slow on large indexes.
Perhaps there is a better way.

index=www NOT uri="/dot_clear.gif" [|inputlookup watchlist_string_lookup | eval query="_raw=".watch_string."" | fields query] | lookup ga ip as clientip | table date_month, date_mday, date_hour, date_minute, date_year, clientip, country, org, status, referer, uri, host, source, sourcetype, index, other, watch_string

0 Karma

sonicZ
Contributor

Thanks Ayn, i changed domain to my "watch_list" header in the csv and that works for me 🙂
Edit:
actually i removed the NOT too, this and it seems to work

index=someindex NOT uri="/dot_clear.gif" earliest=-1h [|inputlookup watchlist_string_lookup | eval query="uri=".watch_string."" | fields query] | lookup ga ip as clientip | table date_month, date_mday, date_hour, date_minute, date_year, clientip, country, org, status, referer, uri, host, source, sourcetype, index, other

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Unlocking Unified Insights: New Gigamon Federated Search App for Splunk

In today’s data-heavy environment, organizations are caught in a data distribution dilemma. As data volumes ...

GA: New Data Management App in Splunk Platform

Streamlining Data Management: Introducing a unified experience in Splunk Managing data at scale shouldn’t feel ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...