Getting Data In

How can I filter data in search-time from a generated csv file?

skender27
Contributor

Hi,

I have a csv file, generated each day from a Powershell script under the Splunk app lookups directory.
I use the info in those records with the | inputlookup command in many other searches. The columns are name, surname and domain of the internal company network.

Is there a way to filter (in search time) only some of those records present in the .csv file (maybe in a wildcard fashion - for example: eliminate those which name start with adm*)?

Thanks for any suggestion,
Skender

0 Karma
1 Solution

adayton20
Contributor

If I understand your request, is this sort of what you're looking for?

|inputlookup testlookup1 | search NOT user=adm*

or for just the user field

|inputlookup testlookup1 | fields + user | search NOT user=adm*

(whatever your field is)

alt text

alt text

View solution in original post

adayton20
Contributor

If I understand your request, is this sort of what you're looking for?

|inputlookup testlookup1 | search NOT user=adm*

or for just the user field

|inputlookup testlookup1 | fields + user | search NOT user=adm*

(whatever your field is)

alt text

alt text

woodcock
Esteemed Legend

The inputlookup command is no different than using index=myindex sourcetype=mysourcetype; you have all the same filtering options with additional pipelines of commands. The only difference is that you must do a | search first. So you can do something like this:

| inputlookup | search NOT name="adm*"
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...