topic Re: How can I filter data in search-time from a generated csv file? in Getting Data In

How can I filter data in search-time from a generated csv file?

skender27 — Wed, 25 Jan 2017 16:17:47 GMT

Hi,

I have a csv file, generated each day from a Powershell script under the Splunk app lookups directory.
I use the info in those records with the | inputlookup command in many other searches. The columns are name, surname and domain of the internal company network.

Is there a way to filter (in search time) only some of those records present in the .csv file (maybe in a wildcard fashion - for example: eliminate those which name start with adm*)?

Thanks for any suggestion,
Skender

Re: How can I filter data in search-time from a generated csv file?

woodcock — Wed, 25 Jan 2017 16:31:57 GMT

The inputlookup command is no different than using index=myindex sourcetype=mysourcetype; you have all the same filtering options with additional pipelines of commands. The only difference is that you must do a | search first. So you can do something like this:

| inputlookup | search NOT name="adm*"

Re: How can I filter data in search-time from a generated csv file?

adayton20 — Wed, 25 Jan 2017 16:32:44 GMT

If I understand your request, is this sort of what you're looking for?

|inputlookup testlookup1 | search NOT user=adm*

or for just the user field

|inputlookup testlookup1 | fields + user | search NOT user=adm*

(whatever your field is)