Splunk Dev

What is the proper way to access input lookup files using custom command logic (Python SDK)?

spammenot66
Contributor

I'm currently trying to create a custom command to handle a multivalue lookup without having to run

|mvexpand

Using MVexpand on large records with multivalue fields will multiply the number of rows and can be unwieldy if we have to use this logic on multiple multivalue fields.

The hope is for a custom command logic to do the following:

1. pull in a lookup file,
2. loop through each record, for each multivalue field
3. --loop through each multivalue field and apply the lookup.

In regards to Splunk custom command coding, what's the guideline for accessing input lookup files? Its mentioned on the python-SDK main page, but then there's no mention of it in the python SDK reference site. for any input file, do we need to add a code to check 4-5 different locations to see if such a file exists? If this is the route, is there a proper order to check the file, for example, check systems/lookup first then local app/bin/lookup then user lookup directory?

Ideally, it would be great if we can make the same call that the system is using when you run |lookup command and |inputloookup command.

http://dev.splunk.com/view/python-sdk/SP-CAAAEU2
GeneratingCommand: Generates event records based on command arguments. Examples of generating commands include search (at the beginning of the pipeline), inputcsv, input lookup, and metadata.

python SDK reference site
https://docs.splunk.com/DocumentationStatic/PythonSDK/1.6.5/index.html#searchcommands

location of CSV files >> In addition to the directory noted here, i've noticed lookup files are also placed here: /opt/splunk/etc/users/{user-account}/{splunk-app}/lookups/
https://docs.splunk.com/Documentation/Splunk/7.2.4/Knowledge/ConfigureCSVlookups

if you offer any code that will help resolve, i'll be happy to offer my karma points.

Labels (2)
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...