Splunk Search

Splunk DB Connect: Can the lookup table for defining extra fields in a datamodel be a dblookup?

kundeng
Path Finder

It seems that the lookup table for defining extra fields in datamodel can not be a dblookup (database lookup)? Can someone confirm this is the case and not a bug?

The dblookup works fine in standalone search, but I am not able to make it to work in datamodel editor.

0 Karma

jcoates_splunk
Splunk Employee
Splunk Employee

I think that's correct... if you can take a bit of delay in recognizing the new schema, you can use the dblookup to regularly generate a new Splunk lookup.

0 Karma

sanjay_shrestha
Contributor

Could you pls elaborate more what do you mean by "you can use the dblookup to regularly generate a new Splunk lookup"?

0 Karma

jcoates_splunk
Splunk Employee
Splunk Employee

a saved search that looks something like this:
dblookup mydb "select * from mytable" | outputlookup mylookup
then you use mylookup in your searches

0 Karma

sanjay_shrestha
Contributor

Did you mean |dbquery instead of |dblookup.
I was using |dbquery but the lookup file kept growing and its huge. To avoid this we also wanted to implement dblookup in datamodel.

0 Karma

jcoates_splunk
Splunk Employee
Splunk Employee

d'oh -- yes, that is what i meant... can you use a SQL limit to keep the size of your query down?

0 Karma

sanjay_shrestha
Contributor

no as lookup can be done to any record for last one year.

0 Karma

jcoates_splunk
Splunk Employee
Splunk Employee

maybe it would work better to dbquery blah | dedup eventid | collect mysummary?

0 Karma

sanjay_shrestha
Contributor

We thought about that but not preferable to create new summary index in this case.

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...