topic Which lookups are being used by ES? in Splunk Search

Which lookups are being used by ES?

danielbb — Wed, 31 Jul 2019 14:26:39 GMT

When looking at the set of lookups available for ES I see more than three hundreds of them. Which lookups are being used by ES and where is it documented?

There are many that are TA based, such as Splunk_TA_cisco-asa and Splunk_TA_bluecoat-proxysg. I assume they are being used to prepare the data for ES but not used directly by ES.

I see only six lookups which were created by ES, such as es_instrumentation_actions.csv and es_instrumentation_datamodels.csv.

Re: Which lookups are being used by ES?

skalliger — Wed, 31 Jul 2019 15:02:42 GMT

Hi,

the lookups are actually documented. The lookups you were talking about (from TAs) don't have anything to do with ES, as you guessed correctly. Here is a link to the docs: Manage internal lookups

Skalli

Re: Which lookups are being used by ES?

danielbb — Wed, 31 Jul 2019 15:07:11 GMT

Great, but the link appears to be broken.

Re: Which lookups are being used by ES?

ChrisG — Wed, 31 Jul 2019 15:10:53 GMT

The correct link is https://docs.splunk.com/Documentation/ES/5.3.0/Admin/Manageinternallookups

Re: Which lookups are being used by ES?

skalliger — Wed, 31 Jul 2019 15:16:10 GMT

Fixed it, thanks. 🙂

Re: Which lookups are being used by ES?

richgalloway — Wed, 31 Jul 2019 15:40:28 GMT

I agree this could be better documented, but the answer is "it depends".

While there are a number of automatic lookups in ES, which other lookups are used depends on which correlation searches you run.

Re: Which lookups are being used by ES?

jnudell_2 — Wed, 31 Jul 2019 16:24:38 GMT

Still not fixed. Points to "http://manage+internal+lookups/" instead of "https://docs.splunk.com/Documentation/ES/5.3.0/Admin/Manageinternallookups"

Re: Which lookups are being used by ES?

jnudell_2 — Wed, 31 Jul 2019 16:26:12 GMT

While it is documented (in different places that may not make a lot of sense), I would be more interested in the reason why you are asking this question? Do you think that ES lookups are breaking something in search? Are you just curious how ES works?

Why are you asking this question? If you can answer this, you might get more informative answers.

Re: Which lookups are being used by ES?

danielbb — Thu, 01 Aug 2019 13:03:49 GMT

@jnudell_2 - I'm asking because I'm trying to understand ES.

It's interesting to see, for example, under security domains > endpoint > malware center, the New Infections panel which invokes a dynamic lookup -

| from inputlookup:malware_tracker | `dayDiff(firstTime)`

Re: Which lookups are being used by ES?

skalliger — Fri, 02 Aug 2019 08:30:13 GMT

Answers is strange on the mobile sometimes. Thanks. 😄