Splunk Enterprise Security

URL-based threat source : where is CSV/lookup file stored?

koshyk
Super Champion

As per the URL
http://docs.splunk.com/Documentation/ES/4.2.0/User/Configureblocklists

We are looking for : Add a URL-based threat source -> Threat Intelligence Downloads.
After configuring we wanted to check if it has worked. Where is the final lookup/csv file cached/stored?

0 Karma
1 Solution

koshyk
Super Champion

Found the issue. In SHC cluster, though we have created "lookups" directory in deployer and pushed to SHC members, the lookup directory won't be created unless there is a file in it !! ( I feel it is a bug).
So first time, we had to create a dummy csv file and then redeploy again from Deployer and it creates in SHC members. Afterwards, when the "remote URL" runs, it will start fetting the new csv file and overwrite the 1st time lookup file. Then it will be shown in "lookups -> lookup table files" as well in Enterprise Security "Threat Intelligence Audit"

View solution in original post

0 Karma

koshyk
Super Champion

Found the issue. In SHC cluster, though we have created "lookups" directory in deployer and pushed to SHC members, the lookup directory won't be created unless there is a file in it !! ( I feel it is a bug).
So first time, we had to create a dummy csv file and then redeploy again from Deployer and it creates in SHC members. Afterwards, when the "remote URL" runs, it will start fetting the new csv file and overwrite the 1st time lookup file. Then it will be shown in "lookups -> lookup table files" as well in Enterprise Security "Threat Intelligence Audit"

0 Karma

dperre_splunk
Splunk Employee
Splunk Employee

Click Lookups | Lookup table files | Have a look in there and all the threat feeds / folders will be present.

0 Karma

dperre_splunk
Splunk Employee
Splunk Employee

If you are running linux can you look for the following folder in your App folder on the Enterprise Security Search head?

etc/apps/SA-ThreatIntelligence/lookups

That is where all the threatintel feeds are. If it is not there you will need to install the app from the Enterprise Security App. Just extract it from the SPL. Hope this helps.

0 Karma

koshyk
Super Champion

it is not present in the list. (eg: even built-in lookup alexa top 1 million site csv is not present).

0 Karma
Get Updates on the Splunk Community!

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...

Integrating Splunk Search API and Quarto to Create Reproducible Investigation ...

 Splunk is More Than Just the Web Console For Digital Forensics and Incident Response (DFIR) practitioners, ...

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...