Security

Why doesn't Splunk 4 honor the crawlers section of crawl.conf?

GuyPaddock
Engager

In the documentation for Splunk 4, it says that you can specify a [crawlers] section like so:

[crawlers]

crawlers_list = vhost_logs

The crawler is defined in its own [vhost_logs] section.

But no matter what crawlers I define in that section, I always get "Unknown crawler 'vhost_logs'. Legal values are: ['files', 'net']". What is the correct way to do this in 4?

Tags (1)
0 Karma

Steve_G_
Splunk Employee
Splunk Employee

The documentation was inaccurate. The [crawlers] stanza does not, in fact, exist.

We've just corrected the documentation; read it here:

http://www.splunk.com/base/Documentation/latest/Admin/Findmorethingstomonitorwithcrawl

Also, refer to the crawl.conf spec file here:

http://www.splunk.com/base/Documentation/latest/Admin/Crawlconf

Get Updates on the Splunk Community!

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...

Integrating Splunk Search API and Quarto to Create Reproducible Investigation ...

 Splunk is More Than Just the Web Console For Digital Forensics and Incident Response (DFIR) practitioners, ...

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...