Knowledge Management

How to create a Splunk spider or other automated solutions ?

Jackiifilwhh
Path Finder

Background

In our company,  Splunk is owned by devops. I don't have the access to develop Splunk(like Splunk Dev). I can only use it and can't do or argue anything about Splunk settings! Many commands like 'eventstats' cannot be run due to space limit. For all that, we want to mine some useful data in log files(we cannot get the log files directly but can only get by Splunk, by the way). We want to find the potential bugs before the customers encountered them.

Problems

I tried to get the raw log events files by running the command which is simple but can get all events, after it finished, I clicked the "download" button. But some files are too big to download(10GB mostly)! So I want to find a way to run Splunk spider program to get the raw events. But I know this field of Splunk poorly. Have you tried this, or if you can think out another automated or half-automated solution ?

Thanks!

0 Karma

Jackiifilwhh
Path Finder

Hi partners! Is there anyone can give me some advice!

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...