Getting Data In

How to avoid exceeding daily limit when monitoring directory?

edrivera3
Builder

I want to monitor a directory that already has many gbs of data (historical data). New data is added to that directory but in a low rate 50mbs/daily. I want to index all the data to Splunk without exceeding the daily limit. I don't need all the data to be indexed at once.

  1. Is there a way to control how much data is indexed daily?

On limits.conf there is a setting called maxKBps, but it seems it's related to forwarders.

0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

Go ahead and index it all at once. If you blow your license it'll only be one time. You're allowed 3 violations per month, IIRC.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

Go ahead and index it all at once. If you blow your license it'll only be one time. You're allowed 3 violations per month, IIRC.

---
If this reply helps you, Karma would be appreciated.

edrivera3
Builder

This is not an option. If I do that I will exceed 3 violations per month.

0 Karma

edrivera3
Builder

Ok. how much data I can index above the limit in a single day?

0 Karma

adonio
Ultra Champion

as much as you want
you can index terabytes of data in a day and count as 1 warning
@richgalloway answer is correct IMHO

edrivera3
Builder

Ohh cool. I didn't know that. Thanks

0 Karma
Get Updates on the Splunk Community!

New Learning Videos on Topics Most Requested by You! Plus This Month’s New Splunk ...

Splunk Lantern is a customer success center that provides advice from Splunk experts on valuable data ...

How I Instrumented a Rust Application Without Knowing Rust

As a technical writer, I often have to edit or create code snippets for Splunk's distributions of ...

Splunk Community Platform Survey

Hey Splunk Community, Starting today, the community platform may prompt you to participate in a survey. The ...