In short, we don't have direct access to our licensing server (it's being managed by our service provider) - but we still need to know what the volume of indexed data is each day.
We do get a report from our service provider each day with licence usage data, but we want a dashboard doing the same.
We found that running this SPL query:
index="_internal" source="*metrics.log" per_index_thruput source="/opt/splunk/var/log/splunk/metrics.log" | eval gb=kb/1024/1024 | timechart span=1d sum(gb) as "Total Per Day" by series useother=f | fields - VALUE_*
It sort of works, but the values we get are not matching the licence usage report we are getting. It's adding about 1/3rd more to the totals.
We've got indexer and search head clusters (3 in each), splunk enterprise 8.0.0.
Any advise appreciated!
I've tried without any conversion - and the the results are no different when I take the KB total and convert elsewhere.
The report we get from our service provider is lower on the Licence usage than our Throughput logs from each of the indexers. Is that normal?
Depending on where and when in the search process the conversion from kilobytes to gigabytes is done, rounding errors may be coming into play. Try perhaps not doing the conversion till after the sum. That should help minimise the error, especially if you have lots of small bits of data coming in.