All Apps and Add-ons

License Use Search Question

hartfoml
Motivator

I have a number of Linux systems that are reporting to the OS index

I need to move to an Organizational index

I can do this using the deployment server since they are all reporting to the DS

The organization is being charged by the amount of data they put in there index each day

I have a list of hosts [index=os host=server1 OR host=server2 OR host=server3 OR host=etc]

What would be the best way to fashion a search to see how much data per day will be added to the ORG index whan I move the 93 systems to the new index?

0 Karma
1 Solution

lukejadamec
Super Champion

Here is one of my all time favorite searches:

index=_internal source=*metrics.log group=per_index_thruput series=ORG | eval totalGB = (kb/1024)/1024 | timechart span=1d sum(totalGB)

Change the series to what ever index you're looking for, or a number of indexes if you like, and run it for the time period you'd like to check.

EDIT:

Getting a pre-move estimate is rather tricky, because a host can write to more than one index. If you assume that the hosts you're moving only write to the OS index, then you can use this search for per_host_thruput.

index=_internal source=*metrics.log group=per_host_thruput series=hostA OR series=hostb OR series=hostc | eval totalGB = (kb/1024)/1024 | timechart span=1d sum(totalGB)

You may be able to group your hosts by similar names, or use a lookup.

View solution in original post

0 Karma

lukejadamec
Super Champion

Here is one of my all time favorite searches:

index=_internal source=*metrics.log group=per_index_thruput series=ORG | eval totalGB = (kb/1024)/1024 | timechart span=1d sum(totalGB)

Change the series to what ever index you're looking for, or a number of indexes if you like, and run it for the time period you'd like to check.

EDIT:

Getting a pre-move estimate is rather tricky, because a host can write to more than one index. If you assume that the hosts you're moving only write to the OS index, then you can use this search for per_host_thruput.

index=_internal source=*metrics.log group=per_host_thruput series=hostA OR series=hostb OR series=hostc | eval totalGB = (kb/1024)/1024 | timechart span=1d sum(totalGB)

You may be able to group your hosts by similar names, or use a lookup.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Improve Delivery Assurance with S2S ACK for Edge Processor

Edge Processor helps Splunk customers process data closer to the source: filtering, transforming, masking, and ...

.conf26 Platform Sessions: Turn Machine Data into Agentic Action

As autonomous agents and multi-cloud architectures reshape modern IT, data platforms have to do far more than ...

Introducing the Launch of Edge Processor in Hybrid Mode!

Modernize Data Ingestion Without Starting Over  For years, organizations have relied on Splunk's proven ...