Deployment Architecture

If I cluster do I need RAID?

robertlynch2020
Motivator

Hi

we are about to move from single install to cluster Install on 3 machines (1 search head and 3 indexers) and we are getting SSD.

As SSD is expensive, do we need to add on RAID as well?

Thanks in Advance
Rob

0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @robertlynch2020,
at first to have an Indexer Cluster you need also an additional server called Master Node that manages cluster and cannot be neither Search Head or Indexer.

About SSD you should read https://www.splunk.com/en_us/blog/tips-and-tricks/quantifying-the-benefits-of-splunk-with-ssds.html and https://docs.splunk.com/Documentation/Splunk/8.0.2/Capacity/Referencehardware .
Sequential write performance on SSD vs SAS is pretty similar so no real benefit for Splunk on an SSD here.

Anyway I didn't see any Splunk installation without RAID0 on system disks and RAID1+0 on data disks.
Eventually you could think to have fast disks for hot and warm buckets and slower disks for cold buckets.

Ciao.
Giuseppe

View solution in original post

0 Karma

robertlynch2020
Motivator

Hi

Thanks for this, so we are looking to go for RAID 5 on SSD.

So after reading the document i get the feeling SSD vs. SAN

Write: Is the same
Read sequential: Is the same
Read Sparc: Is much better

Most of our data is in datamodels, so i am not sure if that also make a difference?
At the moment the current install is on SSD, so i am a bit nervous from moving back to SAN!

Thanks
Robert

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @robertlynch2020,
at first to have an Indexer Cluster you need also an additional server called Master Node that manages cluster and cannot be neither Search Head or Indexer.

About SSD you should read https://www.splunk.com/en_us/blog/tips-and-tricks/quantifying-the-benefits-of-splunk-with-ssds.html and https://docs.splunk.com/Documentation/Splunk/8.0.2/Capacity/Referencehardware .
Sequential write performance on SSD vs SAS is pretty similar so no real benefit for Splunk on an SSD here.

Anyway I didn't see any Splunk installation without RAID0 on system disks and RAID1+0 on data disks.
Eventually you could think to have fast disks for hot and warm buckets and slower disks for cold buckets.

Ciao.
Giuseppe

0 Karma

gcusello
SplunkTrust
SplunkTrust

Never RAID 5 because is slower than RAID1+0!
Ciao.
Giuseppe

0 Karma

robertlynch2020
Motivator

Hi

Thanks for the info, at the moment Splunk is on RAID 5 and the performance is good, but i will hopefully be able to take your advice for the future.

Rob

0 Karma
Get Updates on the Splunk Community!

Enter the Dashboard Challenge and Watch the .conf24 Global Broadcast!

The Splunk Community Dashboard Challenge is still happening, and it's not too late to enter for the week of ...

Join Us at the Builder Bar at .conf24 – Empowering Innovation and Collaboration

What is the Builder Bar? The Builder Bar is more than just a place; it's a hub of creativity, collaboration, ...

Combine Multiline Logs into a Single Event with SOCK - a Guide for Advanced Users

This article is the continuation of the “Combine multiline logs into a single event with SOCK - a step-by-step ...