I want to start using search head clustering but want to know if I need to upgrade my search head peers (indexers) to 6.2.x ?
Search head clustering is backwards compatible with search peers / indexers to version 5.x an 6.x. Please see the following docs
http://docs.splunk.com/Documentation/Splunk/6.2.1/Indexer/Clusterdeploymentoverview