On the Hadoop Monitoring add-on details, it describes the inputs.conf entires for Spark. However, i didn't find it in /bin directory. Anyone has any insight into this please? Thx!
In the inputs.conf you can add spark monitoring, for example:
[script://./bin/hadoopmon_spark.sh]
disabled = 0
interval=60
sourcetype = hdfs_spark_metrics
index = spark_metricsdata
[monitor:///var/log/spark/history]
sourcetype = spark_historyserver
index = spark_metricsdata
[monitor:///var/log/spark/thriftserver]
sourcetype = spark_hivethrift
index = spark_metricsdata
And the in the hadoopmon_spark.sh you can add something like this
. dirname $0
/hadoopmon_common.sh
hadoop fs -text /spark-history/*