I have a folder for each day. I would like to know how much data is in there, by day, so I can then export the results to a CSV file and track data growth,
For this type of use case (Hadoop directory usage), I would suggest you use Splunk Hadoop Connect App (not Splunk Analytics for Hadoop - Hunk). Specifically, try the command " | hdfs lsr "
Here is a good blog on the subject: https://www.splunk.com/blog/2012/12/20/connecting-splunk-and-hadoop.html