Keep getting this error message on my Light Forwarder client

[balbano]

Hi,

For some reason I keep seeing the following error message coming from one of my light forwarder clients.

01-12-2012 14:52:02.545 ERROR BTreeCP - failed: failed to mkdir /opt/splunk/var/lib/splunk/fishbucket/splunk_private_db/snapshot.tmp: No space left on device

More than enough space should be available for this so called dir to get created and the appropriate file permissions are in place to make this happen.

Anybody ever see this? If so how can this be corrected.

Let me know.

Thanks.

Brian

[LewisWheeler]

Had same issue - was due to no iNodes remaining, caused by some scripts creating too many files. Ran df -i as per sowings comment above and it was fixed.

[sowings]

"No space left on device" can sometimes occur if you've run out of inodes. In addition to checking "df", consider also checking "df -i".

[jonathon]

I just had the same issue on a couple of my light forwarders, but without the "no space" message. I restarted the forwarders that that took care of the issue. I will update once I dig into this a little more.