All Apps and Add-ons

Hadoop Export functionality is failing

mzorzi
Splunk Employee
Splunk Employee

According to the logs and $SPLUNK_HOME/var/run/splunk/dispatch, the configured search executes successfully and produces results in csv format.

The cursor and CSV header files are written to HDFS filesystem (that means the HDFS connection works and permissions for splunk to write are in order).

Strange message in splunkd.log

/opt/splunk/var/log/splunk/splunkd.log
09-24-2014 21:26:12.066 +0200 WARN AdminManager - Handler 'hdfs_export' has not performed any capability checks for this operation (requestedAction=edit, customAction="force", item="P_WebTrends_CSV"). This may be a bug

And Message from HadoopConnect.log:

"Field 'rmIP' is not presented in fields exported last time. last export fields: ['_time', 'src_ip', 'WT_cg_s', 'WT_co_f']", "value": "_time,rmIP,ipF,a_ip,…"

Tags (1)

mathu
Path Finder

I've had this issue in combination with fillnull:

| fillnull value=XXX

using explicit field values for fillnull helped
i.e.

 | fillnull value=XXX field1, field2, etc.
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...

What's new in Splunk Cloud Platform 9.1.2312?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.1.2312! Analysts can ...

What’s New in Splunk Security Essentials 3.8.0?

Splunk Security Essentials (SSE) is an app that can amplify the power of your existing Splunk Cloud Platform, ...