All Apps and Add-ons

Hadoop Export functionality is failing

mzorzi
Splunk Employee
Splunk Employee

According to the logs and $SPLUNK_HOME/var/run/splunk/dispatch, the configured search executes successfully and produces results in csv format.

The cursor and CSV header files are written to HDFS filesystem (that means the HDFS connection works and permissions for splunk to write are in order).

Strange message in splunkd.log

/opt/splunk/var/log/splunk/splunkd.log
09-24-2014 21:26:12.066 +0200 WARN AdminManager - Handler 'hdfs_export' has not performed any capability checks for this operation (requestedAction=edit, customAction="force", item="P_WebTrends_CSV"). This may be a bug

And Message from HadoopConnect.log:

"Field 'rmIP' is not presented in fields exported last time. last export fields: ['_time', 'src_ip', 'WT_cg_s', 'WT_co_f']", "value": "_time,rmIP,ipF,a_ip,…"

Tags (1)

mathu
Path Finder

I've had this issue in combination with fillnull:

| fillnull value=XXX

using explicit field values for fillnull helped
i.e.

 | fillnull value=XXX field1, field2, etc.
Get Updates on the Splunk Community!

See just what you’ve been missing | Observability tracks at Splunk University

Looking to sharpen your observability skills so you can better understand how to collect and analyze data from ...

Weezer at .conf25? Say it ain’t so!

Hello Splunkers, The countdown to .conf25 is on-and we've just turned up the volume! We're thrilled to ...

How SC4S Makes Suricata Logs Ingestion Simple

Network security monitoring has become increasingly critical for organizations of all sizes. Splunk has ...