All Apps and Add-ons

Hadoop Export functionality is failing

mzorzi
Splunk Employee
Splunk Employee

According to the logs and $SPLUNK_HOME/var/run/splunk/dispatch, the configured search executes successfully and produces results in csv format.

The cursor and CSV header files are written to HDFS filesystem (that means the HDFS connection works and permissions for splunk to write are in order).

Strange message in splunkd.log

/opt/splunk/var/log/splunk/splunkd.log
09-24-2014 21:26:12.066 +0200 WARN AdminManager - Handler 'hdfs_export' has not performed any capability checks for this operation (requestedAction=edit, customAction="force", item="P_WebTrends_CSV"). This may be a bug

And Message from HadoopConnect.log:

"Field 'rmIP' is not presented in fields exported last time. last export fields: ['_time', 'src_ip', 'WT_cg_s', 'WT_co_f']", "value": "_time,rmIP,ipF,a_ip,…"

Tags (1)

mathu
Path Finder

I've had this issue in combination with fillnull:

| fillnull value=XXX

using explicit field values for fillnull helped
i.e.

 | fillnull value=XXX field1, field2, etc.
Get Updates on the Splunk Community!

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...

Integrating Splunk Search API and Quarto to Create Reproducible Investigation ...

 Splunk is More Than Just the Web Console For Digital Forensics and Incident Response (DFIR) practitioners, ...

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...