Getting Data In

Show Source and save as CSV truncate large events?

pde
Path Finder

I have records that consist of fairly large (200+ lines, > 20 Kb per record) XML documents.

When I export the results of a search for these records to CSV, the _raw cell is truncated; the full record is not written to the _raw cell (note: not an Excel issue. The records are not larger than the 32K-1 byte Excel maximum, and editing the CSV directly shows that the record is indeed truncated).

The records are similarly truncated in a "Show Source" view.

What gives?

Thanks

-Pete

Tags (2)
0 Karma
1 Solution

steveyz
Splunk Employee
Splunk Employee

When the UI typically issues a request for events, it will ask the backend to truncate long events above a certain number of lines. My guess is that this limit is in force even for show search and export as csv from the UI, because they share a common access point. To get around this issue, you can append "| outputcsv <filename>" to the end of your search, and the full csv file should be written out to $SPLUNK_HOME/var/run/splunk/<filename>

View solution in original post

0 Karma

steveyz
Splunk Employee
Splunk Employee

When the UI typically issues a request for events, it will ask the backend to truncate long events above a certain number of lines. My guess is that this limit is in force even for show search and export as csv from the UI, because they share a common access point. To get around this issue, you can append "| outputcsv <filename>" to the end of your search, and the full csv file should be written out to $SPLUNK_HOME/var/run/splunk/<filename>

0 Karma

pde
Path Finder

Interesting. The main UI displays the full event...

The solution works, but is of little use to my users, who do not get shell access to the server. I suppose an enhancement is in order.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Classic British Rock Bands

This puzzle series (first published here) is based on extracting information from statements about well-known ...

New to the Community? Join Us for an Exclusive Post .conf26 Welcome Session (Plus a ...

Keep the .conf26 Energy Going: Welcome to the Splunk Community! Whether we scanned your badge at the Community ...

Accelerate Splunk App Development with AI

  Learn how to automate the repetitive parts of your build cycle.   Register to Attend   Join our Tech Talk ...