Splunk Search

download specific CSV columns via the web API?

rwgilt
Explorer

What I want to do is pull down the results of a saved search as a CSV file, which will then be loaded into a data warehouse. I would like to automate this on a nightly basis, so I'm experimenting with the web api.

I've successfully been able to pull down the results of the search I want via the web API, but am running into two issues which I have not found info about in the docs:

  1. When I browse through the results with the web interface, I get 2600 results. However, I'm only getting about 200 in the csv I'm pulling down. How do I get the rest of the result set?

  2. Can I somehow set up the saved search so I only get the fields I am interested in, rather than the other 100 fields I don't care about?

Tags (4)

Stephen_Sorkin
Splunk Employee
Splunk Employee

I assume that you're using the REST API like:

GET /services/search/jobs/<sid>/results?output_mode=csv

If this is the case, there are two arguments to add, field_list and count:

GET /services/search/jobs/<sid>/results?output_mode=csv&field_list=<comma separated field list>&count=0

If you want to page through the results for efficiency, you can use the offset argument in addition to the count argument and make several requests.

Stephen_Sorkin
Splunk Employee
Splunk Employee
0 Karma

rwgilt
Explorer

ps: is this info in the docs somewhere?

0 Karma

rwgilt
Explorer

This does just what I need - thanks!

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

All Work and No Play? Not at .conf26! Unwind at These Evening Events

Between hands-on technical sessions, keynote reveals, and diving into live architectures, .conf26 is packed ...

Join the Hackathon at .conf26 and build a No-Code AI agent

Join us for the AI Agent Buildathon, an in-person, three-hour hands-on Hackathon where you’ll use Splunk Agent ...

Level Up Your Workflow: Mastering Splunk Cloud Management via Terraform

Tech Talk Recap   From Chaos to Control: Scaling Splunk Cloud with Infrastructure as Code Managing apps in ...