Splunk Dev

Know CSV file size before download

brunoabreu
Loves-to-Learn Lots

Using the Splunk Python SDK, is there any way to know the size of the CSV file that will be generated after streaming and writing all the results?

I've managed to achieve this with the approach below, but it makes me to download and iterate the CSV lines two times.

splunk_job = service.jobs.create(query, **kwargs)

# waits job to be done

splunk_job_result_args = {
    "output_mode": "csv"
}

splunk_job_results = splunk_job.results(**splunk_job_result_args)
results_length = 0
for bytes_csv_line in splunk_job_results:
    results_length += len(bytes_csv_line)
splunk_job_results.close()

# checks if the results_length exceeds the limit
# if not, executes the following:

splunk_job_results = splunk_job.results(**splunk_job_result_args)
for bytes_csv_line in splunk_job_results:
    # writes the bytes in a file
splunk_job_results.close()

 

Labels (2)
Tags (5)
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas     Cisco Live 2026 is almost here, and this ...

What Is the Name of the USB Key Inserted by Bob Smith? (BOTS Hint, Not the Answer)

Hello Splunkers,   So you searched, “what is the name of the usb key inserted by bob smith?”  Not gonna lie… ...

Automating Threat Operations and Threat Hunting with Recorded Future

    Automating Threat Operations and Threat Hunting with Recorded Future June 29, 2026 | Register   Is your ...