Knowledge Management

How to upload large json format data into kv-store?

rashid47010
Communicator

Hi, everyone,

The customer shared one last JSON formatted file. there are more than 1000 records. Customers want it as a lookup. my thought process is saying that I should use the kV-store approach. but how can I upload a large amount of data into the kV store?

 

Labels (1)
Tags (2)
0 Karma

kamlesh_vaghela
SplunkTrust
SplunkTrust

@rashid47010 

You can store JSON data using KVStore REST API.

Please go through  https://dev.splunk.com/enterprise/docs/developapps/manageknowledge/kvstore/usetherestapitomanagekv and check the Run multiple save operations section.

I have tried the below JSON with my curl command. You can try it in a local machine and validate the data.

 

[{
	"id": "1",
	"name": "Splunk Sweden"
}, {
	"id": "2",
	"name": "Splunk Singapore"
}]

 

Curl

 

curl -k -u admin:admin123     https://localhost:8089/servicesNS/nobody/APP_NAME/storage/collections/data/KV_STORE_COLLECTION/batch_save     -H 'Content-Type: application/json'     -d 'VALID_JSON_DATA'

 

My example Curl.

curl -k -u admin:admin123     https://localhost:8089/servicesNS/nobody/search/storage/collections/data/kvstorecoll/batch_save     -H 'Content-Type: application/json'     -d '[{"id":"1","name": "Splunk Sweden"}, {"id":"2","name": "Splunk Singapore"}]'

 

I hope this will help you.

 

Thanks
KV


If any of my replies help you to solve the problem Or gain knowledge, an upvote would be appreciated.

0 Karma
Get Updates on the Splunk Community!

Splunk Enterprise Security(ES) 7.3 is approaching the end of support. Get ready for ...

Hi friends!    At Splunk, your product success is our top priority. With Enterprise Security (ES), we're here ...

Splunk Enterprise Security 8.x: The Essential Upgrade for Threat Detection, ...

Watch On Demand the Tech Talk, and empower your SOC to reach new heights! Duration: 1 hour  Prepare to ...

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI!Discover how Splunk’s agentic AI ...